Nov 02 09:55:35 devstack cinder-volume[75889]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 02 09:55:35 devstack cinder-volume[75889]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 02 09:55:35 devstack cinder-volume[75889]: we strongly recommend against using it for new projects. Nov 02 09:55:35 devstack cinder-volume[75889]: If you are already using Eventlet, we recommend migrating to a different Nov 02 09:55:35 devstack cinder-volume[75889]: framework. For more detail see Nov 02 09:55:35 devstack cinder-volume[75889]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 02 09:55:35 devstack cinder-volume[75889]: import eventlet # noqa Nov 02 09:55:38 devstack cinder-volume[75889]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75889) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 02 09:55:38 devstack cinder-volume[75889]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75889) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 02 09:55:38 devstack cinder-volume[75889]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75889) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 02 09:55:39 devstack cinder-volume[75889]: INFO dbcounter [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] Registered counter for database cinder Nov 02 09:55:39 devstack cinder-volume[75889]: DEBUG oslo_db.sqlalchemy.engines [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75889) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 09:55:40 devstack cinder-volume[75889]: DEBUG dbcounter [-] [75889] Writer thread running {{(pid=75889) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 02 09:55:40 devstack cinder-volume[75889]: INFO cinder.rpc [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 02 09:55:40 devstack cinder-volume[75889]: INFO cinder.rpc [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 02 09:55:40 devstack cinder-volume[75889]: DEBUG oslo_db.sqlalchemy.engines [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75889) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 09:55:40 devstack cinder-volume[75889]: INFO cinder.volume.manager [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] Determined volume DB was empty at startup. Nov 02 09:55:40 devstack cinder-volume[75889]: DEBUG cinder.volume.manager [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75889) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 02 09:55:40 devstack cinder-volume[75889]: INFO cinder.volume.manager [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] Service not found for updating active_backend_id, assuming default for driver init. Nov 02 09:55:40 devstack cinder-volume[75889]: WARNING stevedore.named [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 02 09:55:40 devstack cinder-volume[75889]: WARNING castellan.key_manager [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 02 09:55:40 devstack cinder-volume[75889]: WARNING cinder.keymgr.conf_key_mgr [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 02 09:55:40 devstack cinder-volume[75889]: DEBUG cinder.volume.drivers.lvm [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75889) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Nov 02 09:55:40 devstack cinder-volume[75889]: DEBUG oslo_concurrency.processutils [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:55:40 devstack cinder-volume[75889]: DEBUG oslo_concurrency.processutils [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] CMD "cinder-rtstool verify" returned: 0 in 0.462s {{(pid=75889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:55:40 devstack cinder-volume[75889]: DEBUG oslo_db.sqlalchemy.engines [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75889) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 09:55:40 devstack cinder-volume[75889]: INFO cinder.rpc [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Nov 02 09:55:40 devstack cinder-volume[75889]: INFO cinder.rpc [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Nov 02 09:55:40 devstack cinder-volume[75889]: WARNING stevedore.named [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 02 09:55:40 devstack cinder-volume[75889]: WARNING castellan.key_manager [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 02 09:55:40 devstack cinder-volume[75889]: INFO cinder.volume.manager [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Nov 02 09:55:40 devstack cinder-volume[75889]: DEBUG oslo_db.sqlalchemy.engines [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75889) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 09:55:40 devstack cinder-volume[75889]: INFO oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] Starting 1 workers Nov 02 09:55:40 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] Started child 76038 {{(pid=75889) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 02 09:55:40 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] Full set of CONF: {{(pid=75889) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 02 09:55:40 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] ******************************************************************************** {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 02 09:55:40 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] Configuration options gathered from: {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 02 09:55:40 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 02 09:55:40 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 02 09:55:40 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] ================================================================================ {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 02 09:55:40 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] allow_availability_zone_fallback = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:40 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] allow_compression_on_image_upload = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:40 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] allowed_direct_url_schemes = [] {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:40 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] api_rate_limit = True {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:40 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] auth_strategy = keystone {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[76038]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.1) Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] az_cache_duration = 3600 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] backend_availability_zone = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] backend_host = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] backend_name = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] backend_stats_polling_interval = 60 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] backup_api_class = cinder.backup.api.API {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] backup_name_template = backup-%s {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] backup_use_same_host = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] backup_use_temp_snapshot = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] chap_password = **** {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] chap_username = {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] cinder_internal_tenant_project_id = 42dcac582ac04c35befb4b4ddf7da3a1 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] cinder_internal_tenant_user_id = a9a89b4792f64f42b820d2147028e44a {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] cloned_volume_same_az = True {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] cluster = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] compression_format = gzip {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] compute_api_class = cinder.compute.nova.API {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] config_dir = [] {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] config_source = [] {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] control_exchange = openstack {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] debug = True {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] default_availability_zone = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] default_group_type = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] default_volume_type = lvmdriver-1 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] disk_geometry = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] driver_client_cert = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] driver_client_cert_key = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] driver_data_namespace = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] driver_ssl_cert_path = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] driver_ssl_cert_verify = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] driver_use_ssl = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] enable_force_upload = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] enable_new_services = True {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] enable_unsupported_driver = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] enabled_backends = ['lvmdriver-1'] {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] enforce_multipath_for_image_xfer = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] filter_function = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] glance_api_insecure = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] glance_api_servers = ['http://192.168.122.243/image'] {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] glance_api_ssl_compression = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] glance_ca_certificates_file = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] glance_catalog_info = image:glance:publicURL {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] glance_certfile = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] glance_keyfile = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] glance_num_retries = 3 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] glance_request_timeout = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] goodness_function = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] graceful_shutdown_timeout = 5 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] group_api_class = cinder.group.api.API {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] host = devstack {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] image_compress_on_upload = True {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] image_conversion_address_space_limit = 1 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] image_conversion_cpu_limit = 60 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] image_conversion_disable = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] image_introspection_address_space_limit = 1 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] image_introspection_cpu_limit = 60 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] image_upload_use_cinder_backend = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] image_upload_use_internal_tenant = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] image_volume_cache_enabled = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] image_volume_cache_max_count = 0 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] image_volume_cache_max_size_gb = 0 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] init_host_max_objects_retrieval = 0 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[76038]: INFO cinder.volume.manager [None req-821e6ffa-2815-4d8f-94ab-adac2c5ba15e None None] Starting volume driver LVMVolumeDriver (3.0.0) Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] instance_format = [instance: %(uuid)s] {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] iscsi_target_flags = {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] iscsi_write_cache = on {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] iser_helper = tgtadm {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-821e6ffa-2815-4d8f-94ab-adac2c5ba15e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] iser_ip_address = 192.168.122.243 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] iser_port = 3260 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] log_color = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] log_config_append = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] log_dir = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] log_file = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] log_options = True {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] log_rotate_interval = 1 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] log_rotate_interval_type = days {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] log_rotation_type = none {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] max_age = 0 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] max_logfile_count = 30 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] max_logfile_size_mb = 200 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] max_over_subscription_ratio = 20.0 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] message_reap_interval = 86400 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] message_ttl = 2592000 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] migration_create_volume_timeout_secs = 300 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] monkey_patch = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] monkey_patch_modules = [] {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] my_ip = 192.168.122.243 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] no_snapshot_gb_quota = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] num_iser_scan_tries = 3 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] num_shell_tries = 3 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] num_volume_device_scan_tries = 3 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] nvmeof_conn_info_version = 1 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] nvmet_ns_id = 10 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-821e6ffa-2815-4d8f-94ab-adac2c5ba15e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.044s {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] nvmet_port_id = 1 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] osapi_max_limit = 1000 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] osapi_volume_ext_list = [] {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-821e6ffa-2815-4d8f-94ab-adac2c5ba15e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] osapi_volume_listen = 0.0.0.0 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] osapi_volume_listen_port = 8776 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] osapi_volume_use_ssl = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] osapi_volume_workers = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] per_volume_size_limit = -1 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] periodic_fuzzy_delay = 60 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] periodic_interval = 60 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] project_id_regex = [0-9a-f\-]+ {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] public_endpoint = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] publish_errors = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] quota_backup_gigabytes = 1000 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] quota_backups = 10 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] quota_gigabytes = 1000 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] quota_groups = 10 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] quota_snapshots = 10 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] quota_volumes = 10 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] rate_limit_burst = 0 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] rate_limit_except_level = CRITICAL {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] rate_limit_interval = 0 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] reinit_driver_count = 3 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] replication_device = **** {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] report_discard_supported = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] report_interval = 120 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] reservation_clean_interval = 86400 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] reservation_expire = 86400 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] reserved_image_namespaces = [] {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] reserved_percentage = 0 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] rpc_response_timeout = 120 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] run_external_periodic_tasks = True {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] scst_target_driver = iscsi {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] scst_target_iqn_name = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] service_down_time = 720 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] shell_completion = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] snapshot_name_template = snapshot-%s {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] snapshot_same_host = True {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] split_loggers = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] state_path = /opt/stack/data/cinder {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] storage_availability_zone = nova {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] storage_protocol = iSCSI {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] syslog_log_facility = LOG_USER {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] target_helper = lioadm {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] target_ip_address = 192.168.122.243 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] target_port = 3260 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] target_protocol = iscsi {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] target_secondary_ip_addresses = [] {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] trace_flags = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] transfer_api_class = cinder.transfer.api.API {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] transport_url = **** {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] until_refresh = 0 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] use_chap_auth = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] use_default_quota_class = True {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] use_journal = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] use_json = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] use_multipath_for_image_xfer = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] use_stderr = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] use_syslog = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] verify_glance_signatures = enabled {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] volume_api_class = cinder.volume.api.API {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] volume_backend_name = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] volume_clear = zero {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] volume_clear_ionice = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] volume_clear_size = 0 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] volume_copy_bps_limit = 0 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] volume_dd_blocksize = 1M {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] volume_name_template = volume-%s {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] volume_service_inithost_offload = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] volume_usage_audit_period = month {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] zoning_mode = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] oslo_concurrency.disable_process_locking = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] keystone_authtoken.auth_section = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] keystone_authtoken.auth_type = password {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-821e6ffa-2815-4d8f-94ab-adac2c5ba15e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.043s {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:55:41 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-821e6ffa-2815-4d8f-94ab-adac2c5ba15e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] keystone_authtoken.auth_version = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] keystone_authtoken.cache = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] keystone_authtoken.certfile = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] keystone_authtoken.include_service_catalog = True {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] keystone_authtoken.insecure = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] keystone_authtoken.interface = public {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] keystone_authtoken.keyfile = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] keystone_authtoken.memcache_password = **** {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] keystone_authtoken.memcache_username = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] keystone_authtoken.region_name = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] keystone_authtoken.service_token_roles_required = True {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] keystone_authtoken.service_type = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.243/identity {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] cache.backend = dogpile.cache.null {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] cache.backend_argument = **** {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] cache.backend_expiration_time = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] cache.config_prefix = cache.oslo {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] cache.debug_cache_backend = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] cache.enable_retry_client = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] cache.enable_socket_keepalive = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] cache.enabled = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] cache.expiration_time = 600 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] cache.hashclient_retry_attempts = 2 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] cache.memcache_dead_retry = 300 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] cache.memcache_pool_maxsize = 10 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] cache.memcache_sasl_enabled = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] cache.password = **** {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] cache.proxies = [] {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-821e6ffa-2815-4d8f-94ab-adac2c5ba15e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.043s {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:55:41 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-821e6ffa-2815-4d8f-94ab-adac2c5ba15e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] cache.redis_db = 0 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] cache.redis_server = localhost:6379 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] cache.retry_attempts = 2 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] cache.retry_delay = 0.0 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] cache.socket_keepalive_count = 1 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] cache.socket_keepalive_idle = 1 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] cache.socket_keepalive_interval = 1 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] cache.socket_timeout = 1.0 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] cache.tls_allowed_ciphers = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] cache.tls_cafile = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] cache.tls_certfile = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] cache.tls_enabled = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] cache.tls_keyfile = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] cache.username = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] coordination.backend_url = **** {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] database.asyncio_connection = **** {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] database.asyncio_slave_connection = **** {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] database.backend = sqlalchemy {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] database.connection = **** {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] database.connection_debug = 0 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] database.connection_parameters = {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] database.connection_recycle_time = 3600 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] database.connection_trace = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] database.db_inc_retry_interval = True {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] database.db_max_retries = 20 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] database.db_max_retry_interval = 10 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] database.db_retry_interval = 1 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] database.max_overflow = 50 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack sudo[76045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] database.max_pool_size = 5 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] database.max_retries = 10 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack sudo[76045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] database.mysql_wsrep_sync_wait = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] database.pool_timeout = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] database.retry_interval = 10 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] database.slave_connection = **** {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] database.sqlite_synchronous = True {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] database.synchronous_reader = True {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] database.use_db_reconnect = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] oslo_messaging_tracing.insecure = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] profiler.connection_string = messaging:// {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] profiler.enabled = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] profiler.es_doc_type = notification {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] profiler.es_scroll_size = 10000 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] profiler.es_scroll_time = 2m {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] profiler.filter_error_trace = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] profiler.hmac_keys = **** {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] profiler.sentinel_service_name = mymaster {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] profiler.socket_timeout = 0.1 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] profiler.trace_requests = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] profiler.trace_sqlalchemy = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] profiler_jaeger.process_tags = {} {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] profiler_jaeger.service_name_prefix = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] profiler_otlp.service_name_prefix = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] oslo_policy.enforce_new_defaults = True {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] oslo_policy.policy_default_rule = default {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] oslo_policy.policy_file = policy.yaml {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] oslo_policy.remote_timeout = 60.0 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] privsep_osbrick.group = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] privsep_osbrick.helper_command = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] privsep_osbrick.user = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] cinder_sys_admin.group = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] cinder_sys_admin.helper_command = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] cinder_sys_admin.user = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] service_user.auth_section = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] service_user.auth_type = password {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] service_user.cafile = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] service_user.certfile = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] service_user.collect_timing = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] service_user.insecure = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] service_user.keyfile = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] service_user.send_service_user_token = True {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] service_user.split_loggers = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] service_user.timeout = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] service_user.tls_ciphers = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] service_user.tls_min_version = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] glance.auth_section = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] glance.auth_type = password {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] glance.certfile = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] glance.collect_timing = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] glance.insecure = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] glance.keyfile = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] glance.region_name = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] glance.split_loggers = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] glance.timeout = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] glance.tls_ciphers = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] glance.tls_min_version = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] backend_defaults.backend_availability_zone = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] backend_defaults.chap_password = **** {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] backend_defaults.chap_username = {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] backend_defaults.disk_geometry = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] backend_defaults.driver_client_cert = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] backend_defaults.driver_client_cert_key = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] backend_defaults.driver_data_namespace = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] backend_defaults.driver_use_ssl = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] backend_defaults.extra_capabilities = {} {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] backend_defaults.filter_function = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] backend_defaults.goodness_function = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] backend_defaults.iscsi_target_flags = {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] backend_defaults.iscsi_write_cache = on {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] backend_defaults.iser_helper = tgtadm {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] backend_defaults.iser_ip_address = 192.168.122.243 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] backend_defaults.iser_port = 3260 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] backend_defaults.lvm_mirrors = 0 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] backend_defaults.lvm_share_target = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] backend_defaults.lvm_type = auto {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] backend_defaults.num_shell_tries = 3 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] backend_defaults.replication_device = **** {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] backend_defaults.report_discard_supported = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] backend_defaults.reserved_percentage = 0 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] backend_defaults.target_helper = tgtadm {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] backend_defaults.target_ip_address = 192.168.122.243 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] backend_defaults.target_port = 3260 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] backend_defaults.target_protocol = iscsi {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] backend_defaults.trace_flags = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] backend_defaults.unique_fqdn_network = True {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] backend_defaults.use_chap_auth = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] backend_defaults.volume_backend_name = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] backend_defaults.volume_clear = zero {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] backend_defaults.volume_clear_ionice = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] backend_defaults.volume_clear_size = 0 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] backend_defaults.volume_group = cinder-volumes {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] oslo_reports.file_event_handler = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] oslo_reports.log_dir = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] lvmdriver-1.backend_host = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] lvmdriver-1.chap_password = **** {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] lvmdriver-1.chap_username = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] lvmdriver-1.chiscsi_conf = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] lvmdriver-1.disk_geometry = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] lvmdriver-1.driver_client_cert = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] lvmdriver-1.driver_use_ssl = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] lvmdriver-1.extra_capabilities = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] lvmdriver-1.filter_function = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] lvmdriver-1.goodness_function = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] lvmdriver-1.iser_helper = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] lvmdriver-1.iser_ip_address = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] lvmdriver-1.iser_port = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] lvmdriver-1.lvm_conf_file = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] lvmdriver-1.lvm_mirrors = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] lvmdriver-1.lvm_share_target = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] lvmdriver-1.lvm_type = auto {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] lvmdriver-1.num_shell_tries = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] lvmdriver-1.nvmet_port_id = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] lvmdriver-1.replication_device = **** {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] lvmdriver-1.report_discard_supported = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] lvmdriver-1.reserved_percentage = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] lvmdriver-1.scst_target_driver = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] lvmdriver-1.storage_protocol = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] lvmdriver-1.target_helper = lioadm {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] lvmdriver-1.target_ip_address = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] lvmdriver-1.target_port = 3260 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] lvmdriver-1.target_protocol = iscsi {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] lvmdriver-1.trace_flags = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] lvmdriver-1.use_chap_auth = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] lvmdriver-1.volume_clear = zero {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] lvmdriver-1.volume_clear_size = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] lvmdriver-1.volumes_dir = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] oslo_messaging_rabbit.ssl = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] oslo_messaging_notifications.driver = [] {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] oslo_messaging_notifications.retry = -1 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] key_manager.fixed_key = **** {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] barbican.barbican_api_version = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] barbican.barbican_endpoint = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] barbican.barbican_endpoint_type = public {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] barbican.barbican_region_name = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] barbican.cafile = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] barbican.certfile = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] barbican.collect_timing = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] barbican.insecure = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] barbican.keyfile = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] barbican.number_of_retries = 60 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] barbican.retry_delay = 1 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] barbican.send_service_user_token = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] barbican.split_loggers = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] barbican.timeout = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] barbican.tls_ciphers = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] barbican.tls_min_version = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] barbican.verify_ssl = True {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] barbican.verify_ssl_path = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] barbican_service_user.auth_section = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] barbican_service_user.auth_type = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] barbican_service_user.cafile = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] barbican_service_user.certfile = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] barbican_service_user.collect_timing = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] barbican_service_user.insecure = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] barbican_service_user.keyfile = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] barbican_service_user.split_loggers = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] barbican_service_user.timeout = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] barbican_service_user.tls_ciphers = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] barbican_service_user.tls_min_version = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] vault.approle_role_id = **** {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] vault.approle_secret_id = **** {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] vault.auth_method = approle {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] vault.auth_path = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] vault.kv_mountpoint = secret {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] vault.kv_path = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] vault.kv_version = 2 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] vault.namespace = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] vault.root_token_id = **** {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] vault.ssl_ca_crt_file = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] vault.timeout = 60.0 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] vault.token_file = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] vault.token_role = None {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] vault.use_ssl = False {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:55:41 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] ******************************************************************************** {{(pid=75889) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 02 09:55:41 devstack sudo[76045]: pam_unix(sudo:session): session closed for user root Nov 02 09:55:41 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-821e6ffa-2815-4d8f-94ab-adac2c5ba15e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.398s {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:55:41 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-821e6ffa-2815-4d8f-94ab-adac2c5ba15e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:55:41 devstack sudo[76157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 09:55:41 devstack sudo[76157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:55:42 devstack sudo[76157]: pam_unix(sudo:session): session closed for user root Nov 02 09:55:42 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-821e6ffa-2815-4d8f-94ab-adac2c5ba15e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.431s {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:55:42 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-821e6ffa-2815-4d8f-94ab-adac2c5ba15e None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 09:55:42 devstack cinder-volume[76038]: INFO cinder.brick.local_dev.lvm [None req-821e6ffa-2815-4d8f-94ab-adac2c5ba15e None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Nov 02 09:55:42 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-821e6ffa-2815-4d8f-94ab-adac2c5ba15e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:55:42 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-821e6ffa-2815-4d8f-94ab-adac2c5ba15e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:55:42 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-821e6ffa-2815-4d8f-94ab-adac2c5ba15e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:55:42 devstack sudo[76294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 02 09:55:42 devstack sudo[76294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:55:42 devstack sudo[76294]: pam_unix(sudo:session): session closed for user root Nov 02 09:55:42 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-821e6ffa-2815-4d8f-94ab-adac2c5ba15e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.298s {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:55:42 devstack cinder-volume[76038]: DEBUG cinder.brick.local_dev.lvm [None req-821e6ffa-2815-4d8f-94ab-adac2c5ba15e None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76038) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Nov 02 09:55:42 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-821e6ffa-2815-4d8f-94ab-adac2c5ba15e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:55:42 devstack sudo[76407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 09:55:42 devstack sudo[76407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:55:43 devstack sudo[76407]: pam_unix(sudo:session): session closed for user root Nov 02 09:55:43 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-821e6ffa-2815-4d8f-94ab-adac2c5ba15e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.669s {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:55:43 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-821e6ffa-2815-4d8f-94ab-adac2c5ba15e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:55:43 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-821e6ffa-2815-4d8f-94ab-adac2c5ba15e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:55:43 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-821e6ffa-2815-4d8f-94ab-adac2c5ba15e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:55:43 devstack sudo[76650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 09:55:43 devstack sudo[76650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:55:43 devstack sudo[76650]: pam_unix(sudo:session): session closed for user root Nov 02 09:55:43 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-821e6ffa-2815-4d8f-94ab-adac2c5ba15e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.266s {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:55:43 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-821e6ffa-2815-4d8f-94ab-adac2c5ba15e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:55:43 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-821e6ffa-2815-4d8f-94ab-adac2c5ba15e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:55:43 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-821e6ffa-2815-4d8f-94ab-adac2c5ba15e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:55:43 devstack sudo[76654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Nov 02 09:55:43 devstack sudo[76654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:55:43 devstack sudo[76654]: pam_unix(sudo:session): session closed for user root Nov 02 09:55:43 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-821e6ffa-2815-4d8f-94ab-adac2c5ba15e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.381s {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:55:43 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-821e6ffa-2815-4d8f-94ab-adac2c5ba15e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:55:43 devstack sudo[76738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 02 09:55:43 devstack sudo[76738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:55:44 devstack sudo[76738]: pam_unix(sudo:session): session closed for user root Nov 02 09:55:44 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-821e6ffa-2815-4d8f-94ab-adac2c5ba15e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.278s {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:55:44 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-821e6ffa-2815-4d8f-94ab-adac2c5ba15e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:55:44 devstack sudo[76741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 02 09:55:44 devstack sudo[76741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:55:44 devstack sudo[76741]: pam_unix(sudo:session): session closed for user root Nov 02 09:55:44 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-821e6ffa-2815-4d8f-94ab-adac2c5ba15e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.320s {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:55:44 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-821e6ffa-2815-4d8f-94ab-adac2c5ba15e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:55:44 devstack sudo[76803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 09:55:44 devstack sudo[76803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:55:44 devstack sudo[76803]: pam_unix(sudo:session): session closed for user root Nov 02 09:55:44 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-821e6ffa-2815-4d8f-94ab-adac2c5ba15e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.338s {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:55:44 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-821e6ffa-2815-4d8f-94ab-adac2c5ba15e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:55:44 devstack sudo[76833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 09:55:44 devstack sudo[76833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:55:44 devstack sudo[76833]: pam_unix(sudo:session): session closed for user root Nov 02 09:55:44 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-821e6ffa-2815-4d8f-94ab-adac2c5ba15e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.302s {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:55:44 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-821e6ffa-2815-4d8f-94ab-adac2c5ba15e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:55:45 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-821e6ffa-2815-4d8f-94ab-adac2c5ba15e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:55:45 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-821e6ffa-2815-4d8f-94ab-adac2c5ba15e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:55:45 devstack sudo[76837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 09:55:45 devstack sudo[76837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:55:45 devstack sudo[76837]: pam_unix(sudo:session): session closed for user root Nov 02 09:55:45 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-821e6ffa-2815-4d8f-94ab-adac2c5ba15e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.304s {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:55:45 devstack cinder-volume[76038]: INFO cinder.volume.drivers.lvm [None req-821e6ffa-2815-4d8f-94ab-adac2c5ba15e None None] Enabling LVM thin provisioning by default because a thin pool exists. Nov 02 09:55:45 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-821e6ffa-2815-4d8f-94ab-adac2c5ba15e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:55:45 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-821e6ffa-2815-4d8f-94ab-adac2c5ba15e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:55:45 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-821e6ffa-2815-4d8f-94ab-adac2c5ba15e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:55:45 devstack sudo[76847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 09:55:45 devstack sudo[76847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:55:45 devstack sudo[76847]: pam_unix(sudo:session): session closed for user root Nov 02 09:55:45 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-821e6ffa-2815-4d8f-94ab-adac2c5ba15e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.296s {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:55:45 devstack cinder-volume[76038]: DEBUG cinder.volume.drivers.lvm [None req-821e6ffa-2815-4d8f-94ab-adac2c5ba15e None None] Updating volume stats {{(pid=76038) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 02 09:55:45 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-821e6ffa-2815-4d8f-94ab-adac2c5ba15e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:55:45 devstack sudo[76850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 02 09:55:45 devstack sudo[76850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:55:45 devstack sudo[76850]: pam_unix(sudo:session): session closed for user root Nov 02 09:55:45 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-821e6ffa-2815-4d8f-94ab-adac2c5ba15e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.285s {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:55:45 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-821e6ffa-2815-4d8f-94ab-adac2c5ba15e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:55:45 devstack sudo[76853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 09:55:45 devstack sudo[76853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:55:46 devstack sudo[76853]: pam_unix(sudo:session): session closed for user root Nov 02 09:55:46 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-821e6ffa-2815-4d8f-94ab-adac2c5ba15e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.307s {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:55:46 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-821e6ffa-2815-4d8f-94ab-adac2c5ba15e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:55:46 devstack sudo[76856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 09:55:46 devstack sudo[76856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:55:46 devstack sudo[76856]: pam_unix(sudo:session): session closed for user root Nov 02 09:55:46 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-821e6ffa-2815-4d8f-94ab-adac2c5ba15e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.285s {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:55:46 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-821e6ffa-2815-4d8f-94ab-adac2c5ba15e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:55:46 devstack sudo[76859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 09:55:46 devstack sudo[76859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:55:46 devstack sudo[76859]: pam_unix(sudo:session): session closed for user root Nov 02 09:55:46 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-821e6ffa-2815-4d8f-94ab-adac2c5ba15e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.311s {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:55:46 devstack cinder-volume[76038]: INFO cinder.volume.driver [None req-821e6ffa-2815-4d8f-94ab-adac2c5ba15e None None] Driver hasn't implemented _init_vendor_properties() Nov 02 09:55:46 devstack cinder-volume[76038]: DEBUG cinder.volume.driver [None req-821e6ffa-2815-4d8f-94ab-adac2c5ba15e None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76038) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 02 09:55:46 devstack cinder-volume[76038]: DEBUG oslo_db.sqlalchemy.engines [None req-821e6ffa-2815-4d8f-94ab-adac2c5ba15e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76038) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 09:55:46 devstack cinder-volume[76038]: DEBUG dbcounter [-] [76038] Writer thread running {{(pid=76038) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 02 09:55:46 devstack cinder-volume[76038]: DEBUG cinder.db.api [None req-821e6ffa-2815-4d8f-94ab-adac2c5ba15e None None] Building query based on filter {{(pid=76038) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Nov 02 09:55:46 devstack cinder-volume[76038]: DEBUG cinder.image.image_utils [None req-821e6ffa-2815-4d8f-94ab-adac2c5ba15e None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76038) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 02 09:55:46 devstack cinder-volume[76038]: INFO cinder.keymgr.migration [None req-0e12f14e-209b-44f6-bc60-b18a718ffa5f None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 02 09:55:46 devstack cinder-volume[76038]: DEBUG cinder.volume.drivers.lvm [None req-821e6ffa-2815-4d8f-94ab-adac2c5ba15e None None] Updating volume stats {{(pid=76038) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 02 09:55:46 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-821e6ffa-2815-4d8f-94ab-adac2c5ba15e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:55:47 devstack sudo[76863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 02 09:55:47 devstack sudo[76863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:55:47 devstack sudo[76863]: pam_unix(sudo:session): session closed for user root Nov 02 09:55:47 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-821e6ffa-2815-4d8f-94ab-adac2c5ba15e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.353s {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:55:47 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-821e6ffa-2815-4d8f-94ab-adac2c5ba15e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:55:47 devstack sudo[76868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 09:55:47 devstack sudo[76868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:55:47 devstack sudo[76868]: pam_unix(sudo:session): session closed for user root Nov 02 09:55:47 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-821e6ffa-2815-4d8f-94ab-adac2c5ba15e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.350s {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:55:47 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-821e6ffa-2815-4d8f-94ab-adac2c5ba15e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:55:47 devstack sudo[76871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 09:55:47 devstack sudo[76871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:55:47 devstack sudo[76871]: pam_unix(sudo:session): session closed for user root Nov 02 09:55:47 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-821e6ffa-2815-4d8f-94ab-adac2c5ba15e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.297s {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:55:47 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-821e6ffa-2815-4d8f-94ab-adac2c5ba15e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:55:48 devstack sudo[76874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 09:55:48 devstack sudo[76874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:55:48 devstack sudo[76874]: pam_unix(sudo:session): session closed for user root Nov 02 09:55:48 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-821e6ffa-2815-4d8f-94ab-adac2c5ba15e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.297s {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:55:48 devstack cinder-volume[76038]: DEBUG cinder.manager [None req-821e6ffa-2815-4d8f-94ab-adac2c5ba15e None None] Notifying Schedulers of capabilities ... {{(pid=76038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:55:48 devstack cinder-volume[76038]: INFO cinder.volume.manager [None req-821e6ffa-2815-4d8f-94ab-adac2c5ba15e None None] Driver initialization completed successfully. Nov 02 09:55:48 devstack cinder-volume[76038]: INFO cinder.manager [None req-821e6ffa-2815-4d8f-94ab-adac2c5ba15e None None] Initiating service 2 cleanup Nov 02 09:55:48 devstack cinder-volume[76038]: INFO cinder.manager [None req-821e6ffa-2815-4d8f-94ab-adac2c5ba15e None None] Service 2 cleanup completed. Nov 02 09:55:48 devstack cinder-volume[76038]: DEBUG cinder.service [None req-821e6ffa-2815-4d8f-94ab-adac2c5ba15e None None] Creating RPC server for service cinder-volume {{(pid=76038) start /opt/stack/cinder/cinder/service.py:231}} Nov 02 09:55:48 devstack cinder-volume[76038]: DEBUG cinder.service [None req-821e6ffa-2815-4d8f-94ab-adac2c5ba15e None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76038) start /opt/stack/cinder/cinder/service.py:237}} Nov 02 09:55:48 devstack cinder-volume[76038]: INFO cinder.volume.manager [None req-821e6ffa-2815-4d8f-94ab-adac2c5ba15e None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Nov 02 09:55:48 devstack cinder-volume[76038]: DEBUG cinder.volume.drivers.lvm [None req-821e6ffa-2815-4d8f-94ab-adac2c5ba15e None None] Updating volume stats {{(pid=76038) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 02 09:55:48 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-821e6ffa-2815-4d8f-94ab-adac2c5ba15e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:55:48 devstack sudo[76879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 02 09:55:48 devstack sudo[76879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:55:48 devstack sudo[76879]: pam_unix(sudo:session): session closed for user root Nov 02 09:55:48 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-821e6ffa-2815-4d8f-94ab-adac2c5ba15e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.295s {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:55:48 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-821e6ffa-2815-4d8f-94ab-adac2c5ba15e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:55:48 devstack sudo[76883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 09:55:48 devstack sudo[76883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:55:49 devstack sudo[76883]: pam_unix(sudo:session): session closed for user root Nov 02 09:55:49 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-821e6ffa-2815-4d8f-94ab-adac2c5ba15e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.347s {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:55:49 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-821e6ffa-2815-4d8f-94ab-adac2c5ba15e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:55:49 devstack sudo[76889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 09:55:49 devstack sudo[76889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:55:49 devstack sudo[76889]: pam_unix(sudo:session): session closed for user root Nov 02 09:55:49 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-821e6ffa-2815-4d8f-94ab-adac2c5ba15e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.290s {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:55:49 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-821e6ffa-2815-4d8f-94ab-adac2c5ba15e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:55:49 devstack sudo[76893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 09:55:49 devstack sudo[76893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:55:49 devstack sudo[76893]: pam_unix(sudo:session): session closed for user root Nov 02 09:55:49 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-821e6ffa-2815-4d8f-94ab-adac2c5ba15e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.324s {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:55:49 devstack cinder-volume[76038]: INFO cinder.volume.manager [None req-821e6ffa-2815-4d8f-94ab-adac2c5ba15e None None] Driver post RPC initialization completed successfully. Nov 02 09:55:50 devstack cinder-volume[75889]: DEBUG dbcounter [-] [75889] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75889) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 09:55:58 devstack cinder-volume[76038]: DEBUG dbcounter [-] [76038] Writing DB stats cinder:SELECT=3 {{(pid=76038) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 09:55:59 devstack cinder-volume[76038]: DEBUG dbcounter [-] [76038] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=76038) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 09:56:40 devstack cinder-volume[76038]: DEBUG oslo_service.periodic_task [None req-69f711d7-d7bb-4312-a228-b06e33d32f20 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76038) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 09:56:40 devstack cinder-volume[76038]: DEBUG cinder.volume.drivers.lvm [None req-69f711d7-d7bb-4312-a228-b06e33d32f20 None None] Updating volume stats {{(pid=76038) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 02 09:56:40 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-69f711d7-d7bb-4312-a228-b06e33d32f20 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:56:40 devstack sudo[78751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 02 09:56:40 devstack sudo[78751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:56:41 devstack sudo[78751]: pam_unix(sudo:session): session closed for user root Nov 02 09:56:41 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-69f711d7-d7bb-4312-a228-b06e33d32f20 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.324s {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:56:41 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-69f711d7-d7bb-4312-a228-b06e33d32f20 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:56:41 devstack sudo[78754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 09:56:41 devstack sudo[78754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:56:41 devstack sudo[78754]: pam_unix(sudo:session): session closed for user root Nov 02 09:56:41 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-69f711d7-d7bb-4312-a228-b06e33d32f20 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.276s {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:56:41 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-69f711d7-d7bb-4312-a228-b06e33d32f20 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:56:41 devstack sudo[78757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 09:56:41 devstack sudo[78757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:56:41 devstack sudo[78757]: pam_unix(sudo:session): session closed for user root Nov 02 09:56:41 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-69f711d7-d7bb-4312-a228-b06e33d32f20 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.288s {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:56:41 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-69f711d7-d7bb-4312-a228-b06e33d32f20 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:56:41 devstack sudo[78760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 09:56:41 devstack sudo[78760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:56:42 devstack sudo[78760]: pam_unix(sudo:session): session closed for user root Nov 02 09:56:42 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-69f711d7-d7bb-4312-a228-b06e33d32f20 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.278s {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:56:42 devstack cinder-volume[76038]: DEBUG cinder.manager [None req-69f711d7-d7bb-4312-a228-b06e33d32f20 None None] Notifying Schedulers of capabilities ... {{(pid=76038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:56:42 devstack cinder-volume[76038]: DEBUG oslo_service.periodic_task [None req-69f711d7-d7bb-4312-a228-b06e33d32f20 None None] Running periodic task VolumeManager._thread_info {{(pid=76038) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 09:56:42 devstack cinder-volume[76038]: DEBUG cinder.volume.manager [None req-69f711d7-d7bb-4312-a228-b06e33d32f20 None None] thread count: 6 {{(pid=76038) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 09:56:42 devstack cinder-volume[76038]: DEBUG cinder.volume.manager [None req-69f711d7-d7bb-4312-a228-b06e33d32f20 None None] thread info: [<_MainThread(MainThread, started 128750256287872)>, , , , , ] {{(pid=76038) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 09:57:40 devstack cinder-volume[76038]: DEBUG oslo_service.periodic_task [None req-69f711d7-d7bb-4312-a228-b06e33d32f20 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76038) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 09:57:40 devstack cinder-volume[76038]: DEBUG cinder.volume.drivers.lvm [None req-69f711d7-d7bb-4312-a228-b06e33d32f20 None None] Updating volume stats {{(pid=76038) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 02 09:57:40 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-69f711d7-d7bb-4312-a228-b06e33d32f20 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:40 devstack sudo[82016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 02 09:57:40 devstack sudo[82016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:41 devstack sudo[82016]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:41 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-69f711d7-d7bb-4312-a228-b06e33d32f20 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.296s {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:41 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-69f711d7-d7bb-4312-a228-b06e33d32f20 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:41 devstack sudo[82019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 09:57:41 devstack sudo[82019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:41 devstack sudo[82019]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:41 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-69f711d7-d7bb-4312-a228-b06e33d32f20 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.289s {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:41 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-69f711d7-d7bb-4312-a228-b06e33d32f20 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:41 devstack sudo[82022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 09:57:41 devstack sudo[82022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:41 devstack sudo[82022]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:41 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-69f711d7-d7bb-4312-a228-b06e33d32f20 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.276s {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:41 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-69f711d7-d7bb-4312-a228-b06e33d32f20 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:41 devstack sudo[82025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 09:57:41 devstack sudo[82025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:42 devstack sudo[82025]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:42 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-69f711d7-d7bb-4312-a228-b06e33d32f20 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.272s {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:42 devstack cinder-volume[76038]: DEBUG cinder.manager [None req-69f711d7-d7bb-4312-a228-b06e33d32f20 None None] Notifying Schedulers of capabilities ... {{(pid=76038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:57:59 devstack cinder-volume[76038]: DEBUG dbcounter [-] [76038] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76038) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 09:58:40 devstack cinder-volume[76038]: DEBUG oslo_service.periodic_task [None req-69f711d7-d7bb-4312-a228-b06e33d32f20 None None] Running periodic task VolumeManager._thread_info {{(pid=76038) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 09:58:40 devstack cinder-volume[76038]: DEBUG cinder.volume.manager [None req-69f711d7-d7bb-4312-a228-b06e33d32f20 None None] thread count: 6 {{(pid=76038) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 09:58:40 devstack cinder-volume[76038]: DEBUG cinder.volume.manager [None req-69f711d7-d7bb-4312-a228-b06e33d32f20 None None] thread info: [<_MainThread(MainThread, started 128750256287872)>, , , , , ] {{(pid=76038) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 09:59:40 devstack cinder-volume[76038]: DEBUG oslo_service.periodic_task [None req-69f711d7-d7bb-4312-a228-b06e33d32f20 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76038) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 09:59:40 devstack cinder-volume[76038]: DEBUG cinder.volume.drivers.lvm [None req-69f711d7-d7bb-4312-a228-b06e33d32f20 None None] Updating volume stats {{(pid=76038) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 02 09:59:40 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-69f711d7-d7bb-4312-a228-b06e33d32f20 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:40 devstack sudo[85044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 02 09:59:40 devstack sudo[85044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:41 devstack sudo[85044]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:41 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-69f711d7-d7bb-4312-a228-b06e33d32f20 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:41 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-69f711d7-d7bb-4312-a228-b06e33d32f20 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:41 devstack sudo[85047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 09:59:41 devstack sudo[85047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:41 devstack sudo[85047]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:41 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-69f711d7-d7bb-4312-a228-b06e33d32f20 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:41 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-69f711d7-d7bb-4312-a228-b06e33d32f20 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:41 devstack sudo[85050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 09:59:41 devstack sudo[85050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:41 devstack sudo[85050]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:41 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-69f711d7-d7bb-4312-a228-b06e33d32f20 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.310s {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:41 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-69f711d7-d7bb-4312-a228-b06e33d32f20 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:41 devstack sudo[85055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 09:59:41 devstack sudo[85055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:42 devstack sudo[85055]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:42 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-69f711d7-d7bb-4312-a228-b06e33d32f20 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.312s {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:42 devstack cinder-volume[76038]: DEBUG cinder.manager [None req-69f711d7-d7bb-4312-a228-b06e33d32f20 None None] Notifying Schedulers of capabilities ... {{(pid=76038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:59:42 devstack cinder-volume[76038]: DEBUG oslo_service.periodic_task [None req-69f711d7-d7bb-4312-a228-b06e33d32f20 None None] Running periodic task VolumeManager._thread_info {{(pid=76038) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 09:59:42 devstack cinder-volume[76038]: DEBUG cinder.volume.manager [None req-69f711d7-d7bb-4312-a228-b06e33d32f20 None None] thread count: 6 {{(pid=76038) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 09:59:42 devstack cinder-volume[76038]: DEBUG cinder.volume.manager [None req-69f711d7-d7bb-4312-a228-b06e33d32f20 None None] thread info: [<_MainThread(MainThread, started 128750256287872)>, , , , , ] {{(pid=76038) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 09:59:59 devstack cinder-volume[76038]: DEBUG dbcounter [-] [76038] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76038) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:00:33 devstack cinder-volume[75889]: INFO oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] Caught SIGTERM, stopping children Nov 02 10:00:33 devstack cinder-volume[75889]: DEBUG oslo_concurrency.lockutils [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] Acquiring lock "singleton_lock" {{(pid=75889) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 02 10:00:33 devstack cinder-volume[75889]: DEBUG oslo_concurrency.lockutils [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] Acquired lock "singleton_lock" {{(pid=75889) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 02 10:00:33 devstack cinder-volume[75889]: DEBUG oslo_concurrency.lockutils [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] Releasing lock "singleton_lock" {{(pid=75889) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 02 10:00:33 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] Stop services. {{(pid=75889) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Nov 02 10:00:33 devstack cinder-volume[75889]: DEBUG oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] Killing children. {{(pid=75889) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Nov 02 10:00:33 devstack cinder-volume[75889]: INFO oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] Waiting on 1 children to exit Nov 02 10:00:38 devstack cinder-volume[76038]: DEBUG oslo_concurrency.lockutils [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] Acquiring lock "singleton_lock" {{(pid=76038) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 02 10:00:38 devstack cinder-volume[76038]: DEBUG oslo_concurrency.lockutils [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] Acquired lock "singleton_lock" {{(pid=76038) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 02 10:00:38 devstack cinder-volume[76038]: DEBUG oslo_concurrency.lockutils [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] Releasing lock "singleton_lock" {{(pid=76038) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 02 10:00:38 devstack cinder-volume[76038]: WARNING amqp [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 02 10:00:38 devstack cinder-volume[76038]: WARNING amqp [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 02 10:00:38 devstack cinder-volume[75889]: INFO oslo_service.backend._eventlet.service [None req-d627b4ab-b78a-4ad6-b950-ec5d9e6c1fe0 None None] Child 76038 exited with status 0 Nov 02 10:00:38 devstack cinder-volume[86122]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 02 10:00:38 devstack cinder-volume[86122]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 02 10:00:38 devstack cinder-volume[86122]: we strongly recommend against using it for new projects. Nov 02 10:00:38 devstack cinder-volume[86122]: If you are already using Eventlet, we recommend migrating to a different Nov 02 10:00:38 devstack cinder-volume[86122]: framework. For more detail see Nov 02 10:00:38 devstack cinder-volume[86122]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 02 10:00:38 devstack cinder-volume[86122]: import eventlet # noqa Nov 02 10:00:41 devstack cinder-volume[86122]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86122) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 02 10:00:41 devstack cinder-volume[86122]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86122) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 02 10:00:41 devstack cinder-volume[86122]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86122) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 02 10:00:42 devstack cinder-volume[86122]: INFO dbcounter [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] Registered counter for database cinder Nov 02 10:00:42 devstack cinder-volume[86122]: DEBUG oslo_db.sqlalchemy.engines [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86122) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 10:00:42 devstack cinder-volume[86122]: DEBUG dbcounter [-] [86122] Writer thread running {{(pid=86122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 02 10:00:42 devstack cinder-volume[86122]: INFO cinder.rpc [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 02 10:00:42 devstack cinder-volume[86122]: INFO cinder.rpc [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 02 10:00:42 devstack cinder-volume[86122]: DEBUG oslo_db.sqlalchemy.engines [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86122) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 10:00:42 devstack cinder-volume[86122]: INFO cinder.volume.manager [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] Determined volume DB was empty at startup. Nov 02 10:00:42 devstack cinder-volume[86122]: DEBUG cinder.volume.manager [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86122) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 02 10:00:42 devstack cinder-volume[86122]: INFO cinder.volume.manager [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] Service not found for updating active_backend_id, assuming default for driver init. Nov 02 10:00:42 devstack cinder-volume[86122]: WARNING stevedore.named [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 02 10:00:42 devstack cinder-volume[86122]: WARNING castellan.key_manager [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 02 10:00:42 devstack cinder-volume[86122]: WARNING cinder.keymgr.conf_key_mgr [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 02 10:00:43 devstack cinder-volume[86122]: INFO cinder.volume.manager [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] Image-volume cache disabled for host devstack@QuobyteHD. Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_db.sqlalchemy.engines [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86122) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 10:00:43 devstack cinder-volume[86122]: INFO oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] Starting 1 workers Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] Started child 86338 {{(pid=86122) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] Full set of CONF: {{(pid=86122) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] ******************************************************************************** {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] Configuration options gathered from: {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] ================================================================================ {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] allow_availability_zone_fallback = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] allow_compression_on_image_upload = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] allowed_direct_url_schemes = [] {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] api_rate_limit = True {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] auth_strategy = keystone {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] backend_availability_zone = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] backend_host = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] backend_name = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] backend_stats_polling_interval = 60 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] backup_api_class = cinder.backup.api.API {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] backup_name_template = backup-%s {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] backup_use_same_host = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] backup_use_temp_snapshot = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86338]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.1) Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] chap_password = **** {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] chap_username = {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] cinder_internal_tenant_project_id = 42dcac582ac04c35befb4b4ddf7da3a1 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] cinder_internal_tenant_user_id = a9a89b4792f64f42b820d2147028e44a {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] cluster = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] compression_format = gzip {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] compute_api_class = cinder.compute.nova.API {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] config_dir = [] {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] config_source = [] {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] control_exchange = openstack {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] debug = True {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] default_availability_zone = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] default_group_type = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] default_volume_type = QuobyteHD {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] disk_geometry = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] driver_client_cert = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] driver_client_cert_key = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] driver_data_namespace = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] driver_ssl_cert_path = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] driver_ssl_cert_verify = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] driver_use_ssl = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] enable_new_services = True {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] enable_unsupported_driver = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] enabled_backends = ['QuobyteHD'] {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] enforce_multipath_for_image_xfer = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] filter_function = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] glance_api_insecure = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] glance_api_servers = ['http://192.168.122.243/image'] {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] glance_api_ssl_compression = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] glance_ca_certificates_file = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] glance_catalog_info = image:glance:publicURL {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] glance_certfile = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] glance_keyfile = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] glance_num_retries = 3 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] glance_request_timeout = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] goodness_function = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] graceful_shutdown_timeout = 5 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] group_api_class = cinder.group.api.API {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] host = devstack {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] image_compress_on_upload = True {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] image_conversion_address_space_limit = 1 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] image_conversion_cpu_limit = 60 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] image_conversion_disable = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] image_introspection_address_space_limit = 1 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] image_introspection_cpu_limit = 60 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] image_upload_use_cinder_backend = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] image_upload_use_internal_tenant = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] image_volume_cache_enabled = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] image_volume_cache_max_count = 0 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] image_volume_cache_max_size_gb = 0 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] init_host_max_objects_retrieval = 0 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] instance_format = [instance: %(uuid)s] {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] iscsi_target_flags = {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] iscsi_write_cache = on {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] iser_helper = tgtadm {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] iser_ip_address = 192.168.122.243 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] iser_port = 3260 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] log_color = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] log_config_append = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] log_dir = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] log_file = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] log_options = True {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] log_rotate_interval = 1 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] log_rotate_interval_type = days {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] log_rotation_type = none {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] max_age = 0 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] max_logfile_count = 30 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] max_logfile_size_mb = 200 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] max_over_subscription_ratio = 20.0 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] message_reap_interval = 86400 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] message_ttl = 2592000 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] migration_create_volume_timeout_secs = 300 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] monkey_patch = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] monkey_patch_modules = [] {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] my_ip = 192.168.122.243 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] no_snapshot_gb_quota = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] num_iser_scan_tries = 3 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] num_shell_tries = 3 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] num_volume_device_scan_tries = 3 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] nvmeof_conn_info_version = 1 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] nvmet_ns_id = 10 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] nvmet_port_id = 1 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] osapi_max_limit = 1000 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] osapi_volume_ext_list = [] {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] osapi_volume_listen = 0.0.0.0 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] osapi_volume_listen_port = 8776 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] osapi_volume_use_ssl = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] osapi_volume_workers = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] per_volume_size_limit = -1 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] periodic_fuzzy_delay = 60 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] periodic_interval = 60 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] project_id_regex = [0-9a-f\-]+ {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] public_endpoint = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] publish_errors = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] quota_backup_gigabytes = 1000 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] quota_backups = 10 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] quota_gigabytes = 1000 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] quota_groups = 10 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] quota_snapshots = 10 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] quota_volumes = 10 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] rate_limit_burst = 0 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] rate_limit_except_level = CRITICAL {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] rate_limit_interval = 0 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] reinit_driver_count = 3 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] replication_device = **** {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] report_discard_supported = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] report_interval = 120 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] reservation_clean_interval = 86400 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] reservation_expire = 86400 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] reserved_image_namespaces = [] {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] reserved_percentage = 0 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] rpc_response_timeout = 120 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] run_external_periodic_tasks = True {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] scst_target_driver = iscsi {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] scst_target_iqn_name = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] service_down_time = 720 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] shell_completion = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] snapshot_name_template = snapshot-%s {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] split_loggers = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] state_path = /opt/stack/data/cinder {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] storage_availability_zone = nova {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] storage_protocol = iSCSI {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] syslog_log_facility = LOG_USER {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] target_helper = lioadm {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] target_ip_address = 192.168.122.243 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] target_port = 3260 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] target_protocol = iscsi {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86338]: INFO cinder.volume.manager [None req-8b8880f5-d1c4-4e0e-b3e9-d822c3fe19ef None None] Starting volume driver QuobyteDriver (1.2.1) Nov 02 10:00:43 devstack cinder-volume[86338]: DEBUG cinder.volume.drivers.remotefs [None req-8b8880f5-d1c4-4e0e-b3e9-d822c3fe19ef None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86338) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] target_secondary_ip_addresses = [] {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] trace_flags = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] transfer_api_class = cinder.transfer.api.API {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] transport_url = **** {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] until_refresh = 0 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] use_chap_auth = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] use_default_quota_class = True {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] use_journal = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] use_json = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] use_multipath_for_image_xfer = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] use_stderr = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] use_syslog = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] verify_glance_signatures = enabled {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] volume_api_class = cinder.volume.api.API {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] volume_backend_name = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] volume_clear = zero {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] volume_clear_ionice = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] volume_clear_size = 0 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] volume_copy_bps_limit = 0 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] volume_dd_blocksize = 1M {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] volume_name_template = volume-%s {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] volume_service_inithost_offload = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] volume_usage_audit_period = month {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] zoning_mode = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] oslo_concurrency.disable_process_locking = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] keystone_authtoken.auth_section = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] keystone_authtoken.auth_type = password {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] keystone_authtoken.auth_version = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] keystone_authtoken.cache = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] keystone_authtoken.certfile = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] keystone_authtoken.delay_auth_decision = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] keystone_authtoken.http_connect_timeout = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] keystone_authtoken.include_service_catalog = True {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] keystone_authtoken.insecure = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] keystone_authtoken.interface = public {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] keystone_authtoken.keyfile = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] keystone_authtoken.memcache_password = **** {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] keystone_authtoken.memcache_username = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] keystone_authtoken.region_name = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] keystone_authtoken.service_token_roles_required = True {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] keystone_authtoken.service_type = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] keystone_authtoken.token_cache_time = 300 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.243/identity {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] cache.backend = dogpile.cache.null {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] cache.backend_argument = **** {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] cache.backend_expiration_time = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] cache.config_prefix = cache.oslo {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] cache.debug_cache_backend = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] cache.enable_retry_client = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] cache.enable_socket_keepalive = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] cache.enabled = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] cache.expiration_time = 600 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] cache.hashclient_retry_attempts = 2 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] cache.memcache_dead_retry = 300 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] cache.memcache_pool_maxsize = 10 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] cache.memcache_sasl_enabled = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] cache.password = **** {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] cache.proxies = [] {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] cache.redis_db = 0 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] cache.redis_sentinel_service_name = mymaster {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] cache.redis_server = localhost:6379 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] cache.retry_attempts = 2 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] cache.retry_delay = 0.0 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] cache.socket_keepalive_count = 1 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] cache.socket_keepalive_idle = 1 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] cache.socket_keepalive_interval = 1 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] cache.socket_timeout = 1.0 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] cache.tls_allowed_ciphers = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] cache.tls_cafile = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] cache.tls_certfile = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] cache.tls_enabled = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] cache.tls_keyfile = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] cache.username = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] coordination.backend_url = **** {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] database.asyncio_connection = **** {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] database.asyncio_slave_connection = **** {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] database.backend = sqlalchemy {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] database.connection = **** {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] database.connection_debug = 0 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] database.connection_parameters = {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] database.connection_recycle_time = 3600 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] database.connection_trace = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] database.db_inc_retry_interval = True {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] database.db_max_retries = 20 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] database.db_max_retry_interval = 10 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] database.db_retry_interval = 1 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] database.max_overflow = 50 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] database.max_pool_size = 5 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] database.max_retries = 10 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] database.mysql_wsrep_sync_wait = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] database.pool_timeout = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] database.retry_interval = 10 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] database.slave_connection = **** {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] database.sqlite_synchronous = True {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] database.synchronous_reader = True {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] database.use_db_reconnect = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] oslo_messaging_tracing.insecure = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] profiler.connection_string = messaging:// {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] profiler.enabled = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] profiler.es_doc_type = notification {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] profiler.es_scroll_size = 10000 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] profiler.es_scroll_time = 2m {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] profiler.filter_error_trace = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] profiler.hmac_keys = **** {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] profiler.sentinel_service_name = mymaster {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] profiler.socket_timeout = 0.1 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] profiler.trace_requests = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] profiler.trace_sqlalchemy = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] profiler_jaeger.process_tags = {} {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] profiler_jaeger.service_name_prefix = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] profiler_otlp.service_name_prefix = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] oslo_policy.enforce_new_defaults = True {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] oslo_policy.policy_default_rule = default {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] oslo_policy.policy_file = policy.yaml {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86338]: DEBUG cinder.volume.drivers.quobyte [None req-8b8880f5-d1c4-4e0e-b3e9-d822c3fe19ef None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86338) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Nov 02 10:00:43 devstack cinder-volume[86338]: WARNING cinder.volume.drivers.quobyte [None req-8b8880f5-d1c4-4e0e-b3e9-d822c3fe19ef None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Nov 02 10:00:43 devstack cinder-volume[86338]: WARNING cinder.volume.drivers.quobyte [None req-8b8880f5-d1c4-4e0e-b3e9-d822c3fe19ef None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] oslo_policy.remote_timeout = 60.0 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] privsep_osbrick.group = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] privsep_osbrick.helper_command = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] privsep_osbrick.user = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] cinder_sys_admin.group = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86338]: DEBUG oslo_concurrency.processutils [None req-8b8880f5-d1c4-4e0e-b3e9-d822c3fe19ef None None] Running cmd (subprocess): mount.quobyte {{(pid=86338) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] cinder_sys_admin.helper_command = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] cinder_sys_admin.user = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] service_user.auth_section = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] service_user.auth_type = password {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] service_user.cafile = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] service_user.certfile = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] service_user.collect_timing = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] service_user.insecure = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] service_user.keyfile = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] service_user.send_service_user_token = True {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] service_user.split_loggers = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] service_user.timeout = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] service_user.tls_ciphers = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] service_user.tls_min_version = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] glance.auth_section = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] glance.auth_type = password {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] glance.certfile = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] glance.collect_timing = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] glance.insecure = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] glance.keyfile = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] glance.region_name = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] glance.split_loggers = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] glance.timeout = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] glance.tls_ciphers = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] glance.tls_min_version = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] backend_defaults.backend_availability_zone = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] backend_defaults.chap_password = **** {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] backend_defaults.chap_username = {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] backend_defaults.disk_geometry = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] backend_defaults.driver_client_cert = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] backend_defaults.driver_client_cert_key = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] backend_defaults.driver_data_namespace = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] backend_defaults.driver_use_ssl = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] backend_defaults.enable_unsupported_driver = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] backend_defaults.extra_capabilities = {} {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] backend_defaults.filter_function = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] backend_defaults.goodness_function = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] backend_defaults.iscsi_target_flags = {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] backend_defaults.iscsi_write_cache = on {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] backend_defaults.iser_helper = tgtadm {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] backend_defaults.iser_ip_address = 192.168.122.243 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] backend_defaults.iser_port = 3260 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] backend_defaults.nas_host = {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] backend_defaults.nas_login = admin {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] backend_defaults.nas_mount_options = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] backend_defaults.nas_password = **** {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] backend_defaults.nas_private_key = {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] backend_defaults.nas_share_path = {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] backend_defaults.nas_ssh_port = 22 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] backend_defaults.num_shell_tries = 3 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] backend_defaults.nvmet_port_id = 1 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] backend_defaults.quobyte_client_cfg = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] backend_defaults.quobyte_volume_url = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] backend_defaults.replication_device = **** {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] backend_defaults.report_discard_supported = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] backend_defaults.reserved_percentage = 0 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] backend_defaults.scst_target_driver = iscsi {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] backend_defaults.scst_target_iqn_name = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] backend_defaults.storage_protocol = iSCSI {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] backend_defaults.target_helper = tgtadm {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] backend_defaults.target_ip_address = 192.168.122.243 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] backend_defaults.target_port = 3260 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] backend_defaults.target_protocol = iscsi {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] backend_defaults.trace_flags = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] backend_defaults.unique_fqdn_network = True {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] backend_defaults.use_chap_auth = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] backend_defaults.volume_backend_name = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] backend_defaults.volume_clear = zero {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] backend_defaults.volume_clear_ionice = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] backend_defaults.volume_clear_size = 0 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] oslo_reports.file_event_handler = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] oslo_reports.log_dir = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] QuobyteHD.backend_availability_zone = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] QuobyteHD.backend_host = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] QuobyteHD.chap_password = **** {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] QuobyteHD.chap_username = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] QuobyteHD.chiscsi_conf = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] QuobyteHD.disk_geometry = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] QuobyteHD.driver_client_cert = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] QuobyteHD.driver_client_cert_key = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] QuobyteHD.driver_data_namespace = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] QuobyteHD.driver_use_ssl = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] QuobyteHD.extra_capabilities = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] QuobyteHD.filter_function = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] QuobyteHD.goodness_function = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] QuobyteHD.iscsi_target_flags = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] QuobyteHD.iscsi_write_cache = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] QuobyteHD.iser_helper = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] QuobyteHD.iser_ip_address = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] QuobyteHD.iser_port = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] QuobyteHD.iser_target_prefix = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] QuobyteHD.nas_host = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] QuobyteHD.nas_login = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] QuobyteHD.nas_mount_options = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] QuobyteHD.nas_password = **** {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] QuobyteHD.nas_private_key = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] QuobyteHD.nas_share_path = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] QuobyteHD.nas_ssh_port = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] QuobyteHD.num_shell_tries = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] QuobyteHD.nvmet_ns_id = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] QuobyteHD.nvmet_port_id = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] QuobyteHD.replication_device = **** {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] QuobyteHD.report_discard_supported = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] QuobyteHD.reserved_percentage = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] QuobyteHD.scst_target_driver = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] QuobyteHD.storage_protocol = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] QuobyteHD.target_helper = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] QuobyteHD.target_ip_address = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] QuobyteHD.target_port = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] QuobyteHD.target_prefix = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] QuobyteHD.target_protocol = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] QuobyteHD.trace_flags = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] QuobyteHD.unique_fqdn_network = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] QuobyteHD.use_chap_auth = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] QuobyteHD.volume_clear = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] QuobyteHD.volume_clear_ionice = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] QuobyteHD.volume_clear_size = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] QuobyteHD.volumes_dir = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack quobyte-client[86343]: Reading configuration file: /etc/quobyte/client.cfg Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack quobyte-client[86343]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86338]: DEBUG oslo_concurrency.processutils [None req-8b8880f5-d1c4-4e0e-b3e9-d822c3fe19ef None None] CMD "mount.quobyte" returned: 1 in 0.169s {{(pid=86338) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:43 devstack cinder-volume[86338]: DEBUG oslo_concurrency.lockutils [None req-8b8880f5-d1c4-4e0e-b3e9-d822c3fe19ef None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86338) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:00:43 devstack cinder-volume[86338]: DEBUG oslo_concurrency.lockutils [None req-8b8880f5-d1c4-4e0e-b3e9-d822c3fe19ef None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86338) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:00:43 devstack cinder-volume[86338]: DEBUG cinder.volume.drivers.quobyte [None req-8b8880f5-d1c4-4e0e-b3e9-d822c3fe19ef None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86338) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] oslo_messaging_rabbit.ssl = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86338]: INFO cinder.volume.drivers.quobyte [None req-8b8880f5-d1c4-4e0e-b3e9-d822c3fe19ef None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 ... Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] oslo_messaging_rabbit.ssl_version = {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86338]: DEBUG oslo_concurrency.processutils [None req-8b8880f5-d1c4-4e0e-b3e9-d822c3fe19ef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 -c /etc/quobyte/client-cinder.cfg {{(pid=86338) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] oslo_messaging_notifications.driver = [] {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] oslo_messaging_notifications.retry = -1 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] oslo_messaging_notifications.transport_url = **** {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] key_manager.fixed_key = **** {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] barbican.barbican_api_version = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] barbican.barbican_endpoint = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] barbican.barbican_endpoint_type = public {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] barbican.barbican_region_name = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] barbican.cafile = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] barbican.certfile = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] barbican.collect_timing = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] barbican.insecure = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] barbican.keyfile = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] barbican.number_of_retries = 60 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] barbican.retry_delay = 1 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] barbican.send_service_user_token = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] barbican.split_loggers = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] barbican.timeout = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] barbican.tls_ciphers = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] barbican.tls_min_version = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] barbican.verify_ssl = True {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] barbican.verify_ssl_path = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] barbican_service_user.auth_section = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] barbican_service_user.auth_type = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] barbican_service_user.cafile = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] barbican_service_user.certfile = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] barbican_service_user.collect_timing = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] barbican_service_user.insecure = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] barbican_service_user.keyfile = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] barbican_service_user.split_loggers = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] barbican_service_user.timeout = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] barbican_service_user.tls_ciphers = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] barbican_service_user.tls_min_version = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] vault.approle_role_id = **** {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] vault.approle_secret_id = **** {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] vault.auth_method = approle {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] vault.auth_path = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] vault.kv_mountpoint = secret {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] vault.kv_path = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] vault.kv_version = 2 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] vault.namespace = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] vault.root_token_id = **** {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] vault.ssl_ca_crt_file = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] vault.timeout = 60.0 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] vault.token_file = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] vault.token_role = None {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] vault.use_ssl = False {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:43 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] ******************************************************************************** {{(pid=86122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 02 10:00:43 devstack sudo[86344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 -c /etc/quobyte/client-cinder.cfg Nov 02 10:00:43 devstack sudo[86344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:44 devstack sudo[86344]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:44 devstack cinder-volume[86338]: DEBUG oslo_concurrency.processutils [None req-8b8880f5-d1c4-4e0e-b3e9-d822c3fe19ef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.491s {{(pid=86338) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:44 devstack cinder-volume[86338]: INFO cinder.volume.drivers.quobyte [None req-8b8880f5-d1c4-4e0e-b3e9-d822c3fe19ef None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 succeeded Nov 02 10:00:44 devstack cinder-volume[86338]: DEBUG cinder.volume.drivers.quobyte [None req-8b8880f5-d1c4-4e0e-b3e9-d822c3fe19ef None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86338) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:00:44 devstack cinder-volume[86338]: DEBUG oslo_concurrency.lockutils [None req-8b8880f5-d1c4-4e0e-b3e9-d822c3fe19ef None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.503s {{(pid=86338) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:00:44 devstack cinder-volume[86338]: DEBUG oslo_concurrency.processutils [None req-8b8880f5-d1c4-4e0e-b3e9-d822c3fe19ef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86338) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:44 devstack sudo[86446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:00:44 devstack sudo[86446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:44 devstack sudo[86446]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:44 devstack cinder-volume[86338]: DEBUG oslo_concurrency.processutils [None req-8b8880f5-d1c4-4e0e-b3e9-d822c3fe19ef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.291s {{(pid=86338) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:44 devstack cinder-volume[86338]: INFO cinder.volume.driver [None req-8b8880f5-d1c4-4e0e-b3e9-d822c3fe19ef None None] Driver hasn't implemented _init_vendor_properties() Nov 02 10:00:44 devstack cinder-volume[86338]: DEBUG cinder.volume.driver [None req-8b8880f5-d1c4-4e0e-b3e9-d822c3fe19ef None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.8322715759277, 'free_capacity_gb': 1773.8322715759277, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86338) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 02 10:00:44 devstack cinder-volume[86338]: DEBUG oslo_db.sqlalchemy.engines [None req-8b8880f5-d1c4-4e0e-b3e9-d822c3fe19ef None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86338) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 10:00:44 devstack cinder-volume[86338]: DEBUG dbcounter [-] [86338] Writer thread running {{(pid=86338) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 02 10:00:44 devstack cinder-volume[86338]: DEBUG cinder.db.api [None req-8b8880f5-d1c4-4e0e-b3e9-d822c3fe19ef None None] Building query based on filter {{(pid=86338) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Nov 02 10:00:44 devstack cinder-volume[86338]: DEBUG cinder.image.image_utils [None req-8b8880f5-d1c4-4e0e-b3e9-d822c3fe19ef None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86338) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 02 10:00:44 devstack cinder-volume[86338]: INFO cinder.keymgr.migration [None req-584d7fd9-740f-4374-a9ce-a5a163516bb5 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 02 10:00:44 devstack cinder-volume[86338]: DEBUG oslo_concurrency.lockutils [None req-8b8880f5-d1c4-4e0e-b3e9-d822c3fe19ef None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86338) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:00:44 devstack cinder-volume[86338]: DEBUG oslo_concurrency.lockutils [None req-8b8880f5-d1c4-4e0e-b3e9-d822c3fe19ef None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86338) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:00:44 devstack cinder-volume[86338]: DEBUG cinder.volume.drivers.quobyte [None req-8b8880f5-d1c4-4e0e-b3e9-d822c3fe19ef None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86338) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:00:44 devstack cinder-volume[86338]: DEBUG cinder.volume.drivers.quobyte [None req-8b8880f5-d1c4-4e0e-b3e9-d822c3fe19ef None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86338) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:00:44 devstack cinder-volume[86338]: DEBUG oslo_concurrency.lockutils [None req-8b8880f5-d1c4-4e0e-b3e9-d822c3fe19ef None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86338) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:00:44 devstack cinder-volume[86338]: DEBUG oslo_concurrency.processutils [None req-8b8880f5-d1c4-4e0e-b3e9-d822c3fe19ef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86338) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:44 devstack sudo[86475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:00:44 devstack sudo[86475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:44 devstack sudo[86475]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:44 devstack cinder-volume[86338]: DEBUG oslo_concurrency.processutils [None req-8b8880f5-d1c4-4e0e-b3e9-d822c3fe19ef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.360s {{(pid=86338) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:44 devstack cinder-volume[86338]: DEBUG cinder.manager [None req-8b8880f5-d1c4-4e0e-b3e9-d822c3fe19ef None None] Notifying Schedulers of capabilities ... {{(pid=86338) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:00:44 devstack cinder-volume[86338]: INFO cinder.volume.manager [None req-8b8880f5-d1c4-4e0e-b3e9-d822c3fe19ef None None] Driver initialization completed successfully. Nov 02 10:00:44 devstack cinder-volume[86338]: INFO cinder.manager [None req-8b8880f5-d1c4-4e0e-b3e9-d822c3fe19ef None None] Initiating service 3 cleanup Nov 02 10:00:44 devstack cinder-volume[86338]: INFO cinder.manager [None req-8b8880f5-d1c4-4e0e-b3e9-d822c3fe19ef None None] Service 3 cleanup completed. Nov 02 10:00:44 devstack cinder-volume[86338]: DEBUG cinder.service [None req-8b8880f5-d1c4-4e0e-b3e9-d822c3fe19ef None None] Creating RPC server for service cinder-volume {{(pid=86338) start /opt/stack/cinder/cinder/service.py:231}} Nov 02 10:00:44 devstack cinder-volume[86338]: DEBUG cinder.service [None req-8b8880f5-d1c4-4e0e-b3e9-d822c3fe19ef None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86338) start /opt/stack/cinder/cinder/service.py:237}} Nov 02 10:00:45 devstack cinder-volume[86338]: INFO cinder.volume.manager [None req-8b8880f5-d1c4-4e0e-b3e9-d822c3fe19ef None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Nov 02 10:00:45 devstack cinder-volume[86338]: DEBUG oslo_concurrency.lockutils [None req-8b8880f5-d1c4-4e0e-b3e9-d822c3fe19ef None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86338) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:00:45 devstack cinder-volume[86338]: DEBUG oslo_concurrency.lockutils [None req-8b8880f5-d1c4-4e0e-b3e9-d822c3fe19ef None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86338) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:00:45 devstack cinder-volume[86338]: DEBUG cinder.volume.drivers.quobyte [None req-8b8880f5-d1c4-4e0e-b3e9-d822c3fe19ef None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86338) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:00:45 devstack cinder-volume[86338]: DEBUG cinder.volume.drivers.quobyte [None req-8b8880f5-d1c4-4e0e-b3e9-d822c3fe19ef None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86338) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:00:45 devstack cinder-volume[86338]: DEBUG oslo_concurrency.lockutils [None req-8b8880f5-d1c4-4e0e-b3e9-d822c3fe19ef None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86338) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:00:45 devstack cinder-volume[86338]: DEBUG oslo_concurrency.processutils [None req-8b8880f5-d1c4-4e0e-b3e9-d822c3fe19ef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86338) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:45 devstack sudo[86479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:00:45 devstack sudo[86479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:45 devstack sudo[86479]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:45 devstack cinder-volume[86338]: DEBUG oslo_concurrency.processutils [None req-8b8880f5-d1c4-4e0e-b3e9-d822c3fe19ef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.648s {{(pid=86338) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:45 devstack cinder-volume[86338]: INFO cinder.volume.manager [None req-8b8880f5-d1c4-4e0e-b3e9-d822c3fe19ef None None] Driver post RPC initialization completed successfully. Nov 02 10:00:48 devstack cinder-volume[86122]: INFO oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] Caught SIGTERM, stopping children Nov 02 10:00:48 devstack cinder-volume[86122]: DEBUG oslo_concurrency.lockutils [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] Acquiring lock "singleton_lock" {{(pid=86122) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 02 10:00:48 devstack cinder-volume[86122]: DEBUG oslo_concurrency.lockutils [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] Acquired lock "singleton_lock" {{(pid=86122) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 02 10:00:48 devstack cinder-volume[86122]: DEBUG oslo_concurrency.lockutils [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] Releasing lock "singleton_lock" {{(pid=86122) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 02 10:00:48 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] Stop services. {{(pid=86122) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Nov 02 10:00:48 devstack cinder-volume[86122]: DEBUG oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] Killing children. {{(pid=86122) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Nov 02 10:00:48 devstack cinder-volume[86122]: INFO oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] Waiting on 1 children to exit Nov 02 10:00:49 devstack cinder-volume[86338]: DEBUG oslo_concurrency.lockutils [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] Acquiring lock "singleton_lock" {{(pid=86338) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 02 10:00:49 devstack cinder-volume[86338]: DEBUG oslo_concurrency.lockutils [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] Acquired lock "singleton_lock" {{(pid=86338) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 02 10:00:49 devstack cinder-volume[86338]: DEBUG oslo_concurrency.lockutils [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] Releasing lock "singleton_lock" {{(pid=86338) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 02 10:00:49 devstack cinder-volume[86338]: WARNING amqp [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 02 10:00:49 devstack cinder-volume[86338]: WARNING amqp [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 02 10:00:49 devstack cinder-volume[86122]: INFO oslo_service.backend._eventlet.service [None req-80dfeeb3-1827-43ef-8968-b9096f94537b None None] Child 86338 exited with status 0 Nov 02 10:00:49 devstack cinder-volume[86643]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 02 10:00:49 devstack cinder-volume[86643]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 02 10:00:49 devstack cinder-volume[86643]: we strongly recommend against using it for new projects. Nov 02 10:00:49 devstack cinder-volume[86643]: If you are already using Eventlet, we recommend migrating to a different Nov 02 10:00:49 devstack cinder-volume[86643]: framework. For more detail see Nov 02 10:00:49 devstack cinder-volume[86643]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 02 10:00:49 devstack cinder-volume[86643]: import eventlet # noqa Nov 02 10:00:52 devstack cinder-volume[86643]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86643) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 02 10:00:52 devstack cinder-volume[86643]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86643) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 02 10:00:52 devstack cinder-volume[86643]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86643) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 02 10:00:53 devstack cinder-volume[86643]: INFO dbcounter [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] Registered counter for database cinder Nov 02 10:00:53 devstack cinder-volume[86643]: DEBUG oslo_db.sqlalchemy.engines [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86643) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG dbcounter [-] [86643] Writer thread running {{(pid=86643) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 02 10:00:54 devstack cinder-volume[86643]: INFO cinder.rpc [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 02 10:00:54 devstack cinder-volume[86643]: INFO cinder.rpc [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_db.sqlalchemy.engines [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86643) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 10:00:54 devstack cinder-volume[86643]: INFO cinder.volume.manager [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] Determined volume DB was empty at startup. Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG cinder.volume.manager [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86643) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 02 10:00:54 devstack cinder-volume[86643]: WARNING stevedore.named [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 02 10:00:54 devstack cinder-volume[86643]: WARNING castellan.key_manager [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 02 10:00:54 devstack cinder-volume[86643]: WARNING cinder.keymgr.conf_key_mgr [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 02 10:00:54 devstack cinder-volume[86643]: INFO cinder.volume.manager [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] Image-volume cache disabled for host devstack@QuobyteHD. Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_db.sqlalchemy.engines [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86643) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 10:00:54 devstack cinder-volume[86643]: INFO oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] Starting 1 workers Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] Started child 86890 {{(pid=86643) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] Full set of CONF: {{(pid=86643) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] ******************************************************************************** {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] Configuration options gathered from: {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 02 10:00:54 devstack cinder-volume[86890]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.1) Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] ================================================================================ {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] allow_availability_zone_fallback = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] allow_compression_on_image_upload = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] allowed_direct_url_schemes = [] {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] api_rate_limit = True {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] auth_strategy = keystone {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] backend_availability_zone = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] backend_host = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] backend_name = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] backend_stats_polling_interval = 60 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] backup_api_class = cinder.backup.api.API {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] backup_name_template = backup-%s {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] backup_use_same_host = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] backup_use_temp_snapshot = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] chap_password = **** {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] chap_username = {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] cinder_internal_tenant_project_id = 42dcac582ac04c35befb4b4ddf7da3a1 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] cinder_internal_tenant_user_id = a9a89b4792f64f42b820d2147028e44a {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] cluster = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] compression_format = gzip {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] compute_api_class = cinder.compute.nova.API {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] config_dir = [] {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] config_source = [] {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] control_exchange = openstack {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] debug = True {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] default_availability_zone = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] default_group_type = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-551d0a29-e4eb-419e-bcdd-8c170c3657d4 None None] Starting volume driver QuobyteDriver (1.2.1) Nov 02 10:00:54 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-551d0a29-e4eb-419e-bcdd-8c170c3657d4 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86890) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] default_volume_type = QuobyteHD {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] disk_geometry = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] driver_client_cert = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] driver_client_cert_key = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] driver_data_namespace = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] driver_ssl_cert_path = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] driver_ssl_cert_verify = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] driver_use_ssl = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] enable_new_services = True {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] enable_unsupported_driver = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] enabled_backends = ['QuobyteHD'] {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] enforce_multipath_for_image_xfer = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] filter_function = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] glance_api_insecure = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] glance_api_servers = ['http://192.168.122.243/image'] {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] glance_api_ssl_compression = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] glance_ca_certificates_file = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] glance_catalog_info = image:glance:publicURL {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] glance_certfile = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] glance_keyfile = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] glance_num_retries = 3 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] glance_request_timeout = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] goodness_function = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] graceful_shutdown_timeout = 5 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] group_api_class = cinder.group.api.API {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] host = devstack {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] image_compress_on_upload = True {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] image_conversion_address_space_limit = 1 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] image_conversion_cpu_limit = 60 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] image_conversion_disable = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] image_introspection_address_space_limit = 1 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] image_introspection_cpu_limit = 60 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] image_upload_use_cinder_backend = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] image_upload_use_internal_tenant = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] image_volume_cache_enabled = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] image_volume_cache_max_count = 0 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] image_volume_cache_max_size_gb = 0 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] init_host_max_objects_retrieval = 0 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] instance_format = [instance: %(uuid)s] {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] iscsi_target_flags = {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] iscsi_write_cache = on {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] iser_helper = tgtadm {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] iser_ip_address = 192.168.122.243 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] iser_port = 3260 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] log_color = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] log_config_append = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] log_dir = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] log_file = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] log_options = True {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] log_rotate_interval = 1 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] log_rotate_interval_type = days {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] log_rotation_type = none {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] max_age = 0 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] max_logfile_count = 30 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] max_logfile_size_mb = 200 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] max_over_subscription_ratio = 20.0 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] message_reap_interval = 86400 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] message_ttl = 2592000 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] migration_create_volume_timeout_secs = 300 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] monkey_patch = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] monkey_patch_modules = [] {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] my_ip = 192.168.122.243 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] no_snapshot_gb_quota = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] num_iser_scan_tries = 3 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] num_shell_tries = 3 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] num_volume_device_scan_tries = 3 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] nvmeof_conn_info_version = 1 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] nvmet_ns_id = 10 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] nvmet_port_id = 1 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] osapi_max_limit = 1000 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] osapi_volume_ext_list = [] {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] osapi_volume_listen = 0.0.0.0 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] osapi_volume_listen_port = 8776 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] osapi_volume_use_ssl = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] osapi_volume_workers = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] per_volume_size_limit = -1 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] periodic_fuzzy_delay = 60 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] periodic_interval = 60 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] project_id_regex = [0-9a-f\-]+ {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] public_endpoint = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] publish_errors = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] quota_backup_gigabytes = 1000 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] quota_backups = 10 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] quota_gigabytes = 1000 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] quota_groups = 10 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] quota_snapshots = 10 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] quota_volumes = 10 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] rate_limit_burst = 0 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] rate_limit_except_level = CRITICAL {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] rate_limit_interval = 0 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-551d0a29-e4eb-419e-bcdd-8c170c3657d4 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86890) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Nov 02 10:00:54 devstack cinder-volume[86890]: WARNING cinder.volume.drivers.quobyte [None req-551d0a29-e4eb-419e-bcdd-8c170c3657d4 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Nov 02 10:00:54 devstack cinder-volume[86890]: WARNING cinder.volume.drivers.quobyte [None req-551d0a29-e4eb-419e-bcdd-8c170c3657d4 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] reinit_driver_count = 3 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] replication_device = **** {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] report_discard_supported = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-551d0a29-e4eb-419e-bcdd-8c170c3657d4 None None] Running cmd (subprocess): mount.quobyte {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] report_interval = 120 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] reservation_clean_interval = 86400 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] reservation_expire = 86400 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] reserved_image_namespaces = [] {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] reserved_percentage = 0 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:54 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] rpc_response_timeout = 120 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] run_external_periodic_tasks = True {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] scst_target_driver = iscsi {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] scst_target_iqn_name = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] service_down_time = 720 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] shell_completion = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] snapshot_name_template = snapshot-%s {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] split_loggers = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] state_path = /opt/stack/data/cinder {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] storage_availability_zone = nova {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] storage_protocol = iSCSI {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] syslog_log_facility = LOG_USER {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] target_helper = lioadm {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] target_ip_address = 192.168.122.243 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] target_port = 3260 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] target_protocol = iscsi {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] target_secondary_ip_addresses = [] {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] trace_flags = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] transfer_api_class = cinder.transfer.api.API {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] transport_url = **** {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] until_refresh = 0 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] use_chap_auth = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] use_default_quota_class = True {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] use_journal = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] use_json = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] use_multipath_for_image_xfer = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] use_stderr = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] use_syslog = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] verify_glance_signatures = enabled {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] volume_api_class = cinder.volume.api.API {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] volume_backend_name = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] volume_clear = zero {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] volume_clear_ionice = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] volume_clear_size = 0 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] volume_copy_bps_limit = 0 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] volume_dd_blocksize = 1M {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] volume_name_template = volume-%s {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] volume_service_inithost_offload = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] volume_usage_audit_period = month {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] zoning_mode = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] oslo_concurrency.disable_process_locking = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] keystone_authtoken.auth_section = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] keystone_authtoken.auth_type = password {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] keystone_authtoken.auth_version = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] keystone_authtoken.cache = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] keystone_authtoken.certfile = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] keystone_authtoken.delay_auth_decision = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] keystone_authtoken.http_connect_timeout = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] keystone_authtoken.include_service_catalog = True {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] keystone_authtoken.insecure = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] keystone_authtoken.interface = public {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] keystone_authtoken.keyfile = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] keystone_authtoken.memcache_password = **** {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] keystone_authtoken.memcache_username = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] keystone_authtoken.region_name = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] keystone_authtoken.service_token_roles_required = True {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] keystone_authtoken.service_type = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] keystone_authtoken.token_cache_time = 300 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.243/identity {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] cache.backend = dogpile.cache.null {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] cache.backend_argument = **** {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] cache.backend_expiration_time = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] cache.config_prefix = cache.oslo {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] cache.debug_cache_backend = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] cache.enable_retry_client = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] cache.enable_socket_keepalive = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] cache.enabled = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] cache.expiration_time = 600 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] cache.hashclient_retry_attempts = 2 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] cache.memcache_dead_retry = 300 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] cache.memcache_pool_maxsize = 10 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] cache.memcache_sasl_enabled = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] cache.password = **** {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] cache.proxies = [] {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] cache.redis_db = 0 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] cache.redis_sentinel_service_name = mymaster {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] cache.redis_server = localhost:6379 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] cache.retry_attempts = 2 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] cache.retry_delay = 0.0 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] cache.socket_keepalive_count = 1 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] cache.socket_keepalive_idle = 1 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] cache.socket_keepalive_interval = 1 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] cache.socket_timeout = 1.0 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] cache.tls_allowed_ciphers = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] cache.tls_cafile = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] cache.tls_certfile = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] cache.tls_enabled = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] cache.tls_keyfile = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] cache.username = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] coordination.backend_url = **** {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] database.asyncio_connection = **** {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] database.asyncio_slave_connection = **** {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] database.backend = sqlalchemy {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] database.connection = **** {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] database.connection_debug = 0 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] database.connection_parameters = {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] database.connection_recycle_time = 3600 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] database.connection_trace = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] database.db_inc_retry_interval = True {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] database.db_max_retries = 20 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] database.db_max_retry_interval = 10 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] database.db_retry_interval = 1 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] database.max_overflow = 50 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] database.max_pool_size = 5 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] database.max_retries = 10 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] database.mysql_wsrep_sync_wait = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] database.pool_timeout = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] database.retry_interval = 10 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] database.slave_connection = **** {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] database.sqlite_synchronous = True {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] database.synchronous_reader = True {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] database.use_db_reconnect = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack quobyte-client[86899]: Reading configuration file: /etc/quobyte/client.cfg Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack quobyte-client[86899]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] oslo_messaging_tracing.insecure = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] profiler.connection_string = messaging:// {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-551d0a29-e4eb-419e-bcdd-8c170c3657d4 None None] CMD "mount.quobyte" returned: 1 in 0.143s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] profiler.enabled = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] profiler.es_doc_type = notification {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] profiler.es_scroll_size = 10000 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] profiler.es_scroll_time = 2m {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] profiler.filter_error_trace = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] profiler.hmac_keys = **** {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] profiler.sentinel_service_name = mymaster {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] profiler.socket_timeout = 0.1 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] profiler.trace_requests = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] profiler.trace_sqlalchemy = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] profiler_jaeger.process_tags = {} {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-551d0a29-e4eb-419e-bcdd-8c170c3657d4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:00:55 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-551d0a29-e4eb-419e-bcdd-8c170c3657d4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] profiler_jaeger.service_name_prefix = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] profiler_otlp.service_name_prefix = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] oslo_policy.enforce_new_defaults = True {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] oslo_policy.policy_default_rule = default {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-551d0a29-e4eb-419e-bcdd-8c170c3657d4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] oslo_policy.policy_file = policy.yaml {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] oslo_policy.remote_timeout = 60.0 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] privsep_osbrick.group = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] privsep_osbrick.helper_command = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] privsep_osbrick.user = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-551d0a29-e4eb-419e-bcdd-8c170c3657d4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] cinder_sys_admin.group = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] cinder_sys_admin.helper_command = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] cinder_sys_admin.user = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] service_user.auth_section = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-551d0a29-e4eb-419e-bcdd-8c170c3657d4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:00:55 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-551d0a29-e4eb-419e-bcdd-8c170c3657d4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] service_user.auth_type = password {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] service_user.cafile = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] service_user.certfile = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] service_user.collect_timing = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] service_user.insecure = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] service_user.keyfile = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] service_user.send_service_user_token = True {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] service_user.split_loggers = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] service_user.timeout = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] service_user.tls_ciphers = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] service_user.tls_min_version = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] glance.auth_section = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] glance.auth_type = password {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] glance.certfile = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] glance.collect_timing = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] glance.insecure = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] glance.keyfile = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] glance.region_name = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] glance.split_loggers = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] glance.timeout = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] glance.tls_ciphers = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] glance.tls_min_version = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] backend_defaults.backend_availability_zone = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] backend_defaults.chap_password = **** {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] backend_defaults.chap_username = {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] backend_defaults.disk_geometry = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] backend_defaults.driver_client_cert = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] backend_defaults.driver_client_cert_key = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] backend_defaults.driver_data_namespace = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] backend_defaults.driver_use_ssl = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] backend_defaults.enable_unsupported_driver = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] backend_defaults.extra_capabilities = {} {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] backend_defaults.filter_function = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] backend_defaults.goodness_function = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack sudo[86907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack sudo[86907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] backend_defaults.iscsi_target_flags = {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] backend_defaults.iscsi_write_cache = on {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] backend_defaults.iser_helper = tgtadm {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] backend_defaults.iser_ip_address = 192.168.122.243 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] backend_defaults.iser_port = 3260 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] backend_defaults.nas_host = {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] backend_defaults.nas_login = admin {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] backend_defaults.nas_mount_options = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] backend_defaults.nas_password = **** {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] backend_defaults.nas_private_key = {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] backend_defaults.nas_share_path = {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] backend_defaults.nas_ssh_port = 22 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] backend_defaults.num_shell_tries = 3 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] backend_defaults.nvmet_port_id = 1 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] backend_defaults.quobyte_client_cfg = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] backend_defaults.quobyte_volume_url = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] backend_defaults.replication_device = **** {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] backend_defaults.report_discard_supported = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] backend_defaults.reserved_percentage = 0 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] backend_defaults.scst_target_driver = iscsi {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] backend_defaults.scst_target_iqn_name = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] backend_defaults.storage_protocol = iSCSI {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] backend_defaults.target_helper = tgtadm {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] backend_defaults.target_ip_address = 192.168.122.243 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] backend_defaults.target_port = 3260 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] backend_defaults.target_protocol = iscsi {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] backend_defaults.trace_flags = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] backend_defaults.unique_fqdn_network = True {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] backend_defaults.use_chap_auth = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] backend_defaults.volume_backend_name = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] backend_defaults.volume_clear = zero {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] backend_defaults.volume_clear_ionice = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] backend_defaults.volume_clear_size = 0 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] oslo_reports.file_event_handler = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] oslo_reports.log_dir = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] QuobyteHD.backend_availability_zone = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] QuobyteHD.backend_host = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] QuobyteHD.chap_password = **** {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] QuobyteHD.chap_username = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] QuobyteHD.chiscsi_conf = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] QuobyteHD.disk_geometry = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] QuobyteHD.driver_client_cert = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] QuobyteHD.driver_client_cert_key = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] QuobyteHD.driver_data_namespace = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] QuobyteHD.driver_use_ssl = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] QuobyteHD.extra_capabilities = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] QuobyteHD.filter_function = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] QuobyteHD.goodness_function = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] QuobyteHD.iscsi_target_flags = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] QuobyteHD.iscsi_write_cache = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] QuobyteHD.iser_helper = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] QuobyteHD.iser_ip_address = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] QuobyteHD.iser_port = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] QuobyteHD.iser_target_prefix = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] QuobyteHD.nas_host = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] QuobyteHD.nas_login = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] QuobyteHD.nas_mount_options = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] QuobyteHD.nas_password = **** {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] QuobyteHD.nas_private_key = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] QuobyteHD.nas_share_path = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] QuobyteHD.nas_ssh_port = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] QuobyteHD.num_shell_tries = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] QuobyteHD.nvmet_ns_id = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] QuobyteHD.nvmet_port_id = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] QuobyteHD.replication_device = **** {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] QuobyteHD.report_discard_supported = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] QuobyteHD.reserved_percentage = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] QuobyteHD.scst_target_driver = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] QuobyteHD.storage_protocol = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] QuobyteHD.target_helper = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] QuobyteHD.target_ip_address = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] QuobyteHD.target_port = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] QuobyteHD.target_prefix = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] QuobyteHD.target_protocol = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] QuobyteHD.trace_flags = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] QuobyteHD.unique_fqdn_network = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] QuobyteHD.use_chap_auth = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] QuobyteHD.volume_clear = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] QuobyteHD.volume_clear_ionice = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] QuobyteHD.volume_clear_size = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] QuobyteHD.volumes_dir = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] oslo_messaging_rabbit.ssl = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] oslo_messaging_rabbit.ssl_version = {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] oslo_messaging_notifications.driver = [] {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] oslo_messaging_notifications.retry = -1 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] oslo_messaging_notifications.transport_url = **** {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] key_manager.fixed_key = **** {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] barbican.barbican_api_version = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] barbican.barbican_endpoint = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] barbican.barbican_endpoint_type = public {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] barbican.barbican_region_name = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] barbican.cafile = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] barbican.certfile = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] barbican.collect_timing = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] barbican.insecure = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] barbican.keyfile = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] barbican.number_of_retries = 60 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] barbican.retry_delay = 1 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] barbican.send_service_user_token = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] barbican.split_loggers = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] barbican.timeout = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] barbican.tls_ciphers = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] barbican.tls_min_version = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] barbican.verify_ssl = True {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] barbican.verify_ssl_path = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] barbican_service_user.auth_section = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] barbican_service_user.auth_type = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] barbican_service_user.cafile = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] barbican_service_user.certfile = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] barbican_service_user.collect_timing = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] barbican_service_user.insecure = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] barbican_service_user.keyfile = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] barbican_service_user.split_loggers = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] barbican_service_user.timeout = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] barbican_service_user.tls_ciphers = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] barbican_service_user.tls_min_version = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] vault.approle_role_id = **** {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] vault.approle_secret_id = **** {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] vault.auth_method = approle {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] vault.auth_path = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] vault.kv_mountpoint = secret {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] vault.kv_path = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] vault.kv_version = 2 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] vault.namespace = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] vault.root_token_id = **** {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] vault.ssl_ca_crt_file = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] vault.timeout = 60.0 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] vault.token_file = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] vault.token_role = None {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] vault.use_ssl = False {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:00:55 devstack cinder-volume[86643]: DEBUG oslo_service.backend._eventlet.service [None req-7cae8c58-6e73-487a-b091-7e4bf21293cb None None] ******************************************************************************** {{(pid=86643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 02 10:00:55 devstack sudo[86907]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:55 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-551d0a29-e4eb-419e-bcdd-8c170c3657d4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.458s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:55 devstack cinder-volume[86890]: INFO cinder.volume.driver [None req-551d0a29-e4eb-419e-bcdd-8c170c3657d4 None None] Driver hasn't implemented _init_vendor_properties() Nov 02 10:00:55 devstack cinder-volume[86890]: DEBUG cinder.volume.driver [None req-551d0a29-e4eb-419e-bcdd-8c170c3657d4 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.772819519043, 'free_capacity_gb': 1773.772819519043, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86890) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 02 10:00:55 devstack cinder-volume[86890]: DEBUG oslo_db.sqlalchemy.engines [None req-551d0a29-e4eb-419e-bcdd-8c170c3657d4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86890) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 10:00:55 devstack cinder-volume[86890]: DEBUG dbcounter [-] [86890] Writer thread running {{(pid=86890) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 02 10:00:55 devstack cinder-volume[86890]: DEBUG cinder.db.api [None req-551d0a29-e4eb-419e-bcdd-8c170c3657d4 None None] Building query based on filter {{(pid=86890) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Nov 02 10:00:55 devstack cinder-volume[86890]: DEBUG cinder.image.image_utils [None req-551d0a29-e4eb-419e-bcdd-8c170c3657d4 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86890) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 02 10:00:55 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-551d0a29-e4eb-419e-bcdd-8c170c3657d4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:00:55 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-551d0a29-e4eb-419e-bcdd-8c170c3657d4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:00:55 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-551d0a29-e4eb-419e-bcdd-8c170c3657d4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:00:55 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-551d0a29-e4eb-419e-bcdd-8c170c3657d4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:00:55 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-551d0a29-e4eb-419e-bcdd-8c170c3657d4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:00:55 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-551d0a29-e4eb-419e-bcdd-8c170c3657d4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:55 devstack cinder-volume[86890]: INFO cinder.keymgr.migration [None req-627376f8-0995-4ae5-a40f-9034680beb80 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 02 10:00:55 devstack sudo[86917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:00:55 devstack sudo[86917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:56 devstack sudo[86917]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:56 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-551d0a29-e4eb-419e-bcdd-8c170c3657d4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.420s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:56 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-551d0a29-e4eb-419e-bcdd-8c170c3657d4 None None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:00:56 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-551d0a29-e4eb-419e-bcdd-8c170c3657d4 None None] Driver initialization completed successfully. Nov 02 10:00:56 devstack cinder-volume[86890]: INFO cinder.manager [None req-551d0a29-e4eb-419e-bcdd-8c170c3657d4 None None] Initiating service 3 cleanup Nov 02 10:00:56 devstack cinder-volume[86890]: INFO cinder.manager [None req-551d0a29-e4eb-419e-bcdd-8c170c3657d4 None None] Service 3 cleanup completed. Nov 02 10:00:56 devstack cinder-volume[86890]: DEBUG cinder.service [None req-551d0a29-e4eb-419e-bcdd-8c170c3657d4 None None] Creating RPC server for service cinder-volume {{(pid=86890) start /opt/stack/cinder/cinder/service.py:231}} Nov 02 10:00:56 devstack cinder-volume[86890]: DEBUG cinder.service [None req-551d0a29-e4eb-419e-bcdd-8c170c3657d4 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86890) start /opt/stack/cinder/cinder/service.py:237}} Nov 02 10:00:56 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-551d0a29-e4eb-419e-bcdd-8c170c3657d4 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Nov 02 10:00:56 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-551d0a29-e4eb-419e-bcdd-8c170c3657d4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:00:56 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-551d0a29-e4eb-419e-bcdd-8c170c3657d4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:00:56 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-551d0a29-e4eb-419e-bcdd-8c170c3657d4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:00:56 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-551d0a29-e4eb-419e-bcdd-8c170c3657d4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:00:56 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-551d0a29-e4eb-419e-bcdd-8c170c3657d4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:00:56 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-551d0a29-e4eb-419e-bcdd-8c170c3657d4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:56 devstack sudo[86932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:00:56 devstack sudo[86932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:56 devstack sudo[86932]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:56 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-551d0a29-e4eb-419e-bcdd-8c170c3657d4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.313s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:56 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-551d0a29-e4eb-419e-bcdd-8c170c3657d4 None None] Driver post RPC initialization completed successfully. Nov 02 10:01:04 devstack cinder-volume[86643]: DEBUG dbcounter [-] [86643] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86643) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:01:06 devstack cinder-volume[86890]: DEBUG dbcounter [-] [86890] Writing DB stats cinder:SELECT=2 {{(pid=86890) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:01:06 devstack cinder-volume[86890]: DEBUG dbcounter [-] [86890] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=86890) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:01:34 devstack cinder-volume[86890]: DEBUG oslo_service.periodic_task [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Running periodic task VolumeManager._thread_info {{(pid=86890) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:01:34 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] thread count: 6 {{(pid=86890) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:01:34 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] thread info: [<_MainThread(MainThread, started 133913319395456)>, , , , , ] {{(pid=86890) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:01:55 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d0617b6-1a74-4790-923c-f9430ffbe5fd tempest-TaggedAttachmentsTest-1004175425 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:01:55 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-4d0617b6-1a74-4790-923c-f9430ffbe5fd tempest-TaggedAttachmentsTest-1004175425 None] Flow 'volume_create_manager' (3f4c3b34-0736-40eb-a238-4303649e4e12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:01:55 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-4d0617b6-1a74-4790-923c-f9430ffbe5fd tempest-TaggedAttachmentsTest-1004175425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97a27a2a-2199-43c0-b02d-a8303ac4bdb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:01:56 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-4d0617b6-1a74-4790-923c-f9430ffbe5fd tempest-TaggedAttachmentsTest-1004175425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97a27a2a-2199-43c0-b02d-a8303ac4bdb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:01:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-244764157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9476181d-385b-46d4-b594-f641000ad2a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f6d96b6c96e4a97a9b51259f8e4b997',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:01:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:01:56Z,use_quota=True,user_id='64b1650797674dd69b9f255a213e8270',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:01:56 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-4d0617b6-1a74-4790-923c-f9430ffbe5fd tempest-TaggedAttachmentsTest-1004175425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccb74f47-6168-4468-ae5d-96af3b440dff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:01:56 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-4d0617b6-1a74-4790-923c-f9430ffbe5fd tempest-TaggedAttachmentsTest-1004175425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccb74f47-6168-4468-ae5d-96af3b440dff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:01:56 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-4d0617b6-1a74-4790-923c-f9430ffbe5fd tempest-TaggedAttachmentsTest-1004175425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44aedbca-f8f0-426e-a2ac-c8a01dbb1be0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:01:56 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-4d0617b6-1a74-4790-923c-f9430ffbe5fd tempest-TaggedAttachmentsTest-1004175425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44aedbca-f8f0-426e-a2ac-c8a01dbb1be0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9476181d-385b-46d4-b594-f641000ad2a3', 'volume_name': 'volume-9476181d-385b-46d4-b594-f641000ad2a3', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:01:56 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-4d0617b6-1a74-4790-923c-f9430ffbe5fd tempest-TaggedAttachmentsTest-1004175425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (274c2e10-2ab4-48b6-a618-dc7ac1205564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:01:56 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-4d0617b6-1a74-4790-923c-f9430ffbe5fd tempest-TaggedAttachmentsTest-1004175425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (274c2e10-2ab4-48b6-a618-dc7ac1205564) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:01:56 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-4d0617b6-1a74-4790-923c-f9430ffbe5fd tempest-TaggedAttachmentsTest-1004175425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23eefd76-6d36-45d2-83f3-d144bc75ce2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:01:56 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-4d0617b6-1a74-4790-923c-f9430ffbe5fd tempest-TaggedAttachmentsTest-1004175425 None] Volume 9476181d-385b-46d4-b594-f641000ad2a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9476181d-385b-46d4-b594-f641000ad2a3', 'volume_size': 1} Nov 02 10:01:56 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-4d0617b6-1a74-4790-923c-f9430ffbe5fd tempest-TaggedAttachmentsTest-1004175425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:01:56 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-4d0617b6-1a74-4790-923c-f9430ffbe5fd tempest-TaggedAttachmentsTest-1004175425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:01:56 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-4d0617b6-1a74-4790-923c-f9430ffbe5fd tempest-TaggedAttachmentsTest-1004175425 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:01:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-244764157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9476181d-385b-46d4-b594-f641000ad2a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f6d96b6c96e4a97a9b51259f8e4b997',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:01:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:01:56Z,use_quota=True,user_id='64b1650797674dd69b9f255a213e8270',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:01:56 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-4d0617b6-1a74-4790-923c-f9430ffbe5fd tempest-TaggedAttachmentsTest-1004175425 None] Creating volume 9476181d-385b-46d4-b594-f641000ad2a3 {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:01:56 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-4d0617b6-1a74-4790-923c-f9430ffbe5fd tempest-TaggedAttachmentsTest-1004175425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:01:56 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-4d0617b6-1a74-4790-923c-f9430ffbe5fd tempest-TaggedAttachmentsTest-1004175425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:01:56 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-4d0617b6-1a74-4790-923c-f9430ffbe5fd tempest-TaggedAttachmentsTest-1004175425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:01:56 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-4d0617b6-1a74-4790-923c-f9430ffbe5fd tempest-TaggedAttachmentsTest-1004175425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:01:56 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-4d0617b6-1a74-4790-923c-f9430ffbe5fd tempest-TaggedAttachmentsTest-1004175425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:01:56 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-4d0617b6-1a74-4790-923c-f9430ffbe5fd tempest-TaggedAttachmentsTest-1004175425 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:01:56 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-4d0617b6-1a74-4790-923c-f9430ffbe5fd tempest-TaggedAttachmentsTest-1004175425 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:01:56 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-4d0617b6-1a74-4790-923c-f9430ffbe5fd tempest-TaggedAttachmentsTest-1004175425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-9476181d-385b-46d4-b594-f641000ad2a3 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:01:56 devstack sudo[87237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-9476181d-385b-46d4-b594-f641000ad2a3 1073741824 Nov 02 10:01:56 devstack sudo[87237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:01:56 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [req-dd8238b2-1875-48cb-8617-101c3bb8cb72 req-2054e567-adaa-44e0-93cb-84f6ff1ad4e2 tempest-VolumesSnapshotsTestJSON-1420095746 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:01:56 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [req-dd8238b2-1875-48cb-8617-101c3bb8cb72 req-2054e567-adaa-44e0-93cb-84f6ff1ad4e2 tempest-VolumesSnapshotsTestJSON-1420095746 None] Flow 'volume_create_manager' (04ca398f-7198-437a-acf7-78ed608f0139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:01:56 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [req-dd8238b2-1875-48cb-8617-101c3bb8cb72 req-2054e567-adaa-44e0-93cb-84f6ff1ad4e2 tempest-VolumesSnapshotsTestJSON-1420095746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb8b5c71-864a-4d5e-982b-c6cb260f66b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:01:56 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [req-dd8238b2-1875-48cb-8617-101c3bb8cb72 req-2054e567-adaa-44e0-93cb-84f6ff1ad4e2 tempest-VolumesSnapshotsTestJSON-1420095746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb8b5c71-864a-4d5e-982b-c6cb260f66b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:01:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1246301779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aea0fb2c-25e0-446d-9e37-7f716b1a6404,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84b6086514c5442dbc1579e70119b5d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:01:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:01:56Z,use_quota=True,user_id='9dd7e29a84d642bd81296e3b2396f693',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:01:56 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [req-dd8238b2-1875-48cb-8617-101c3bb8cb72 req-2054e567-adaa-44e0-93cb-84f6ff1ad4e2 tempest-VolumesSnapshotsTestJSON-1420095746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9a2df51-6ff7-48d7-b354-c958237bb4ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:01:56 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [req-dd8238b2-1875-48cb-8617-101c3bb8cb72 req-2054e567-adaa-44e0-93cb-84f6ff1ad4e2 tempest-VolumesSnapshotsTestJSON-1420095746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9a2df51-6ff7-48d7-b354-c958237bb4ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:01:56 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [req-dd8238b2-1875-48cb-8617-101c3bb8cb72 req-2054e567-adaa-44e0-93cb-84f6ff1ad4e2 tempest-VolumesSnapshotsTestJSON-1420095746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9e4fe24-ca2f-43e5-9f5d-065fc0858ab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:01:56 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [req-dd8238b2-1875-48cb-8617-101c3bb8cb72 req-2054e567-adaa-44e0-93cb-84f6ff1ad4e2 tempest-VolumesSnapshotsTestJSON-1420095746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9e4fe24-ca2f-43e5-9f5d-065fc0858ab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aea0fb2c-25e0-446d-9e37-7f716b1a6404', 'volume_name': 'volume-aea0fb2c-25e0-446d-9e37-7f716b1a6404', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:01:56 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [req-dd8238b2-1875-48cb-8617-101c3bb8cb72 req-2054e567-adaa-44e0-93cb-84f6ff1ad4e2 tempest-VolumesSnapshotsTestJSON-1420095746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (919e60ab-febb-4ced-815e-4de8de70b336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:01:56 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [req-dd8238b2-1875-48cb-8617-101c3bb8cb72 req-2054e567-adaa-44e0-93cb-84f6ff1ad4e2 tempest-VolumesSnapshotsTestJSON-1420095746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (919e60ab-febb-4ced-815e-4de8de70b336) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:01:56 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [req-dd8238b2-1875-48cb-8617-101c3bb8cb72 req-2054e567-adaa-44e0-93cb-84f6ff1ad4e2 tempest-VolumesSnapshotsTestJSON-1420095746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a794f859-eaae-4a54-bd7c-f33487ff7768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:01:56 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [req-dd8238b2-1875-48cb-8617-101c3bb8cb72 req-2054e567-adaa-44e0-93cb-84f6ff1ad4e2 tempest-VolumesSnapshotsTestJSON-1420095746 None] Volume aea0fb2c-25e0-446d-9e37-7f716b1a6404: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aea0fb2c-25e0-446d-9e37-7f716b1a6404', 'volume_size': 1} Nov 02 10:01:56 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [req-dd8238b2-1875-48cb-8617-101c3bb8cb72 req-2054e567-adaa-44e0-93cb-84f6ff1ad4e2 tempest-VolumesSnapshotsTestJSON-1420095746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:01:56 devstack sudo[87237]: pam_unix(sudo:session): session closed for user root Nov 02 10:01:56 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-4d0617b6-1a74-4790-923c-f9430ffbe5fd tempest-TaggedAttachmentsTest-1004175425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-9476181d-385b-46d4-b594-f641000ad2a3 1073741824" returned: 0 in 0.720s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:01:57 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-4d0617b6-1a74-4790-923c-f9430ffbe5fd tempest-TaggedAttachmentsTest-1004175425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-9476181d-385b-46d4-b594-f641000ad2a3 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:01:57 devstack sudo[87555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-9476181d-385b-46d4-b594-f641000ad2a3 Nov 02 10:01:57 devstack sudo[87555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:01:57 devstack sudo[87555]: pam_unix(sudo:session): session closed for user root Nov 02 10:01:57 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-4d0617b6-1a74-4790-923c-f9430ffbe5fd tempest-TaggedAttachmentsTest-1004175425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-9476181d-385b-46d4-b594-f641000ad2a3" returned: 0 in 0.376s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:01:57 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-4d0617b6-1a74-4790-923c-f9430ffbe5fd tempest-TaggedAttachmentsTest-1004175425 None] <== create_volume: return (1266ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:01:57 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-4d0617b6-1a74-4790-923c-f9430ffbe5fd tempest-TaggedAttachmentsTest-1004175425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.269s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:01:57 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [req-dd8238b2-1875-48cb-8617-101c3bb8cb72 req-2054e567-adaa-44e0-93cb-84f6ff1ad4e2 tempest-VolumesSnapshotsTestJSON-1420095746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.036s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:01:57 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [req-dd8238b2-1875-48cb-8617-101c3bb8cb72 req-2054e567-adaa-44e0-93cb-84f6ff1ad4e2 tempest-VolumesSnapshotsTestJSON-1420095746 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:01:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1246301779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aea0fb2c-25e0-446d-9e37-7f716b1a6404,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84b6086514c5442dbc1579e70119b5d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:01:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:01:56Z,use_quota=True,user_id='9dd7e29a84d642bd81296e3b2396f693',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:01:57 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [req-dd8238b2-1875-48cb-8617-101c3bb8cb72 req-2054e567-adaa-44e0-93cb-84f6ff1ad4e2 tempest-VolumesSnapshotsTestJSON-1420095746 None] Creating volume aea0fb2c-25e0-446d-9e37-7f716b1a6404 {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:01:57 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [req-dd8238b2-1875-48cb-8617-101c3bb8cb72 req-2054e567-adaa-44e0-93cb-84f6ff1ad4e2 tempest-VolumesSnapshotsTestJSON-1420095746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:01:57 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [req-dd8238b2-1875-48cb-8617-101c3bb8cb72 req-2054e567-adaa-44e0-93cb-84f6ff1ad4e2 tempest-VolumesSnapshotsTestJSON-1420095746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:01:57 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [req-dd8238b2-1875-48cb-8617-101c3bb8cb72 req-2054e567-adaa-44e0-93cb-84f6ff1ad4e2 tempest-VolumesSnapshotsTestJSON-1420095746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:01:57 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [req-dd8238b2-1875-48cb-8617-101c3bb8cb72 req-2054e567-adaa-44e0-93cb-84f6ff1ad4e2 tempest-VolumesSnapshotsTestJSON-1420095746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:01:57 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [req-dd8238b2-1875-48cb-8617-101c3bb8cb72 req-2054e567-adaa-44e0-93cb-84f6ff1ad4e2 tempest-VolumesSnapshotsTestJSON-1420095746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:01:57 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [req-dd8238b2-1875-48cb-8617-101c3bb8cb72 req-2054e567-adaa-44e0-93cb-84f6ff1ad4e2 tempest-VolumesSnapshotsTestJSON-1420095746 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:01:57 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [req-dd8238b2-1875-48cb-8617-101c3bb8cb72 req-2054e567-adaa-44e0-93cb-84f6ff1ad4e2 tempest-VolumesSnapshotsTestJSON-1420095746 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:01:57 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [req-dd8238b2-1875-48cb-8617-101c3bb8cb72 req-2054e567-adaa-44e0-93cb-84f6ff1ad4e2 tempest-VolumesSnapshotsTestJSON-1420095746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-aea0fb2c-25e0-446d-9e37-7f716b1a6404 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:01:57 devstack sudo[87559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-aea0fb2c-25e0-446d-9e37-7f716b1a6404 1073741824 Nov 02 10:01:57 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-4d0617b6-1a74-4790-923c-f9430ffbe5fd tempest-TaggedAttachmentsTest-1004175425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23eefd76-6d36-45d2-83f3-d144bc75ce2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9476181d-385b-46d4-b594-f641000ad2a3', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:01:57 devstack sudo[87559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:01:57 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-4d0617b6-1a74-4790-923c-f9430ffbe5fd tempest-TaggedAttachmentsTest-1004175425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7e8744d-957e-4f09-841a-cc079f9c26a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:01:57 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-4d0617b6-1a74-4790-923c-f9430ffbe5fd tempest-TaggedAttachmentsTest-1004175425 None] Volume volume-9476181d-385b-46d4-b594-f641000ad2a3 (9476181d-385b-46d4-b594-f641000ad2a3): created successfully Nov 02 10:01:57 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-4d0617b6-1a74-4790-923c-f9430ffbe5fd tempest-TaggedAttachmentsTest-1004175425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7e8744d-957e-4f09-841a-cc079f9c26a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:01:57 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-4d0617b6-1a74-4790-923c-f9430ffbe5fd tempest-TaggedAttachmentsTest-1004175425 None] Flow 'volume_create_manager' (3f4c3b34-0736-40eb-a238-4303649e4e12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:01:57 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-4d0617b6-1a74-4790-923c-f9430ffbe5fd tempest-TaggedAttachmentsTest-1004175425 None] Created volume successfully. Nov 02 10:01:58 devstack sudo[87559]: pam_unix(sudo:session): session closed for user root Nov 02 10:01:58 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [req-dd8238b2-1875-48cb-8617-101c3bb8cb72 req-2054e567-adaa-44e0-93cb-84f6ff1ad4e2 tempest-VolumesSnapshotsTestJSON-1420095746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-aea0fb2c-25e0-446d-9e37-7f716b1a6404 1073741824" returned: 0 in 0.611s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:01:58 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [req-dd8238b2-1875-48cb-8617-101c3bb8cb72 req-2054e567-adaa-44e0-93cb-84f6ff1ad4e2 tempest-VolumesSnapshotsTestJSON-1420095746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-aea0fb2c-25e0-446d-9e37-7f716b1a6404 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:01:58 devstack sudo[87566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-aea0fb2c-25e0-446d-9e37-7f716b1a6404 Nov 02 10:01:58 devstack sudo[87566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:01:58 devstack sudo[87566]: pam_unix(sudo:session): session closed for user root Nov 02 10:01:58 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [req-dd8238b2-1875-48cb-8617-101c3bb8cb72 req-2054e567-adaa-44e0-93cb-84f6ff1ad4e2 tempest-VolumesSnapshotsTestJSON-1420095746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-aea0fb2c-25e0-446d-9e37-7f716b1a6404" returned: 0 in 0.402s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:01:58 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [req-dd8238b2-1875-48cb-8617-101c3bb8cb72 req-2054e567-adaa-44e0-93cb-84f6ff1ad4e2 tempest-VolumesSnapshotsTestJSON-1420095746 None] <== create_volume: return (1088ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:01:58 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [req-dd8238b2-1875-48cb-8617-101c3bb8cb72 req-2054e567-adaa-44e0-93cb-84f6ff1ad4e2 tempest-VolumesSnapshotsTestJSON-1420095746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.100s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:01:58 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [req-dd8238b2-1875-48cb-8617-101c3bb8cb72 req-2054e567-adaa-44e0-93cb-84f6ff1ad4e2 tempest-VolumesSnapshotsTestJSON-1420095746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a794f859-eaae-4a54-bd7c-f33487ff7768) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aea0fb2c-25e0-446d-9e37-7f716b1a6404', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:01:58 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [req-dd8238b2-1875-48cb-8617-101c3bb8cb72 req-2054e567-adaa-44e0-93cb-84f6ff1ad4e2 tempest-VolumesSnapshotsTestJSON-1420095746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac836f51-b736-4d6a-be40-820fd394416d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:01:58 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [req-dd8238b2-1875-48cb-8617-101c3bb8cb72 req-2054e567-adaa-44e0-93cb-84f6ff1ad4e2 tempest-VolumesSnapshotsTestJSON-1420095746 None] Volume volume-aea0fb2c-25e0-446d-9e37-7f716b1a6404 (aea0fb2c-25e0-446d-9e37-7f716b1a6404): created successfully Nov 02 10:01:58 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [req-dd8238b2-1875-48cb-8617-101c3bb8cb72 req-2054e567-adaa-44e0-93cb-84f6ff1ad4e2 tempest-VolumesSnapshotsTestJSON-1420095746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac836f51-b736-4d6a-be40-820fd394416d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:01:58 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [req-dd8238b2-1875-48cb-8617-101c3bb8cb72 req-2054e567-adaa-44e0-93cb-84f6ff1ad4e2 tempest-VolumesSnapshotsTestJSON-1420095746 None] Flow 'volume_create_manager' (04ca398f-7198-437a-acf7-78ed608f0139) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:01:58 devstack cinder-volume[86890]: INFO cinder.volume.manager [req-dd8238b2-1875-48cb-8617-101c3bb8cb72 req-2054e567-adaa-44e0-93cb-84f6ff1ad4e2 tempest-VolumesSnapshotsTestJSON-1420095746 None] Created volume successfully. Nov 02 10:02:04 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [req-a39d2b91-b8e1-4493-93f4-b74f2423e8fd req-9b163f55-e546-48fc-a90f-af5e160135d8 tempest-VolumesSnapshotsTestJSON-1420095746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:02:04 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [req-a39d2b91-b8e1-4493-93f4-b74f2423e8fd req-9b163f55-e546-48fc-a90f-af5e160135d8 tempest-VolumesSnapshotsTestJSON-1420095746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:02:04 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [req-a39d2b91-b8e1-4493-93f4-b74f2423e8fd req-9b163f55-e546-48fc-a90f-af5e160135d8 tempest-VolumesSnapshotsTestJSON-1420095746 None] Creating offline snapshot 2e351b98-8694-4589-b508-89d9d1d1a11e of volume aea0fb2c-25e0-446d-9e37-7f716b1a6404 {{(pid=86890) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:02:04 devstack cinder-volume[86890]: INFO oslo.privsep.daemon [req-a39d2b91-b8e1-4493-93f4-b74f2423e8fd req-9b163f55-e546-48fc-a90f-af5e160135d8 tempest-VolumesSnapshotsTestJSON-1420095746 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpue2ucs9i/privsep.sock'] Nov 02 10:02:04 devstack sudo[87609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpue2ucs9i/privsep.sock Nov 02 10:02:04 devstack sudo[87609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:02:05 devstack cinder-volume[86890]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Nov 02 10:02:05 devstack cinder-volume[86890]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 02 10:02:05 devstack cinder-volume[86890]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Nov 02 10:02:05 devstack cinder-volume[86890]: WARNING oslo.privsep.daemon [-] privsep log: Nov 02 10:02:05 devstack cinder-volume[86890]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Nov 02 10:02:05 devstack cinder-volume[86890]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Nov 02 10:02:05 devstack cinder-volume[86890]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 02 10:02:05 devstack cinder-volume[86890]: WARNING oslo.privsep.daemon [-] privsep log: Nov 02 10:02:05 devstack cinder-volume[86890]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Nov 02 10:02:05 devstack sudo[87609]: pam_unix(sudo:session): session closed for user root Nov 02 10:02:05 devstack cinder-volume[86890]: INFO oslo.privsep.daemon [req-a39d2b91-b8e1-4493-93f4-b74f2423e8fd req-9b163f55-e546-48fc-a90f-af5e160135d8 tempest-VolumesSnapshotsTestJSON-1420095746 None] Spawned new privsep daemon via rootwrap Nov 02 10:02:05 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [req-a39d2b91-b8e1-4493-93f4-b74f2423e8fd req-9b163f55-e546-48fc-a90f-af5e160135d8 tempest-VolumesSnapshotsTestJSON-1420095746 None] Accepted privsep connection to /tmp/tmpue2ucs9i/privsep.sock {{(pid=86890) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Nov 02 10:02:05 devstack cinder-volume[86890]: INFO oslo.privsep.daemon [-] privsep daemon starting Nov 02 10:02:05 devstack cinder-volume[86890]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Nov 02 10:02:05 devstack cinder-volume[86890]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Nov 02 10:02:05 devstack cinder-volume[86890]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 87612 Nov 02 10:02:05 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb8792bd-a82a-42e3-b20e-14b3a0d53de2]: (2,) {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:02:05 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[c537f7e0-0bfc-491b-bc0a-7c6f42941fa4]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:02:05 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [req-a39d2b91-b8e1-4493-93f4-b74f2423e8fd req-9b163f55-e546-48fc-a90f-af5e160135d8 tempest-VolumesSnapshotsTestJSON-1420095746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-aea0fb2c-25e0-446d-9e37-7f716b1a6404 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:02:05 devstack sudo[87614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-aea0fb2c-25e0-446d-9e37-7f716b1a6404 Nov 02 10:02:05 devstack sudo[87614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:02:06 devstack sudo[87614]: pam_unix(sudo:session): session closed for user root Nov 02 10:02:06 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [req-a39d2b91-b8e1-4493-93f4-b74f2423e8fd req-9b163f55-e546-48fc-a90f-af5e160135d8 tempest-VolumesSnapshotsTestJSON-1420095746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-aea0fb2c-25e0-446d-9e37-7f716b1a6404" returned: 0 in 0.564s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:02:06 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [req-a39d2b91-b8e1-4493-93f4-b74f2423e8fd req-9b163f55-e546-48fc-a90f-af5e160135d8 tempest-VolumesSnapshotsTestJSON-1420095746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-aea0fb2c-25e0-446d-9e37-7f716b1a6404,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-aea0fb2c-25e0-446d-9e37-7f716b1a6404.2e351b98-8694-4589-b508-89d9d1d1a11e 1G {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:02:06 devstack sudo[87625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-aea0fb2c-25e0-446d-9e37-7f716b1a6404,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-aea0fb2c-25e0-446d-9e37-7f716b1a6404.2e351b98-8694-4589-b508-89d9d1d1a11e 1G Nov 02 10:02:06 devstack sudo[87625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:02:06 devstack sudo[87625]: pam_unix(sudo:session): session closed for user root Nov 02 10:02:06 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [req-a39d2b91-b8e1-4493-93f4-b74f2423e8fd req-9b163f55-e546-48fc-a90f-af5e160135d8 tempest-VolumesSnapshotsTestJSON-1420095746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-aea0fb2c-25e0-446d-9e37-7f716b1a6404,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-aea0fb2c-25e0-446d-9e37-7f716b1a6404.2e351b98-8694-4589-b508-89d9d1d1a11e 1G" returned: 0 in 0.625s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:02:06 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [req-a39d2b91-b8e1-4493-93f4-b74f2423e8fd req-9b163f55-e546-48fc-a90f-af5e160135d8 tempest-VolumesSnapshotsTestJSON-1420095746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aea0fb2c-25e0-446d-9e37-7f716b1a6404 -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-aea0fb2c-25e0-446d-9e37-7f716b1a6404.2e351b98-8694-4589-b508-89d9d1d1a11e {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:02:06 devstack sudo[87633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aea0fb2c-25e0-446d-9e37-7f716b1a6404 -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-aea0fb2c-25e0-446d-9e37-7f716b1a6404.2e351b98-8694-4589-b508-89d9d1d1a11e Nov 02 10:02:06 devstack sudo[87633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:02:07 devstack sudo[87633]: pam_unix(sudo:session): session closed for user root Nov 02 10:02:07 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [req-a39d2b91-b8e1-4493-93f4-b74f2423e8fd req-9b163f55-e546-48fc-a90f-af5e160135d8 tempest-VolumesSnapshotsTestJSON-1420095746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aea0fb2c-25e0-446d-9e37-7f716b1a6404 -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-aea0fb2c-25e0-446d-9e37-7f716b1a6404.2e351b98-8694-4589-b508-89d9d1d1a11e" returned: 0 in 0.440s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:02:07 devstack cinder-volume[86890]: WARNING cinder.volume.drivers.remotefs [req-a39d2b91-b8e1-4493-93f4-b74f2423e8fd req-9b163f55-e546-48fc-a90f-af5e160135d8 tempest-VolumesSnapshotsTestJSON-1420095746 None] /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-aea0fb2c-25e0-446d-9e37-7f716b1a6404.2e351b98-8694-4589-b508-89d9d1d1a11e is being set with open permissions: ugo+rw Nov 02 10:02:07 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [req-a39d2b91-b8e1-4493-93f4-b74f2423e8fd req-9b163f55-e546-48fc-a90f-af5e160135d8 tempest-VolumesSnapshotsTestJSON-1420095746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-aea0fb2c-25e0-446d-9e37-7f716b1a6404.2e351b98-8694-4589-b508-89d9d1d1a11e {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:02:07 devstack sudo[87638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-aea0fb2c-25e0-446d-9e37-7f716b1a6404.2e351b98-8694-4589-b508-89d9d1d1a11e Nov 02 10:02:07 devstack sudo[87638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:02:07 devstack sudo[87638]: pam_unix(sudo:session): session closed for user root Nov 02 10:02:07 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [req-a39d2b91-b8e1-4493-93f4-b74f2423e8fd req-9b163f55-e546-48fc-a90f-af5e160135d8 tempest-VolumesSnapshotsTestJSON-1420095746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-aea0fb2c-25e0-446d-9e37-7f716b1a6404.2e351b98-8694-4589-b508-89d9d1d1a11e" returned: 0 in 0.294s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:02:07 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [req-a39d2b91-b8e1-4493-93f4-b74f2423e8fd req-9b163f55-e546-48fc-a90f-af5e160135d8 tempest-VolumesSnapshotsTestJSON-1420095746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-aea0fb2c-25e0-446d-9e37-7f716b1a6404.info {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:02:07 devstack sudo[87643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-aea0fb2c-25e0-446d-9e37-7f716b1a6404.info Nov 02 10:02:07 devstack sudo[87643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:02:07 devstack sudo[87643]: pam_unix(sudo:session): session closed for user root Nov 02 10:02:07 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [req-a39d2b91-b8e1-4493-93f4-b74f2423e8fd req-9b163f55-e546-48fc-a90f-af5e160135d8 tempest-VolumesSnapshotsTestJSON-1420095746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-aea0fb2c-25e0-446d-9e37-7f716b1a6404.info" returned: 0 in 0.323s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:02:07 devstack cinder-volume[86890]: WARNING cinder.volume.drivers.remotefs [req-a39d2b91-b8e1-4493-93f4-b74f2423e8fd req-9b163f55-e546-48fc-a90f-af5e160135d8 tempest-VolumesSnapshotsTestJSON-1420095746 None] /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-aea0fb2c-25e0-446d-9e37-7f716b1a6404.info is being set with open permissions: ugo+rw Nov 02 10:02:07 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [req-a39d2b91-b8e1-4493-93f4-b74f2423e8fd req-9b163f55-e546-48fc-a90f-af5e160135d8 tempest-VolumesSnapshotsTestJSON-1420095746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-aea0fb2c-25e0-446d-9e37-7f716b1a6404.info {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:02:07 devstack sudo[87646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-aea0fb2c-25e0-446d-9e37-7f716b1a6404.info Nov 02 10:02:07 devstack sudo[87646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:02:08 devstack sudo[87646]: pam_unix(sudo:session): session closed for user root Nov 02 10:02:08 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [req-a39d2b91-b8e1-4493-93f4-b74f2423e8fd req-9b163f55-e546-48fc-a90f-af5e160135d8 tempest-VolumesSnapshotsTestJSON-1420095746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-aea0fb2c-25e0-446d-9e37-7f716b1a6404.info" returned: 0 in 0.335s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:02:08 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [req-a39d2b91-b8e1-4493-93f4-b74f2423e8fd req-9b163f55-e546-48fc-a90f-af5e160135d8 tempest-VolumesSnapshotsTestJSON-1420095746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.107s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:02:08 devstack cinder-volume[86890]: INFO cinder.volume.manager [req-a39d2b91-b8e1-4493-93f4-b74f2423e8fd req-9b163f55-e546-48fc-a90f-af5e160135d8 tempest-VolumesSnapshotsTestJSON-1420095746 None] Create snapshot completed successfully Nov 02 10:02:09 devstack cinder-volume[86890]: DEBUG cinder.coordination [req-b71e07e9-2c5e-44b2-90d0-b305e41ba3d5 req-f78852c3-fcd4-4ff3-97ff-e98351ada847 tempest-VolumesSnapshotsTestJSON-1420095746 None] Acquiring lock "cinder-2e351b98-8694-4589-b508-89d9d1d1a11e-delete_snapshot" by "delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:02:09 devstack cinder-volume[86890]: DEBUG cinder.coordination [req-b71e07e9-2c5e-44b2-90d0-b305e41ba3d5 req-f78852c3-fcd4-4ff3-97ff-e98351ada847 tempest-VolumesSnapshotsTestJSON-1420095746 None] Lock "cinder-2e351b98-8694-4589-b508-89d9d1d1a11e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.059s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:02:09 devstack cinder-volume[86890]: DEBUG cinder.coordination [req-b71e07e9-2c5e-44b2-90d0-b305e41ba3d5 req-f78852c3-fcd4-4ff3-97ff-e98351ada847 tempest-VolumesSnapshotsTestJSON-1420095746 None] Acquiring lock "cinder-quobyte-aea0fb2c-25e0-446d-9e37-7f716b1a6404" by "delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:02:09 devstack cinder-volume[86890]: DEBUG cinder.coordination [req-b71e07e9-2c5e-44b2-90d0-b305e41ba3d5 req-f78852c3-fcd4-4ff3-97ff-e98351ada847 tempest-VolumesSnapshotsTestJSON-1420095746 None] Lock "cinder-quobyte-aea0fb2c-25e0-446d-9e37-7f716b1a6404" acquired by "delete_snapshot" :: waited 0.043s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:02:09 devstack cinder-volume[86890]: DEBUG cinder.coordination [req-b71e07e9-2c5e-44b2-90d0-b305e41ba3d5 req-f78852c3-fcd4-4ff3-97ff-e98351ada847 tempest-VolumesSnapshotsTestJSON-1420095746 None] Acquiring lock "cinder-quobyte-2e351b98-8694-4589-b508-89d9d1d1a11e" by "_delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:02:10 devstack cinder-volume[86890]: DEBUG cinder.coordination [req-b71e07e9-2c5e-44b2-90d0-b305e41ba3d5 req-f78852c3-fcd4-4ff3-97ff-e98351ada847 tempest-VolumesSnapshotsTestJSON-1420095746 None] Lock "cinder-quobyte-2e351b98-8694-4589-b508-89d9d1d1a11e" acquired by "_delete_snapshot" :: waited 0.044s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:02:10 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [req-b71e07e9-2c5e-44b2-90d0-b305e41ba3d5 req-f78852c3-fcd4-4ff3-97ff-e98351ada847 tempest-VolumesSnapshotsTestJSON-1420095746 None] Deleting offline snapshot 2e351b98-8694-4589-b508-89d9d1d1a11e of volume aea0fb2c-25e0-446d-9e37-7f716b1a6404 {{(pid=86890) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:02:10 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [req-b71e07e9-2c5e-44b2-90d0-b305e41ba3d5 req-f78852c3-fcd4-4ff3-97ff-e98351ada847 tempest-VolumesSnapshotsTestJSON-1420095746 None] snapshot_file for this snap is: volume-aea0fb2c-25e0-446d-9e37-7f716b1a6404.2e351b98-8694-4589-b508-89d9d1d1a11e {{(pid=86890) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:02:10 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[13ccfc6c-0e9c-4dc4-946d-b4d558b43e4b]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:02:10 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [req-b71e07e9-2c5e-44b2-90d0-b305e41ba3d5 req-f78852c3-fcd4-4ff3-97ff-e98351ada847 tempest-VolumesSnapshotsTestJSON-1420095746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-aea0fb2c-25e0-446d-9e37-7f716b1a6404.2e351b98-8694-4589-b508-89d9d1d1a11e {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:02:10 devstack sudo[87664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-aea0fb2c-25e0-446d-9e37-7f716b1a6404.2e351b98-8694-4589-b508-89d9d1d1a11e Nov 02 10:02:10 devstack sudo[87664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:02:10 devstack sudo[87664]: pam_unix(sudo:session): session closed for user root Nov 02 10:02:10 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [req-b71e07e9-2c5e-44b2-90d0-b305e41ba3d5 req-f78852c3-fcd4-4ff3-97ff-e98351ada847 tempest-VolumesSnapshotsTestJSON-1420095746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-aea0fb2c-25e0-446d-9e37-7f716b1a6404.2e351b98-8694-4589-b508-89d9d1d1a11e" returned: 0 in 0.534s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:02:10 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [req-b71e07e9-2c5e-44b2-90d0-b305e41ba3d5 req-f78852c3-fcd4-4ff3-97ff-e98351ada847 tempest-VolumesSnapshotsTestJSON-1420095746 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aea0fb2c-25e0-446d-9e37-7f716b1a6404(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86890) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:02:10 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[975c79a1-1a0b-4d44-b1d7-513841805b91]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:02:10 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [req-b71e07e9-2c5e-44b2-90d0-b305e41ba3d5 req-f78852c3-fcd4-4ff3-97ff-e98351ada847 tempest-VolumesSnapshotsTestJSON-1420095746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-aea0fb2c-25e0-446d-9e37-7f716b1a6404 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:02:10 devstack sudo[87684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-aea0fb2c-25e0-446d-9e37-7f716b1a6404 Nov 02 10:02:10 devstack sudo[87684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:02:11 devstack sudo[87684]: pam_unix(sudo:session): session closed for user root Nov 02 10:02:11 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [req-b71e07e9-2c5e-44b2-90d0-b305e41ba3d5 req-f78852c3-fcd4-4ff3-97ff-e98351ada847 tempest-VolumesSnapshotsTestJSON-1420095746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-aea0fb2c-25e0-446d-9e37-7f716b1a6404" returned: 0 in 0.604s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:02:11 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [req-b71e07e9-2c5e-44b2-90d0-b305e41ba3d5 req-f78852c3-fcd4-4ff3-97ff-e98351ada847 tempest-VolumesSnapshotsTestJSON-1420095746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-aea0fb2c-25e0-446d-9e37-7f716b1a6404.2e351b98-8694-4589-b508-89d9d1d1a11e {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:02:11 devstack sudo[87703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-aea0fb2c-25e0-446d-9e37-7f716b1a6404.2e351b98-8694-4589-b508-89d9d1d1a11e Nov 02 10:02:11 devstack sudo[87703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:02:11 devstack sudo[87703]: pam_unix(sudo:session): session closed for user root Nov 02 10:02:11 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [req-b71e07e9-2c5e-44b2-90d0-b305e41ba3d5 req-f78852c3-fcd4-4ff3-97ff-e98351ada847 tempest-VolumesSnapshotsTestJSON-1420095746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-aea0fb2c-25e0-446d-9e37-7f716b1a6404.2e351b98-8694-4589-b508-89d9d1d1a11e" returned: 0 in 0.533s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:02:11 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [req-b71e07e9-2c5e-44b2-90d0-b305e41ba3d5 req-f78852c3-fcd4-4ff3-97ff-e98351ada847 tempest-VolumesSnapshotsTestJSON-1420095746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-aea0fb2c-25e0-446d-9e37-7f716b1a6404.2e351b98-8694-4589-b508-89d9d1d1a11e {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:02:11 devstack sudo[87719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-aea0fb2c-25e0-446d-9e37-7f716b1a6404.2e351b98-8694-4589-b508-89d9d1d1a11e Nov 02 10:02:11 devstack sudo[87719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:02:12 devstack sudo[87719]: pam_unix(sudo:session): session closed for user root Nov 02 10:02:12 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [req-b71e07e9-2c5e-44b2-90d0-b305e41ba3d5 req-f78852c3-fcd4-4ff3-97ff-e98351ada847 tempest-VolumesSnapshotsTestJSON-1420095746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-aea0fb2c-25e0-446d-9e37-7f716b1a6404.2e351b98-8694-4589-b508-89d9d1d1a11e" returned: 0 in 0.396s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:02:12 devstack cinder-volume[86890]: DEBUG cinder.coordination [req-b71e07e9-2c5e-44b2-90d0-b305e41ba3d5 req-f78852c3-fcd4-4ff3-97ff-e98351ada847 tempest-VolumesSnapshotsTestJSON-1420095746 None] Lock "cinder-quobyte-2e351b98-8694-4589-b508-89d9d1d1a11e" released by "_delete_snapshot" :: held 2.265s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:02:12 devstack cinder-volume[86890]: DEBUG cinder.coordination [req-b71e07e9-2c5e-44b2-90d0-b305e41ba3d5 req-f78852c3-fcd4-4ff3-97ff-e98351ada847 tempest-VolumesSnapshotsTestJSON-1420095746 None] Lock "cinder-quobyte-aea0fb2c-25e0-446d-9e37-7f716b1a6404" released by "delete_snapshot" :: held 2.326s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:02:12 devstack cinder-volume[86890]: WARNING cinder.quota [req-b71e07e9-2c5e-44b2-90d0-b305e41ba3d5 req-f78852c3-fcd4-4ff3-97ff-e98351ada847 tempest-VolumesSnapshotsTestJSON-1420095746 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:02:12 devstack cinder-volume[86890]: WARNING cinder.quota [req-b71e07e9-2c5e-44b2-90d0-b305e41ba3d5 req-f78852c3-fcd4-4ff3-97ff-e98351ada847 tempest-VolumesSnapshotsTestJSON-1420095746 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:02:12 devstack cinder-volume[86890]: DEBUG cinder.quota [req-b71e07e9-2c5e-44b2-90d0-b305e41ba3d5 req-f78852c3-fcd4-4ff3-97ff-e98351ada847 tempest-VolumesSnapshotsTestJSON-1420095746 None] Created reservations ['ddf52211-af75-4383-b7be-54ce1c33e106', '13a3d469-32d7-49f9-8abe-92eb251d7e0e', '1f260901-1b99-4a35-be89-3c09362dae5b', '93001896-44fc-4c5e-9b20-ab01a333432a'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:02:12 devstack cinder-volume[86890]: INFO cinder.volume.manager [req-b71e07e9-2c5e-44b2-90d0-b305e41ba3d5 req-f78852c3-fcd4-4ff3-97ff-e98351ada847 tempest-VolumesSnapshotsTestJSON-1420095746 None] Delete snapshot completed successfully. Nov 02 10:02:12 devstack cinder-volume[86890]: DEBUG cinder.coordination [req-b71e07e9-2c5e-44b2-90d0-b305e41ba3d5 req-f78852c3-fcd4-4ff3-97ff-e98351ada847 tempest-VolumesSnapshotsTestJSON-1420095746 None] Lock "cinder-2e351b98-8694-4589-b508-89d9d1d1a11e-delete_snapshot" released by "delete_snapshot" :: held 2.600s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:02:13 devstack cinder-volume[86890]: DEBUG cinder.coordination [req-e52d656d-378c-4913-9a75-9cbfaf93ca32 req-d8a528e8-7390-4b4d-99f6-0e95b967765b tempest-VolumesSnapshotsTestJSON-1420095746 None] Acquiring lock "cinder-aea0fb2c-25e0-446d-9e37-7f716b1a6404-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:02:13 devstack cinder-volume[86890]: DEBUG cinder.coordination [req-e52d656d-378c-4913-9a75-9cbfaf93ca32 req-d8a528e8-7390-4b4d-99f6-0e95b967765b tempest-VolumesSnapshotsTestJSON-1420095746 None] Lock "cinder-aea0fb2c-25e0-446d-9e37-7f716b1a6404-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:02:13 devstack cinder-volume[86890]: DEBUG cinder.coordination [req-e52d656d-378c-4913-9a75-9cbfaf93ca32 req-d8a528e8-7390-4b4d-99f6-0e95b967765b tempest-VolumesSnapshotsTestJSON-1420095746 None] Acquiring lock "cinder-quobyte-aea0fb2c-25e0-446d-9e37-7f716b1a6404" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:02:13 devstack cinder-volume[86890]: DEBUG cinder.coordination [req-e52d656d-378c-4913-9a75-9cbfaf93ca32 req-d8a528e8-7390-4b4d-99f6-0e95b967765b tempest-VolumesSnapshotsTestJSON-1420095746 None] Lock "cinder-quobyte-aea0fb2c-25e0-446d-9e37-7f716b1a6404" acquired by "delete_volume" :: waited 0.023s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:02:13 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[48e687a1-703b-452c-8274-7f6a7c3a2311]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:02:13 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [req-e52d656d-378c-4913-9a75-9cbfaf93ca32 req-d8a528e8-7390-4b4d-99f6-0e95b967765b tempest-VolumesSnapshotsTestJSON-1420095746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-aea0fb2c-25e0-446d-9e37-7f716b1a6404 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:02:14 devstack sudo[87755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-aea0fb2c-25e0-446d-9e37-7f716b1a6404 Nov 02 10:02:14 devstack sudo[87755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:02:14 devstack sudo[87755]: pam_unix(sudo:session): session closed for user root Nov 02 10:02:14 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [req-e52d656d-378c-4913-9a75-9cbfaf93ca32 req-d8a528e8-7390-4b4d-99f6-0e95b967765b tempest-VolumesSnapshotsTestJSON-1420095746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-aea0fb2c-25e0-446d-9e37-7f716b1a6404" returned: 0 in 0.655s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:02:14 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [req-e52d656d-378c-4913-9a75-9cbfaf93ca32 req-d8a528e8-7390-4b4d-99f6-0e95b967765b tempest-VolumesSnapshotsTestJSON-1420095746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-aea0fb2c-25e0-446d-9e37-7f716b1a6404 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:02:14 devstack sudo[87762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-aea0fb2c-25e0-446d-9e37-7f716b1a6404 Nov 02 10:02:14 devstack sudo[87762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:02:14 devstack sudo[87762]: pam_unix(sudo:session): session closed for user root Nov 02 10:02:14 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [req-e52d656d-378c-4913-9a75-9cbfaf93ca32 req-d8a528e8-7390-4b4d-99f6-0e95b967765b tempest-VolumesSnapshotsTestJSON-1420095746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-aea0fb2c-25e0-446d-9e37-7f716b1a6404" returned: 0 in 0.263s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:02:14 devstack cinder-volume[86890]: DEBUG cinder.coordination [req-e52d656d-378c-4913-9a75-9cbfaf93ca32 req-d8a528e8-7390-4b4d-99f6-0e95b967765b tempest-VolumesSnapshotsTestJSON-1420095746 None] Lock "cinder-quobyte-aea0fb2c-25e0-446d-9e37-7f716b1a6404" released by "delete_volume" :: held 1.070s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:02:14 devstack cinder-volume[86890]: WARNING cinder.quota [req-e52d656d-378c-4913-9a75-9cbfaf93ca32 req-d8a528e8-7390-4b4d-99f6-0e95b967765b tempest-VolumesSnapshotsTestJSON-1420095746 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:02:14 devstack cinder-volume[86890]: DEBUG cinder.quota [req-e52d656d-378c-4913-9a75-9cbfaf93ca32 req-d8a528e8-7390-4b4d-99f6-0e95b967765b tempest-VolumesSnapshotsTestJSON-1420095746 None] Created reservations ['09284d6e-2adb-4224-b244-1ca6c8f5a155', '2c927282-f76f-4485-be43-447ddcab84a4', '00d8c059-e6b4-4967-9661-0daf938d5d71', '2eea73f9-b4d0-416b-98c2-401bb24b33d2'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:02:15 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [req-e52d656d-378c-4913-9a75-9cbfaf93ca32 req-d8a528e8-7390-4b4d-99f6-0e95b967765b tempest-VolumesSnapshotsTestJSON-1420095746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:02:15 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [req-e52d656d-378c-4913-9a75-9cbfaf93ca32 req-d8a528e8-7390-4b4d-99f6-0e95b967765b tempest-VolumesSnapshotsTestJSON-1420095746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:02:15 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [req-e52d656d-378c-4913-9a75-9cbfaf93ca32 req-d8a528e8-7390-4b4d-99f6-0e95b967765b tempest-VolumesSnapshotsTestJSON-1420095746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:02:15 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [req-e52d656d-378c-4913-9a75-9cbfaf93ca32 req-d8a528e8-7390-4b4d-99f6-0e95b967765b tempest-VolumesSnapshotsTestJSON-1420095746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:02:15 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [req-e52d656d-378c-4913-9a75-9cbfaf93ca32 req-d8a528e8-7390-4b4d-99f6-0e95b967765b tempest-VolumesSnapshotsTestJSON-1420095746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:02:15 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [req-e52d656d-378c-4913-9a75-9cbfaf93ca32 req-d8a528e8-7390-4b4d-99f6-0e95b967765b tempest-VolumesSnapshotsTestJSON-1420095746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:02:15 devstack sudo[87783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:02:15 devstack sudo[87783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:02:15 devstack sudo[87783]: pam_unix(sudo:session): session closed for user root Nov 02 10:02:15 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [req-e52d656d-378c-4913-9a75-9cbfaf93ca32 req-d8a528e8-7390-4b4d-99f6-0e95b967765b tempest-VolumesSnapshotsTestJSON-1420095746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.443s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:02:15 devstack cinder-volume[86890]: DEBUG cinder.manager [req-e52d656d-378c-4913-9a75-9cbfaf93ca32 req-d8a528e8-7390-4b4d-99f6-0e95b967765b tempest-VolumesSnapshotsTestJSON-1420095746 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:02:15 devstack cinder-volume[86890]: INFO cinder.volume.manager [req-e52d656d-378c-4913-9a75-9cbfaf93ca32 req-d8a528e8-7390-4b4d-99f6-0e95b967765b tempest-VolumesSnapshotsTestJSON-1420095746 None] Deleted volume successfully. Nov 02 10:02:15 devstack cinder-volume[86890]: DEBUG cinder.coordination [req-e52d656d-378c-4913-9a75-9cbfaf93ca32 req-d8a528e8-7390-4b4d-99f6-0e95b967765b tempest-VolumesSnapshotsTestJSON-1420095746 None] Lock "cinder-aea0fb2c-25e0-446d-9e37-7f716b1a6404-delete_volume" released by "delete_volume" :: held 1.988s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:02:24 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-0419710b-2154-491b-b0c1-1fc191cdc197 tempest-GroupSnapshotsV319Test-1284869072 None] Group tempest-GroupSnapshotsV319Test-Group-524225860: creating Nov 02 10:02:24 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-0419710b-2154-491b-b0c1-1fc191cdc197 tempest-GroupSnapshotsV319Test-1284869072 None] Group tempest-GroupSnapshotsV319Test-Group-524225860: created successfully Nov 02 10:02:24 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-0419710b-2154-491b-b0c1-1fc191cdc197 tempest-GroupSnapshotsV319Test-1284869072 None] Create group completed successfully. Nov 02 10:02:26 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d140575-7b07-4ed6-b0d3-67112f8dc043 tempest-GroupSnapshotsV319Test-1284869072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:02:26 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-1d140575-7b07-4ed6-b0d3-67112f8dc043 tempest-GroupSnapshotsV319Test-1284869072 None] Flow 'volume_create_manager' (bd0891ee-2563-47fe-b2b0-c514dca08266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:02:26 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-1d140575-7b07-4ed6-b0d3-67112f8dc043 tempest-GroupSnapshotsV319Test-1284869072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b42ca94f-1d45-45b7-9426-1b108522e8a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:02:26 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-1d140575-7b07-4ed6-b0d3-67112f8dc043 tempest-GroupSnapshotsV319Test-1284869072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b42ca94f-1d45-45b7-9426-1b108522e8a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:02:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2086962745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=792eac51-2567-477a-bdd3-207336ac785b,host='devstack@QuobyteHD#QuobyteHD',id=0f71b6b8-f214-401e-aeaf-c89888304fe0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2315fd18112143918e744537f0d56627',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:02:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:02:27Z,use_quota=True,user_id='347b02cd7131447096c7aa7ee009c295',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f1a69757-d3b6-455b-a1ed-cca5c4f66c16),volume_type_id=f1a69757-d3b6-455b-a1ed-cca5c4f66c16)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:02:26 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-1d140575-7b07-4ed6-b0d3-67112f8dc043 tempest-GroupSnapshotsV319Test-1284869072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72bce3e7-8500-4841-9859-c8aa9eb697c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:02:26 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-1d140575-7b07-4ed6-b0d3-67112f8dc043 tempest-GroupSnapshotsV319Test-1284869072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72bce3e7-8500-4841-9859-c8aa9eb697c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:02:27 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-1d140575-7b07-4ed6-b0d3-67112f8dc043 tempest-GroupSnapshotsV319Test-1284869072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0213a86-6e8b-4acd-880b-3777c025d6ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:02:27 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-1d140575-7b07-4ed6-b0d3-67112f8dc043 tempest-GroupSnapshotsV319Test-1284869072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0213a86-6e8b-4acd-880b-3777c025d6ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f71b6b8-f214-401e-aeaf-c89888304fe0', 'volume_name': 'volume-0f71b6b8-f214-401e-aeaf-c89888304fe0', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:02:27 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-1d140575-7b07-4ed6-b0d3-67112f8dc043 tempest-GroupSnapshotsV319Test-1284869072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a389997-9c30-4ff3-94c9-96f4d19ee951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:02:27 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-1d140575-7b07-4ed6-b0d3-67112f8dc043 tempest-GroupSnapshotsV319Test-1284869072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a389997-9c30-4ff3-94c9-96f4d19ee951) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:02:27 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-1d140575-7b07-4ed6-b0d3-67112f8dc043 tempest-GroupSnapshotsV319Test-1284869072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02db7d46-8c74-474c-9123-05a8c6f6700d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:02:27 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-1d140575-7b07-4ed6-b0d3-67112f8dc043 tempest-GroupSnapshotsV319Test-1284869072 None] Volume 0f71b6b8-f214-401e-aeaf-c89888304fe0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f71b6b8-f214-401e-aeaf-c89888304fe0', 'volume_size': 1} Nov 02 10:02:27 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-1d140575-7b07-4ed6-b0d3-67112f8dc043 tempest-GroupSnapshotsV319Test-1284869072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:02:27 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-1d140575-7b07-4ed6-b0d3-67112f8dc043 tempest-GroupSnapshotsV319Test-1284869072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:02:27 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-1d140575-7b07-4ed6-b0d3-67112f8dc043 tempest-GroupSnapshotsV319Test-1284869072 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=792eac51-2567-477a-bdd3-207336ac785b,created_at=2026-11-02T09:02:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2086962745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=792eac51-2567-477a-bdd3-207336ac785b,host='devstack@QuobyteHD#QuobyteHD',id=0f71b6b8-f214-401e-aeaf-c89888304fe0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2315fd18112143918e744537f0d56627',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:02:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:02:27Z,use_quota=True,user_id='347b02cd7131447096c7aa7ee009c295',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f1a69757-d3b6-455b-a1ed-cca5c4f66c16),volume_type_id=f1a69757-d3b6-455b-a1ed-cca5c4f66c16)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:02:27 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-1d140575-7b07-4ed6-b0d3-67112f8dc043 tempest-GroupSnapshotsV319Test-1284869072 None] Creating volume 0f71b6b8-f214-401e-aeaf-c89888304fe0 {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:02:27 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-1d140575-7b07-4ed6-b0d3-67112f8dc043 tempest-GroupSnapshotsV319Test-1284869072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:02:27 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-1d140575-7b07-4ed6-b0d3-67112f8dc043 tempest-GroupSnapshotsV319Test-1284869072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:02:27 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-1d140575-7b07-4ed6-b0d3-67112f8dc043 tempest-GroupSnapshotsV319Test-1284869072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:02:27 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-1d140575-7b07-4ed6-b0d3-67112f8dc043 tempest-GroupSnapshotsV319Test-1284869072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:02:27 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-1d140575-7b07-4ed6-b0d3-67112f8dc043 tempest-GroupSnapshotsV319Test-1284869072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:02:27 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-1d140575-7b07-4ed6-b0d3-67112f8dc043 tempest-GroupSnapshotsV319Test-1284869072 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:02:27 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-1d140575-7b07-4ed6-b0d3-67112f8dc043 tempest-GroupSnapshotsV319Test-1284869072 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:02:27 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-1d140575-7b07-4ed6-b0d3-67112f8dc043 tempest-GroupSnapshotsV319Test-1284869072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-0f71b6b8-f214-401e-aeaf-c89888304fe0 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:02:27 devstack sudo[87982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-0f71b6b8-f214-401e-aeaf-c89888304fe0 1073741824 Nov 02 10:02:27 devstack sudo[87982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:02:28 devstack sudo[87982]: pam_unix(sudo:session): session closed for user root Nov 02 10:02:28 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-1d140575-7b07-4ed6-b0d3-67112f8dc043 tempest-GroupSnapshotsV319Test-1284869072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-0f71b6b8-f214-401e-aeaf-c89888304fe0 1073741824" returned: 0 in 1.375s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:02:28 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-1d140575-7b07-4ed6-b0d3-67112f8dc043 tempest-GroupSnapshotsV319Test-1284869072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-0f71b6b8-f214-401e-aeaf-c89888304fe0 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:02:28 devstack sudo[87989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-0f71b6b8-f214-401e-aeaf-c89888304fe0 Nov 02 10:02:28 devstack sudo[87989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:02:29 devstack sudo[87989]: pam_unix(sudo:session): session closed for user root Nov 02 10:02:29 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-1d140575-7b07-4ed6-b0d3-67112f8dc043 tempest-GroupSnapshotsV319Test-1284869072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-0f71b6b8-f214-401e-aeaf-c89888304fe0" returned: 0 in 0.517s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:02:29 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-1d140575-7b07-4ed6-b0d3-67112f8dc043 tempest-GroupSnapshotsV319Test-1284869072 None] <== create_volume: return (1992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:02:29 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-1d140575-7b07-4ed6-b0d3-67112f8dc043 tempest-GroupSnapshotsV319Test-1284869072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.003s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:02:29 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-1d140575-7b07-4ed6-b0d3-67112f8dc043 tempest-GroupSnapshotsV319Test-1284869072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02db7d46-8c74-474c-9123-05a8c6f6700d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f71b6b8-f214-401e-aeaf-c89888304fe0', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:02:29 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-1d140575-7b07-4ed6-b0d3-67112f8dc043 tempest-GroupSnapshotsV319Test-1284869072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14569f76-14c3-4294-82dd-aeb78dceca54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:02:29 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-1d140575-7b07-4ed6-b0d3-67112f8dc043 tempest-GroupSnapshotsV319Test-1284869072 None] Volume volume-0f71b6b8-f214-401e-aeaf-c89888304fe0 (0f71b6b8-f214-401e-aeaf-c89888304fe0): created successfully Nov 02 10:02:29 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-1d140575-7b07-4ed6-b0d3-67112f8dc043 tempest-GroupSnapshotsV319Test-1284869072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14569f76-14c3-4294-82dd-aeb78dceca54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:02:29 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-1d140575-7b07-4ed6-b0d3-67112f8dc043 tempest-GroupSnapshotsV319Test-1284869072 None] Flow 'volume_create_manager' (bd0891ee-2563-47fe-b2b0-c514dca08266) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:02:29 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-1d140575-7b07-4ed6-b0d3-67112f8dc043 tempest-GroupSnapshotsV319Test-1284869072 None] Created volume successfully. Nov 02 10:02:31 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-da832427-de4e-43c5-af89-a437bf496202 tempest-GroupSnapshotsV319Test-1284869072 None] GroupSnapshot d23f4e1b-c8d4-4445-9d55-3e0c264adabc: creating. Nov 02 10:02:31 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-da832427-de4e-43c5-af89-a437bf496202 tempest-GroupSnapshotsV319Test-1284869072 None] Group snapshot d23f4e1b-c8d4-4445-9d55-3e0c264adabc: creating. {{(pid=86890) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 02 10:02:31 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-da832427-de4e-43c5-af89-a437bf496202 tempest-GroupSnapshotsV319Test-1284869072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:02:31 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-da832427-de4e-43c5-af89-a437bf496202 tempest-GroupSnapshotsV319Test-1284869072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.006s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:02:31 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-da832427-de4e-43c5-af89-a437bf496202 tempest-GroupSnapshotsV319Test-1284869072 None] Creating offline snapshot 196fdfd5-9440-4f17-a9cf-dc0af7f949e3 of volume 0f71b6b8-f214-401e-aeaf-c89888304fe0 {{(pid=86890) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:02:31 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-de9329d0-2114-4f5e-961d-a7405e5798ae tempest-VolumesAdminNegativeTest-1685022847 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:02:31 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-de9329d0-2114-4f5e-961d-a7405e5798ae tempest-VolumesAdminNegativeTest-1685022847 None] Flow 'volume_create_manager' (7e182810-e8df-4fd4-a3ea-44c2df2efb8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:02:31 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-de9329d0-2114-4f5e-961d-a7405e5798ae tempest-VolumesAdminNegativeTest-1685022847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbf460b9-e855-4a73-b15e-6fdddf7740d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:02:31 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e5127d1-592c-423c-8f78-10de36ca8fc2]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:02:31 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-da832427-de4e-43c5-af89-a437bf496202 tempest-GroupSnapshotsV319Test-1284869072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-0f71b6b8-f214-401e-aeaf-c89888304fe0 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:02:31 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-de9329d0-2114-4f5e-961d-a7405e5798ae tempest-VolumesAdminNegativeTest-1685022847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbf460b9-e855-4a73-b15e-6fdddf7740d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:02:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1146431944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a776510-4411-4af9-a940-e8b912facc3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64296c18591c47fc9c2bcde04e5141b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:02:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:02:31Z,use_quota=True,user_id='97c35f08f2fb47e1bad5c3453d8b990b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:02:31 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-de9329d0-2114-4f5e-961d-a7405e5798ae tempest-VolumesAdminNegativeTest-1685022847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39639aad-aaa3-4961-a85b-a47610a6a47f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:02:31 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-de9329d0-2114-4f5e-961d-a7405e5798ae tempest-VolumesAdminNegativeTest-1685022847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39639aad-aaa3-4961-a85b-a47610a6a47f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:02:31 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-de9329d0-2114-4f5e-961d-a7405e5798ae tempest-VolumesAdminNegativeTest-1685022847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7b9decd-b78c-49de-bffb-c0c321c99abb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:02:31 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-de9329d0-2114-4f5e-961d-a7405e5798ae tempest-VolumesAdminNegativeTest-1685022847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7b9decd-b78c-49de-bffb-c0c321c99abb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a776510-4411-4af9-a940-e8b912facc3d', 'volume_name': 'volume-3a776510-4411-4af9-a940-e8b912facc3d', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:02:31 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-de9329d0-2114-4f5e-961d-a7405e5798ae tempest-VolumesAdminNegativeTest-1685022847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22872d00-5614-4c04-82b8-8697d10317ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:02:31 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-de9329d0-2114-4f5e-961d-a7405e5798ae tempest-VolumesAdminNegativeTest-1685022847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22872d00-5614-4c04-82b8-8697d10317ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:02:31 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-de9329d0-2114-4f5e-961d-a7405e5798ae tempest-VolumesAdminNegativeTest-1685022847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe8f2a6c-deff-4975-9830-1237b52ced83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:02:31 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-de9329d0-2114-4f5e-961d-a7405e5798ae tempest-VolumesAdminNegativeTest-1685022847 None] Volume 3a776510-4411-4af9-a940-e8b912facc3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a776510-4411-4af9-a940-e8b912facc3d', 'volume_size': 1} Nov 02 10:02:31 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-de9329d0-2114-4f5e-961d-a7405e5798ae tempest-VolumesAdminNegativeTest-1685022847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:02:31 devstack sudo[87994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-0f71b6b8-f214-401e-aeaf-c89888304fe0 Nov 02 10:02:31 devstack sudo[87994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:02:32 devstack sudo[87994]: pam_unix(sudo:session): session closed for user root Nov 02 10:02:32 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-da832427-de4e-43c5-af89-a437bf496202 tempest-GroupSnapshotsV319Test-1284869072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-0f71b6b8-f214-401e-aeaf-c89888304fe0" returned: 0 in 1.232s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:02:32 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-da832427-de4e-43c5-af89-a437bf496202 tempest-GroupSnapshotsV319Test-1284869072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-0f71b6b8-f214-401e-aeaf-c89888304fe0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-0f71b6b8-f214-401e-aeaf-c89888304fe0.196fdfd5-9440-4f17-a9cf-dc0af7f949e3 1G {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:02:32 devstack sudo[87999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-0f71b6b8-f214-401e-aeaf-c89888304fe0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-0f71b6b8-f214-401e-aeaf-c89888304fe0.196fdfd5-9440-4f17-a9cf-dc0af7f949e3 1G Nov 02 10:02:32 devstack sudo[87999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:02:33 devstack sudo[87999]: pam_unix(sudo:session): session closed for user root Nov 02 10:02:33 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-da832427-de4e-43c5-af89-a437bf496202 tempest-GroupSnapshotsV319Test-1284869072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-0f71b6b8-f214-401e-aeaf-c89888304fe0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-0f71b6b8-f214-401e-aeaf-c89888304fe0.196fdfd5-9440-4f17-a9cf-dc0af7f949e3 1G" returned: 0 in 1.067s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:02:33 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-da832427-de4e-43c5-af89-a437bf496202 tempest-GroupSnapshotsV319Test-1284869072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f71b6b8-f214-401e-aeaf-c89888304fe0 -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-0f71b6b8-f214-401e-aeaf-c89888304fe0.196fdfd5-9440-4f17-a9cf-dc0af7f949e3 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:02:33 devstack sudo[88007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f71b6b8-f214-401e-aeaf-c89888304fe0 -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-0f71b6b8-f214-401e-aeaf-c89888304fe0.196fdfd5-9440-4f17-a9cf-dc0af7f949e3 Nov 02 10:02:33 devstack sudo[88007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:02:34 devstack sudo[88007]: pam_unix(sudo:session): session closed for user root Nov 02 10:02:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-da832427-de4e-43c5-af89-a437bf496202 tempest-GroupSnapshotsV319Test-1284869072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f71b6b8-f214-401e-aeaf-c89888304fe0 -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-0f71b6b8-f214-401e-aeaf-c89888304fe0.196fdfd5-9440-4f17-a9cf-dc0af7f949e3" returned: 0 in 0.683s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:02:34 devstack cinder-volume[86890]: WARNING cinder.volume.drivers.remotefs [None req-da832427-de4e-43c5-af89-a437bf496202 tempest-GroupSnapshotsV319Test-1284869072 None] /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-0f71b6b8-f214-401e-aeaf-c89888304fe0.196fdfd5-9440-4f17-a9cf-dc0af7f949e3 is being set with open permissions: ugo+rw: NotImplementedError Nov 02 10:02:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-da832427-de4e-43c5-af89-a437bf496202 tempest-GroupSnapshotsV319Test-1284869072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-0f71b6b8-f214-401e-aeaf-c89888304fe0.196fdfd5-9440-4f17-a9cf-dc0af7f949e3 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:02:34 devstack sudo[88034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-0f71b6b8-f214-401e-aeaf-c89888304fe0.196fdfd5-9440-4f17-a9cf-dc0af7f949e3 Nov 02 10:02:34 devstack sudo[88034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:02:34 devstack cinder-volume[86890]: DEBUG oslo_service.periodic_task [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86890) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:02:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:02:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:02:34 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:02:34 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:02:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:02:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:02:34 devstack sudo[88043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:02:34 devstack sudo[88043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:02:35 devstack sudo[88034]: pam_unix(sudo:session): session closed for user root Nov 02 10:02:35 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-da832427-de4e-43c5-af89-a437bf496202 tempest-GroupSnapshotsV319Test-1284869072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-0f71b6b8-f214-401e-aeaf-c89888304fe0.196fdfd5-9440-4f17-a9cf-dc0af7f949e3" returned: 0 in 0.615s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:02:35 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-da832427-de4e-43c5-af89-a437bf496202 tempest-GroupSnapshotsV319Test-1284869072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-0f71b6b8-f214-401e-aeaf-c89888304fe0.info {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:02:35 devstack sudo[88051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-0f71b6b8-f214-401e-aeaf-c89888304fe0.info Nov 02 10:02:35 devstack sudo[88051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:02:35 devstack sudo[88043]: pam_unix(sudo:session): session closed for user root Nov 02 10:02:35 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.881s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:02:35 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:02:35 devstack cinder-volume[86890]: DEBUG oslo_service.periodic_task [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Running periodic task VolumeManager._thread_info {{(pid=86890) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:02:35 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] thread count: 8 {{(pid=86890) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:02:35 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] thread info: [<_MainThread(MainThread, started 133913319395456)>, , , , , , , ] {{(pid=86890) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:02:36 devstack sudo[88051]: pam_unix(sudo:session): session closed for user root Nov 02 10:02:36 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-da832427-de4e-43c5-af89-a437bf496202 tempest-GroupSnapshotsV319Test-1284869072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-0f71b6b8-f214-401e-aeaf-c89888304fe0.info" returned: 0 in 0.984s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:02:36 devstack cinder-volume[86890]: WARNING cinder.volume.drivers.remotefs [None req-da832427-de4e-43c5-af89-a437bf496202 tempest-GroupSnapshotsV319Test-1284869072 None] /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-0f71b6b8-f214-401e-aeaf-c89888304fe0.info is being set with open permissions: ugo+rw: NotImplementedError Nov 02 10:02:36 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-da832427-de4e-43c5-af89-a437bf496202 tempest-GroupSnapshotsV319Test-1284869072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-0f71b6b8-f214-401e-aeaf-c89888304fe0.info {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:02:36 devstack sudo[88068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-0f71b6b8-f214-401e-aeaf-c89888304fe0.info Nov 02 10:02:36 devstack sudo[88068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:02:36 devstack sudo[88068]: pam_unix(sudo:session): session closed for user root Nov 02 10:02:36 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-da832427-de4e-43c5-af89-a437bf496202 tempest-GroupSnapshotsV319Test-1284869072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-0f71b6b8-f214-401e-aeaf-c89888304fe0.info" returned: 0 in 0.447s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:02:36 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-da832427-de4e-43c5-af89-a437bf496202 tempest-GroupSnapshotsV319Test-1284869072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.367s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:02:36 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-de9329d0-2114-4f5e-961d-a7405e5798ae tempest-VolumesAdminNegativeTest-1685022847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.018s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:02:36 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-de9329d0-2114-4f5e-961d-a7405e5798ae tempest-VolumesAdminNegativeTest-1685022847 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:02:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1146431944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a776510-4411-4af9-a940-e8b912facc3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64296c18591c47fc9c2bcde04e5141b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:02:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:02:31Z,use_quota=True,user_id='97c35f08f2fb47e1bad5c3453d8b990b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:02:36 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-de9329d0-2114-4f5e-961d-a7405e5798ae tempest-VolumesAdminNegativeTest-1685022847 None] Creating volume 3a776510-4411-4af9-a940-e8b912facc3d {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:02:36 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-de9329d0-2114-4f5e-961d-a7405e5798ae tempest-VolumesAdminNegativeTest-1685022847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:02:36 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-de9329d0-2114-4f5e-961d-a7405e5798ae tempest-VolumesAdminNegativeTest-1685022847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:02:36 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-de9329d0-2114-4f5e-961d-a7405e5798ae tempest-VolumesAdminNegativeTest-1685022847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:02:36 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-de9329d0-2114-4f5e-961d-a7405e5798ae tempest-VolumesAdminNegativeTest-1685022847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:02:36 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-de9329d0-2114-4f5e-961d-a7405e5798ae tempest-VolumesAdminNegativeTest-1685022847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:02:36 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-de9329d0-2114-4f5e-961d-a7405e5798ae tempest-VolumesAdminNegativeTest-1685022847 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:02:36 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-de9329d0-2114-4f5e-961d-a7405e5798ae tempest-VolumesAdminNegativeTest-1685022847 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:02:36 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-de9329d0-2114-4f5e-961d-a7405e5798ae tempest-VolumesAdminNegativeTest-1685022847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3a776510-4411-4af9-a940-e8b912facc3d 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:02:36 devstack sudo[88081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3a776510-4411-4af9-a940-e8b912facc3d 1073741824 Nov 02 10:02:36 devstack sudo[88081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:02:36 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-da832427-de4e-43c5-af89-a437bf496202 tempest-GroupSnapshotsV319Test-1284869072 None] group_snapshot d23f4e1b-c8d4-4445-9d55-3e0c264adabc: created successfully Nov 02 10:02:37 devstack sudo[88081]: pam_unix(sudo:session): session closed for user root Nov 02 10:02:37 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-de9329d0-2114-4f5e-961d-a7405e5798ae tempest-VolumesAdminNegativeTest-1685022847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3a776510-4411-4af9-a940-e8b912facc3d 1073741824" returned: 0 in 1.042s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:02:37 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-de9329d0-2114-4f5e-961d-a7405e5798ae tempest-VolumesAdminNegativeTest-1685022847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3a776510-4411-4af9-a940-e8b912facc3d {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:02:37 devstack sudo[88106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3a776510-4411-4af9-a940-e8b912facc3d Nov 02 10:02:37 devstack sudo[88106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:02:38 devstack sudo[88106]: pam_unix(sudo:session): session closed for user root Nov 02 10:02:38 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-de9329d0-2114-4f5e-961d-a7405e5798ae tempest-VolumesAdminNegativeTest-1685022847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3a776510-4411-4af9-a940-e8b912facc3d" returned: 0 in 0.403s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:02:38 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-de9329d0-2114-4f5e-961d-a7405e5798ae tempest-VolumesAdminNegativeTest-1685022847 None] <== create_volume: return (1555ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:02:38 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-de9329d0-2114-4f5e-961d-a7405e5798ae tempest-VolumesAdminNegativeTest-1685022847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.561s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:02:38 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-de9329d0-2114-4f5e-961d-a7405e5798ae tempest-VolumesAdminNegativeTest-1685022847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe8f2a6c-deff-4975-9830-1237b52ced83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a776510-4411-4af9-a940-e8b912facc3d', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:02:38 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-de9329d0-2114-4f5e-961d-a7405e5798ae tempest-VolumesAdminNegativeTest-1685022847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d368779f-c01e-405a-942a-71839d5d3a31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:02:38 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-de9329d0-2114-4f5e-961d-a7405e5798ae tempest-VolumesAdminNegativeTest-1685022847 None] Volume volume-3a776510-4411-4af9-a940-e8b912facc3d (3a776510-4411-4af9-a940-e8b912facc3d): created successfully Nov 02 10:02:38 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-de9329d0-2114-4f5e-961d-a7405e5798ae tempest-VolumesAdminNegativeTest-1685022847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d368779f-c01e-405a-942a-71839d5d3a31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:02:38 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-de9329d0-2114-4f5e-961d-a7405e5798ae tempest-VolumesAdminNegativeTest-1685022847 None] Flow 'volume_create_manager' (7e182810-e8df-4fd4-a3ea-44c2df2efb8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:02:38 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-de9329d0-2114-4f5e-961d-a7405e5798ae tempest-VolumesAdminNegativeTest-1685022847 None] Created volume successfully. Nov 02 10:02:38 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-8f68b404-7dca-4507-a0ef-c256020b97b0 tempest-GroupSnapshotsV319Test-1284869072 None] group_snapshot d23f4e1b-c8d4-4445-9d55-3e0c264adabc: deleting Nov 02 10:02:38 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-8f68b404-7dca-4507-a0ef-c256020b97b0 tempest-GroupSnapshotsV319Test-1284869072 None] group_snapshot d23f4e1b-c8d4-4445-9d55-3e0c264adabc: deleting {{(pid=86890) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 02 10:02:38 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-8f68b404-7dca-4507-a0ef-c256020b97b0 tempest-GroupSnapshotsV319Test-1284869072 None] Acquiring lock "cinder-quobyte-0f71b6b8-f214-401e-aeaf-c89888304fe0" by "delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:02:38 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-8f68b404-7dca-4507-a0ef-c256020b97b0 tempest-GroupSnapshotsV319Test-1284869072 None] Lock "cinder-quobyte-0f71b6b8-f214-401e-aeaf-c89888304fe0" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:02:38 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-8f68b404-7dca-4507-a0ef-c256020b97b0 tempest-GroupSnapshotsV319Test-1284869072 None] Acquiring lock "cinder-quobyte-196fdfd5-9440-4f17-a9cf-dc0af7f949e3" by "_delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:02:38 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-8f68b404-7dca-4507-a0ef-c256020b97b0 tempest-GroupSnapshotsV319Test-1284869072 None] Lock "cinder-quobyte-196fdfd5-9440-4f17-a9cf-dc0af7f949e3" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:02:38 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-8f68b404-7dca-4507-a0ef-c256020b97b0 tempest-GroupSnapshotsV319Test-1284869072 None] Deleting offline snapshot 196fdfd5-9440-4f17-a9cf-dc0af7f949e3 of volume 0f71b6b8-f214-401e-aeaf-c89888304fe0 {{(pid=86890) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:02:39 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-8f68b404-7dca-4507-a0ef-c256020b97b0 tempest-GroupSnapshotsV319Test-1284869072 None] snapshot_file for this snap is: volume-0f71b6b8-f214-401e-aeaf-c89888304fe0.196fdfd5-9440-4f17-a9cf-dc0af7f949e3 {{(pid=86890) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:02:39 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b110cb5-3602-4b45-87a3-e32a90a4ee68]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:02:39 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8f68b404-7dca-4507-a0ef-c256020b97b0 tempest-GroupSnapshotsV319Test-1284869072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-0f71b6b8-f214-401e-aeaf-c89888304fe0.196fdfd5-9440-4f17-a9cf-dc0af7f949e3 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:02:39 devstack sudo[88111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-0f71b6b8-f214-401e-aeaf-c89888304fe0.196fdfd5-9440-4f17-a9cf-dc0af7f949e3 Nov 02 10:02:39 devstack sudo[88111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:02:39 devstack sudo[88111]: pam_unix(sudo:session): session closed for user root Nov 02 10:02:39 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8f68b404-7dca-4507-a0ef-c256020b97b0 tempest-GroupSnapshotsV319Test-1284869072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-0f71b6b8-f214-401e-aeaf-c89888304fe0.196fdfd5-9440-4f17-a9cf-dc0af7f949e3" returned: 0 in 0.749s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:02:39 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-8f68b404-7dca-4507-a0ef-c256020b97b0 tempest-GroupSnapshotsV319Test-1284869072 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f71b6b8-f214-401e-aeaf-c89888304fe0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86890) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:02:39 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[11d93e9d-4244-4f43-8a6a-e97eb7447230]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:02:39 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8f68b404-7dca-4507-a0ef-c256020b97b0 tempest-GroupSnapshotsV319Test-1284869072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-0f71b6b8-f214-401e-aeaf-c89888304fe0 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:02:40 devstack sudo[88117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-0f71b6b8-f214-401e-aeaf-c89888304fe0 Nov 02 10:02:40 devstack sudo[88117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:02:40 devstack sudo[88117]: pam_unix(sudo:session): session closed for user root Nov 02 10:02:40 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8f68b404-7dca-4507-a0ef-c256020b97b0 tempest-GroupSnapshotsV319Test-1284869072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-0f71b6b8-f214-401e-aeaf-c89888304fe0" returned: 0 in 0.801s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:02:40 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8f68b404-7dca-4507-a0ef-c256020b97b0 tempest-GroupSnapshotsV319Test-1284869072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-0f71b6b8-f214-401e-aeaf-c89888304fe0.196fdfd5-9440-4f17-a9cf-dc0af7f949e3 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:02:40 devstack sudo[88122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-0f71b6b8-f214-401e-aeaf-c89888304fe0.196fdfd5-9440-4f17-a9cf-dc0af7f949e3 Nov 02 10:02:40 devstack sudo[88122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:02:40 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-5704e65b-2bb8-4d95-b887-fe14ae525521 tempest-VolumesAdminNegativeTest-1685022847 None] Acquiring lock "cinder-3a776510-4411-4af9-a940-e8b912facc3d-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:02:40 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-5704e65b-2bb8-4d95-b887-fe14ae525521 tempest-VolumesAdminNegativeTest-1685022847 None] Lock "cinder-3a776510-4411-4af9-a940-e8b912facc3d-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:02:41 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-5704e65b-2bb8-4d95-b887-fe14ae525521 tempest-VolumesAdminNegativeTest-1685022847 None] Acquiring lock "cinder-quobyte-3a776510-4411-4af9-a940-e8b912facc3d" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:02:41 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-5704e65b-2bb8-4d95-b887-fe14ae525521 tempest-VolumesAdminNegativeTest-1685022847 None] Lock "cinder-quobyte-3a776510-4411-4af9-a940-e8b912facc3d" acquired by "delete_volume" :: waited 0.035s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:02:41 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e20da53-0f9b-4f2f-aa95-5a5480f033bf]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:02:41 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-5704e65b-2bb8-4d95-b887-fe14ae525521 tempest-VolumesAdminNegativeTest-1685022847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3a776510-4411-4af9-a940-e8b912facc3d {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:02:41 devstack sudo[88125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3a776510-4411-4af9-a940-e8b912facc3d Nov 02 10:02:41 devstack sudo[88125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:02:41 devstack sudo[88122]: pam_unix(sudo:session): session closed for user root Nov 02 10:02:41 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8f68b404-7dca-4507-a0ef-c256020b97b0 tempest-GroupSnapshotsV319Test-1284869072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-0f71b6b8-f214-401e-aeaf-c89888304fe0.196fdfd5-9440-4f17-a9cf-dc0af7f949e3" returned: 0 in 0.804s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:02:41 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8f68b404-7dca-4507-a0ef-c256020b97b0 tempest-GroupSnapshotsV319Test-1284869072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-0f71b6b8-f214-401e-aeaf-c89888304fe0.196fdfd5-9440-4f17-a9cf-dc0af7f949e3 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:02:41 devstack sudo[88130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-0f71b6b8-f214-401e-aeaf-c89888304fe0.196fdfd5-9440-4f17-a9cf-dc0af7f949e3 Nov 02 10:02:41 devstack sudo[88130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:02:41 devstack sudo[88130]: pam_unix(sudo:session): session closed for user root Nov 02 10:02:41 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8f68b404-7dca-4507-a0ef-c256020b97b0 tempest-GroupSnapshotsV319Test-1284869072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-0f71b6b8-f214-401e-aeaf-c89888304fe0.196fdfd5-9440-4f17-a9cf-dc0af7f949e3" returned: 0 in 0.552s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:02:42 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-8f68b404-7dca-4507-a0ef-c256020b97b0 tempest-GroupSnapshotsV319Test-1284869072 None] Lock "cinder-quobyte-196fdfd5-9440-4f17-a9cf-dc0af7f949e3" released by "_delete_snapshot" :: held 3.065s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:02:42 devstack sudo[88125]: pam_unix(sudo:session): session closed for user root Nov 02 10:02:42 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-5704e65b-2bb8-4d95-b887-fe14ae525521 tempest-VolumesAdminNegativeTest-1685022847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3a776510-4411-4af9-a940-e8b912facc3d" returned: 0 in 0.926s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:02:42 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-5704e65b-2bb8-4d95-b887-fe14ae525521 tempest-VolumesAdminNegativeTest-1685022847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3a776510-4411-4af9-a940-e8b912facc3d {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:02:42 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-8f68b404-7dca-4507-a0ef-c256020b97b0 tempest-GroupSnapshotsV319Test-1284869072 None] Lock "cinder-quobyte-0f71b6b8-f214-401e-aeaf-c89888304fe0" released by "delete_snapshot" :: held 3.126s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:02:42 devstack sudo[88156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3a776510-4411-4af9-a940-e8b912facc3d Nov 02 10:02:42 devstack sudo[88156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:02:42 devstack cinder-volume[86890]: WARNING cinder.quota [None req-8f68b404-7dca-4507-a0ef-c256020b97b0 tempest-GroupSnapshotsV319Test-1284869072 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-105179983 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-105179983, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:02:42 devstack cinder-volume[86890]: WARNING cinder.quota [None req-8f68b404-7dca-4507-a0ef-c256020b97b0 tempest-GroupSnapshotsV319Test-1284869072 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-105179983 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-105179983, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:02:42 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-8f68b404-7dca-4507-a0ef-c256020b97b0 tempest-GroupSnapshotsV319Test-1284869072 None] Created reservations ['374aeb64-443a-47b2-8bdd-022145c3afe7', '80d28251-d1fd-473c-93fe-49ecc158a38e', 'bad94840-efa6-4485-976f-31b749db7712', '6ded1848-4825-44b9-8b5f-dd92c34cf881'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:02:42 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-8f68b404-7dca-4507-a0ef-c256020b97b0 tempest-GroupSnapshotsV319Test-1284869072 None] group_snapshot d23f4e1b-c8d4-4445-9d55-3e0c264adabc: deleted successfully Nov 02 10:02:42 devstack sudo[88156]: pam_unix(sudo:session): session closed for user root Nov 02 10:02:42 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-5704e65b-2bb8-4d95-b887-fe14ae525521 tempest-VolumesAdminNegativeTest-1685022847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3a776510-4411-4af9-a940-e8b912facc3d" returned: 0 in 0.559s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:02:42 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-5704e65b-2bb8-4d95-b887-fe14ae525521 tempest-VolumesAdminNegativeTest-1685022847 None] Lock "cinder-quobyte-3a776510-4411-4af9-a940-e8b912facc3d" released by "delete_volume" :: held 1.566s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:02:42 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-5704e65b-2bb8-4d95-b887-fe14ae525521 tempest-VolumesAdminNegativeTest-1685022847 None] Created reservations ['b3875d0b-99bd-4237-97b5-b67f27c9faa2', 'da65447f-640c-4c3f-afb0-bdbc5fceaaa9', '2b2d3a3b-21c0-4fa2-b5a3-2b8b91700c5c', '17f9e61c-a2a1-4914-aeda-779d2b9130d3'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:02:42 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-5704e65b-2bb8-4d95-b887-fe14ae525521 tempest-VolumesAdminNegativeTest-1685022847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:02:42 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-5704e65b-2bb8-4d95-b887-fe14ae525521 tempest-VolumesAdminNegativeTest-1685022847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:02:42 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-5704e65b-2bb8-4d95-b887-fe14ae525521 tempest-VolumesAdminNegativeTest-1685022847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:02:42 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-5704e65b-2bb8-4d95-b887-fe14ae525521 tempest-VolumesAdminNegativeTest-1685022847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:02:42 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-5704e65b-2bb8-4d95-b887-fe14ae525521 tempest-VolumesAdminNegativeTest-1685022847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:02:42 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-5704e65b-2bb8-4d95-b887-fe14ae525521 tempest-VolumesAdminNegativeTest-1685022847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:02:43 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-6d700ee9-d58f-434f-b9d3-3212e16173e4 tempest-GroupSnapshotsV319Test-1284869072 None] Acquiring lock "cinder-quobyte-0f71b6b8-f214-401e-aeaf-c89888304fe0" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:02:43 devstack sudo[88165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:02:43 devstack sudo[88165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:02:43 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-6d700ee9-d58f-434f-b9d3-3212e16173e4 tempest-GroupSnapshotsV319Test-1284869072 None] Lock "cinder-quobyte-0f71b6b8-f214-401e-aeaf-c89888304fe0" acquired by "delete_volume" :: waited 0.027s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:02:43 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[2552724b-7525-4429-b47b-c9ec888913c2]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:02:43 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6d700ee9-d58f-434f-b9d3-3212e16173e4 tempest-GroupSnapshotsV319Test-1284869072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-0f71b6b8-f214-401e-aeaf-c89888304fe0 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:02:43 devstack sudo[88167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-0f71b6b8-f214-401e-aeaf-c89888304fe0 Nov 02 10:02:43 devstack sudo[88167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:02:43 devstack sudo[88165]: pam_unix(sudo:session): session closed for user root Nov 02 10:02:43 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-5704e65b-2bb8-4d95-b887-fe14ae525521 tempest-VolumesAdminNegativeTest-1685022847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.385s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:02:43 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-5704e65b-2bb8-4d95-b887-fe14ae525521 tempest-VolumesAdminNegativeTest-1685022847 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:02:43 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-5704e65b-2bb8-4d95-b887-fe14ae525521 tempest-VolumesAdminNegativeTest-1685022847 None] Deleted volume successfully. Nov 02 10:02:43 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-5704e65b-2bb8-4d95-b887-fe14ae525521 tempest-VolumesAdminNegativeTest-1685022847 None] Lock "cinder-3a776510-4411-4af9-a940-e8b912facc3d-delete_volume" released by "delete_volume" :: held 2.509s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:02:43 devstack sudo[88167]: pam_unix(sudo:session): session closed for user root Nov 02 10:02:43 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6d700ee9-d58f-434f-b9d3-3212e16173e4 tempest-GroupSnapshotsV319Test-1284869072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-0f71b6b8-f214-401e-aeaf-c89888304fe0" returned: 0 in 0.580s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:02:43 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6d700ee9-d58f-434f-b9d3-3212e16173e4 tempest-GroupSnapshotsV319Test-1284869072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-0f71b6b8-f214-401e-aeaf-c89888304fe0 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:02:43 devstack sudo[88175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-0f71b6b8-f214-401e-aeaf-c89888304fe0 Nov 02 10:02:43 devstack sudo[88175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:02:44 devstack sudo[88175]: pam_unix(sudo:session): session closed for user root Nov 02 10:02:44 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6d700ee9-d58f-434f-b9d3-3212e16173e4 tempest-GroupSnapshotsV319Test-1284869072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-0f71b6b8-f214-401e-aeaf-c89888304fe0" returned: 0 in 0.539s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:02:44 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-6d700ee9-d58f-434f-b9d3-3212e16173e4 tempest-GroupSnapshotsV319Test-1284869072 None] Lock "cinder-quobyte-0f71b6b8-f214-401e-aeaf-c89888304fe0" released by "delete_volume" :: held 1.256s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:02:44 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-6d700ee9-d58f-434f-b9d3-3212e16173e4 tempest-GroupSnapshotsV319Test-1284869072 None] Created reservations ['c9bb47f7-5e33-43a0-a730-5e6cd8ebee1e'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:02:44 devstack cinder-volume[86890]: WARNING cinder.quota [None req-6d700ee9-d58f-434f-b9d3-3212e16173e4 tempest-GroupSnapshotsV319Test-1284869072 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-105179983 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-105179983, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:02:44 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-6d700ee9-d58f-434f-b9d3-3212e16173e4 tempest-GroupSnapshotsV319Test-1284869072 None] Created reservations ['bbb51e11-3e6c-40ec-a8fb-4f73c0711930', 'd88c8041-d4c4-4ddd-a043-8c7a2092f621', 'fb41f1c2-6b0f-42db-9bb5-9437c54aebc5', 'b9cfced3-c9f4-42fe-8ab8-437bc04d8f67'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:02:44 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-6d700ee9-d58f-434f-b9d3-3212e16173e4 tempest-GroupSnapshotsV319Test-1284869072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:02:44 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-6d700ee9-d58f-434f-b9d3-3212e16173e4 tempest-GroupSnapshotsV319Test-1284869072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:02:44 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-6d700ee9-d58f-434f-b9d3-3212e16173e4 tempest-GroupSnapshotsV319Test-1284869072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:02:44 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-6d700ee9-d58f-434f-b9d3-3212e16173e4 tempest-GroupSnapshotsV319Test-1284869072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:02:44 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-6d700ee9-d58f-434f-b9d3-3212e16173e4 tempest-GroupSnapshotsV319Test-1284869072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:02:44 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6d700ee9-d58f-434f-b9d3-3212e16173e4 tempest-GroupSnapshotsV319Test-1284869072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:02:44 devstack sudo[88229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:02:44 devstack sudo[88229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:02:45 devstack sudo[88229]: pam_unix(sudo:session): session closed for user root Nov 02 10:02:45 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6d700ee9-d58f-434f-b9d3-3212e16173e4 tempest-GroupSnapshotsV319Test-1284869072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.370s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:02:45 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-6d700ee9-d58f-434f-b9d3-3212e16173e4 tempest-GroupSnapshotsV319Test-1284869072 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:02:45 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-6d700ee9-d58f-434f-b9d3-3212e16173e4 tempest-GroupSnapshotsV319Test-1284869072 None] Delete group completed successfully. Nov 02 10:02:54 devstack cinder-volume[86890]: DEBUG dbcounter [-] [86890] Writing DB stats cinder:SELECT=49,cinder:UPDATE=52,cinder:DELETE=4,cinder:INSERT=10 {{(pid=86890) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:02:54 devstack cinder-volume[86890]: DEBUG dbcounter [-] [86890] Writing DB stats cinder:SELECT=50,cinder:UPDATE=58,cinder:INSERT=17,cinder:DELETE=3 {{(pid=86890) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:03:06 devstack cinder-volume[86890]: DEBUG dbcounter [-] [86890] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=86890) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:03:09 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-17f1dc1f-a55b-45dd-8af6-ed1a41c4241b tempest-DeleteServersTestJSON-304380531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:03:09 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-17f1dc1f-a55b-45dd-8af6-ed1a41c4241b tempest-DeleteServersTestJSON-304380531 None] Flow 'volume_create_manager' (d3aff10c-94f2-459f-8e7a-08ab18310726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:03:09 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-17f1dc1f-a55b-45dd-8af6-ed1a41c4241b tempest-DeleteServersTestJSON-304380531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e992dd1-e6db-417a-8aa9-4b770a534eec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:03:09 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-17f1dc1f-a55b-45dd-8af6-ed1a41c4241b tempest-DeleteServersTestJSON-304380531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e992dd1-e6db-417a-8aa9-4b770a534eec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:03:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-508344321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c8547a2-eab7-4b0f-8da1-b2712c92d43d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='669888dc4dba4e16872c34acc775d7ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:03:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:03:09Z,use_quota=True,user_id='7440fd5a0e5e44d59b2fd8574921a988',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:03:09 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-17f1dc1f-a55b-45dd-8af6-ed1a41c4241b tempest-DeleteServersTestJSON-304380531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0394775-8cc7-4df0-89a5-08cc3f22b9b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:03:09 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-17f1dc1f-a55b-45dd-8af6-ed1a41c4241b tempest-DeleteServersTestJSON-304380531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0394775-8cc7-4df0-89a5-08cc3f22b9b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:03:09 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-17f1dc1f-a55b-45dd-8af6-ed1a41c4241b tempest-DeleteServersTestJSON-304380531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28b7d810-01d1-4a65-b197-659f87f234af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:03:09 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-17f1dc1f-a55b-45dd-8af6-ed1a41c4241b tempest-DeleteServersTestJSON-304380531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28b7d810-01d1-4a65-b197-659f87f234af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c8547a2-eab7-4b0f-8da1-b2712c92d43d', 'volume_name': 'volume-1c8547a2-eab7-4b0f-8da1-b2712c92d43d', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:03:09 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-17f1dc1f-a55b-45dd-8af6-ed1a41c4241b tempest-DeleteServersTestJSON-304380531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ca45fb4-5f25-4306-b7fb-764bc42252d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:03:09 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-17f1dc1f-a55b-45dd-8af6-ed1a41c4241b tempest-DeleteServersTestJSON-304380531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ca45fb4-5f25-4306-b7fb-764bc42252d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:03:09 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-17f1dc1f-a55b-45dd-8af6-ed1a41c4241b tempest-DeleteServersTestJSON-304380531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dde0e15-0ac9-4c1d-a011-d57e078cfd91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:03:09 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-17f1dc1f-a55b-45dd-8af6-ed1a41c4241b tempest-DeleteServersTestJSON-304380531 None] Volume 1c8547a2-eab7-4b0f-8da1-b2712c92d43d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c8547a2-eab7-4b0f-8da1-b2712c92d43d', 'volume_size': 1} Nov 02 10:03:09 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-17f1dc1f-a55b-45dd-8af6-ed1a41c4241b tempest-DeleteServersTestJSON-304380531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:03:09 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-17f1dc1f-a55b-45dd-8af6-ed1a41c4241b tempest-DeleteServersTestJSON-304380531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:03:09 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-17f1dc1f-a55b-45dd-8af6-ed1a41c4241b tempest-DeleteServersTestJSON-304380531 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:03:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-508344321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c8547a2-eab7-4b0f-8da1-b2712c92d43d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='669888dc4dba4e16872c34acc775d7ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:03:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:03:09Z,use_quota=True,user_id='7440fd5a0e5e44d59b2fd8574921a988',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:03:09 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-17f1dc1f-a55b-45dd-8af6-ed1a41c4241b tempest-DeleteServersTestJSON-304380531 None] Creating volume 1c8547a2-eab7-4b0f-8da1-b2712c92d43d {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:03:09 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-17f1dc1f-a55b-45dd-8af6-ed1a41c4241b tempest-DeleteServersTestJSON-304380531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:03:09 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-17f1dc1f-a55b-45dd-8af6-ed1a41c4241b tempest-DeleteServersTestJSON-304380531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:03:09 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-17f1dc1f-a55b-45dd-8af6-ed1a41c4241b tempest-DeleteServersTestJSON-304380531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:03:09 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-17f1dc1f-a55b-45dd-8af6-ed1a41c4241b tempest-DeleteServersTestJSON-304380531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:03:09 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-17f1dc1f-a55b-45dd-8af6-ed1a41c4241b tempest-DeleteServersTestJSON-304380531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:03:09 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-17f1dc1f-a55b-45dd-8af6-ed1a41c4241b tempest-DeleteServersTestJSON-304380531 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:03:09 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-17f1dc1f-a55b-45dd-8af6-ed1a41c4241b tempest-DeleteServersTestJSON-304380531 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:03:09 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-17f1dc1f-a55b-45dd-8af6-ed1a41c4241b tempest-DeleteServersTestJSON-304380531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-1c8547a2-eab7-4b0f-8da1-b2712c92d43d 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:03:09 devstack sudo[88449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-1c8547a2-eab7-4b0f-8da1-b2712c92d43d 1073741824 Nov 02 10:03:09 devstack sudo[88449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:03:09 devstack sudo[88449]: pam_unix(sudo:session): session closed for user root Nov 02 10:03:09 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-17f1dc1f-a55b-45dd-8af6-ed1a41c4241b tempest-DeleteServersTestJSON-304380531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-1c8547a2-eab7-4b0f-8da1-b2712c92d43d 1073741824" returned: 0 in 0.570s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:03:09 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-17f1dc1f-a55b-45dd-8af6-ed1a41c4241b tempest-DeleteServersTestJSON-304380531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-1c8547a2-eab7-4b0f-8da1-b2712c92d43d {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:03:10 devstack sudo[88456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-1c8547a2-eab7-4b0f-8da1-b2712c92d43d Nov 02 10:03:10 devstack sudo[88456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:03:10 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-9b13647d-4c39-4fee-95b4-20d28a242c0a tempest-GroupsV320Test-946379064 None] Group tempest-GroupsV320Test-Group-595859044: creating Nov 02 10:03:10 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-9b13647d-4c39-4fee-95b4-20d28a242c0a tempest-GroupsV320Test-946379064 None] Group tempest-GroupsV320Test-Group-595859044: created successfully Nov 02 10:03:10 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-9b13647d-4c39-4fee-95b4-20d28a242c0a tempest-GroupsV320Test-946379064 None] Create group completed successfully. Nov 02 10:03:10 devstack sudo[88456]: pam_unix(sudo:session): session closed for user root Nov 02 10:03:10 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-17f1dc1f-a55b-45dd-8af6-ed1a41c4241b tempest-DeleteServersTestJSON-304380531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-1c8547a2-eab7-4b0f-8da1-b2712c92d43d" returned: 0 in 0.432s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:03:10 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-17f1dc1f-a55b-45dd-8af6-ed1a41c4241b tempest-DeleteServersTestJSON-304380531 None] <== create_volume: return (1070ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:03:10 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-17f1dc1f-a55b-45dd-8af6-ed1a41c4241b tempest-DeleteServersTestJSON-304380531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.078s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:03:10 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-17f1dc1f-a55b-45dd-8af6-ed1a41c4241b tempest-DeleteServersTestJSON-304380531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dde0e15-0ac9-4c1d-a011-d57e078cfd91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c8547a2-eab7-4b0f-8da1-b2712c92d43d', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:03:10 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-17f1dc1f-a55b-45dd-8af6-ed1a41c4241b tempest-DeleteServersTestJSON-304380531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (babc4881-0cc1-4046-8e85-d949ae3f0c9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:03:10 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-17f1dc1f-a55b-45dd-8af6-ed1a41c4241b tempest-DeleteServersTestJSON-304380531 None] Volume volume-1c8547a2-eab7-4b0f-8da1-b2712c92d43d (1c8547a2-eab7-4b0f-8da1-b2712c92d43d): created successfully Nov 02 10:03:10 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-17f1dc1f-a55b-45dd-8af6-ed1a41c4241b tempest-DeleteServersTestJSON-304380531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (babc4881-0cc1-4046-8e85-d949ae3f0c9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:03:10 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-17f1dc1f-a55b-45dd-8af6-ed1a41c4241b tempest-DeleteServersTestJSON-304380531 None] Flow 'volume_create_manager' (d3aff10c-94f2-459f-8e7a-08ab18310726) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:03:10 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-17f1dc1f-a55b-45dd-8af6-ed1a41c4241b tempest-DeleteServersTestJSON-304380531 None] Created volume successfully. Nov 02 10:03:11 devstack cinder-volume[86890]: WARNING py.warnings [req-7e5a3c89-2f8a-45e0-9ca4-36bb25c5059a req-457386fc-a731-4fa3-bfd7-3fa92a15ef2c tempest-TaggedAttachmentsTest-1004175425 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Nov 02 10:03:11 devstack cinder-volume[86890]: .first() Nov 02 10:03:11 devstack cinder-volume[86890]: Nov 02 10:03:11 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [req-7e5a3c89-2f8a-45e0-9ca4-36bb25c5059a req-457386fc-a731-4fa3-bfd7-3fa92a15ef2c tempest-TaggedAttachmentsTest-1004175425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:03:11 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [req-7e5a3c89-2f8a-45e0-9ca4-36bb25c5059a req-457386fc-a731-4fa3-bfd7-3fa92a15ef2c tempest-TaggedAttachmentsTest-1004175425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:03:11 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [req-7e5a3c89-2f8a-45e0-9ca4-36bb25c5059a req-457386fc-a731-4fa3-bfd7-3fa92a15ef2c tempest-TaggedAttachmentsTest-1004175425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:03:11 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [req-7e5a3c89-2f8a-45e0-9ca4-36bb25c5059a req-457386fc-a731-4fa3-bfd7-3fa92a15ef2c tempest-TaggedAttachmentsTest-1004175425 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67', 'name': 'volume-9476181d-385b-46d4-b594-f641000ad2a3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1e8e66c1-0dab-402c-b288-2517f1592118', 'enforce_multipath': True} {{(pid=86890) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:03:11 devstack cinder-volume[86890]: INFO cinder.volume.manager [req-7e5a3c89-2f8a-45e0-9ca4-36bb25c5059a req-457386fc-a731-4fa3-bfd7-3fa92a15ef2c tempest-TaggedAttachmentsTest-1004175425 None] attachment_update completed successfully. Nov 02 10:03:12 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-88d6878e-a793-44a4-9507-0aa621c79526 tempest-GroupsV320Test-946379064 None] Created reservations ['8f9738b0-9870-4e2e-a6fa-762e574a78e4'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:03:12 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-88d6878e-a793-44a4-9507-0aa621c79526 tempest-GroupsV320Test-946379064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:03:12 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-88d6878e-a793-44a4-9507-0aa621c79526 tempest-GroupsV320Test-946379064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:03:12 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-88d6878e-a793-44a4-9507-0aa621c79526 tempest-GroupsV320Test-946379064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:03:12 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-88d6878e-a793-44a4-9507-0aa621c79526 tempest-GroupsV320Test-946379064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:03:12 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-88d6878e-a793-44a4-9507-0aa621c79526 tempest-GroupsV320Test-946379064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:03:12 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-88d6878e-a793-44a4-9507-0aa621c79526 tempest-GroupsV320Test-946379064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:03:12 devstack sudo[88894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:03:12 devstack sudo[88894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:03:13 devstack sudo[88894]: pam_unix(sudo:session): session closed for user root Nov 02 10:03:13 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-88d6878e-a793-44a4-9507-0aa621c79526 tempest-GroupsV320Test-946379064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.729s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:03:13 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-88d6878e-a793-44a4-9507-0aa621c79526 tempest-GroupsV320Test-946379064 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:03:13 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-88d6878e-a793-44a4-9507-0aa621c79526 tempest-GroupsV320Test-946379064 None] Delete group completed successfully. Nov 02 10:03:13 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [req-e9e14f11-0e70-41ca-8435-8ba834d8f8a2 req-790db9e2-0afe-410e-9be0-fca36aaec397 tempest-DeleteServersTestJSON-304380531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:03:13 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [req-e9e14f11-0e70-41ca-8435-8ba834d8f8a2 req-790db9e2-0afe-410e-9be0-fca36aaec397 tempest-DeleteServersTestJSON-304380531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:03:13 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [req-e9e14f11-0e70-41ca-8435-8ba834d8f8a2 req-790db9e2-0afe-410e-9be0-fca36aaec397 tempest-DeleteServersTestJSON-304380531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:03:13 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [req-e9e14f11-0e70-41ca-8435-8ba834d8f8a2 req-790db9e2-0afe-410e-9be0-fca36aaec397 tempest-DeleteServersTestJSON-304380531 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67', 'name': 'volume-1c8547a2-eab7-4b0f-8da1-b2712c92d43d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '825ce46b-7e9f-4f71-a3d7-8f5bc7f9368a', 'enforce_multipath': True} {{(pid=86890) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:03:13 devstack cinder-volume[86890]: INFO cinder.volume.manager [req-e9e14f11-0e70-41ca-8435-8ba834d8f8a2 req-790db9e2-0afe-410e-9be0-fca36aaec397 tempest-DeleteServersTestJSON-304380531 None] attachment_update completed successfully. Nov 02 10:03:17 devstack cinder-volume[86890]: INFO cinder.volume.manager [req-c12f519b-9e15-4a8c-88d3-c8850ac43eda req-44b7c6d4-3d4d-4893-b10d-d5df7191fba1 tempest-TaggedAttachmentsTest-1004175425 None] Terminate volume connection completed successfully. Nov 02 10:03:17 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [req-c12f519b-9e15-4a8c-88d3-c8850ac43eda req-44b7c6d4-3d4d-4893-b10d-d5df7191fba1 tempest-TaggedAttachmentsTest-1004175425 None] Deleting attachment 1e8e66c1-0dab-402c-b288-2517f1592118. {{(pid=86890) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:03:18 devstack cinder-volume[86890]: INFO cinder.volume.manager [req-b2c45762-8c9d-4971-bf3e-1cd7d8c19047 req-f0ebe780-b9ee-4691-8eec-1b52249df585 tempest-DeleteServersTestJSON-304380531 None] Terminate volume connection completed successfully. Nov 02 10:03:18 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [req-b2c45762-8c9d-4971-bf3e-1cd7d8c19047 req-f0ebe780-b9ee-4691-8eec-1b52249df585 tempest-DeleteServersTestJSON-304380531 None] Deleting attachment 825ce46b-7e9f-4f71-a3d7-8f5bc7f9368a. {{(pid=86890) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:03:20 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-4a926028-1d08-4ec3-ab53-62d937183def tempest-DeleteServersTestJSON-304380531 None] Acquiring lock "cinder-1c8547a2-eab7-4b0f-8da1-b2712c92d43d-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:03:20 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-4a926028-1d08-4ec3-ab53-62d937183def tempest-DeleteServersTestJSON-304380531 None] Lock "cinder-1c8547a2-eab7-4b0f-8da1-b2712c92d43d-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:03:20 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-4a926028-1d08-4ec3-ab53-62d937183def tempest-DeleteServersTestJSON-304380531 None] Acquiring lock "cinder-quobyte-1c8547a2-eab7-4b0f-8da1-b2712c92d43d" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:03:20 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-4a926028-1d08-4ec3-ab53-62d937183def tempest-DeleteServersTestJSON-304380531 None] Lock "cinder-quobyte-1c8547a2-eab7-4b0f-8da1-b2712c92d43d" acquired by "delete_volume" :: waited 0.036s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:03:20 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[38bce37a-06a3-4427-b036-8b072a0e8cd5]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:03:20 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-4a926028-1d08-4ec3-ab53-62d937183def tempest-DeleteServersTestJSON-304380531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-1c8547a2-eab7-4b0f-8da1-b2712c92d43d {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:03:20 devstack sudo[89001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-1c8547a2-eab7-4b0f-8da1-b2712c92d43d Nov 02 10:03:20 devstack sudo[89001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:03:21 devstack sudo[89001]: pam_unix(sudo:session): session closed for user root Nov 02 10:03:21 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-4a926028-1d08-4ec3-ab53-62d937183def tempest-DeleteServersTestJSON-304380531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-1c8547a2-eab7-4b0f-8da1-b2712c92d43d" returned: 0 in 0.704s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:03:21 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-4a926028-1d08-4ec3-ab53-62d937183def tempest-DeleteServersTestJSON-304380531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-1c8547a2-eab7-4b0f-8da1-b2712c92d43d {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:03:21 devstack sudo[89010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-1c8547a2-eab7-4b0f-8da1-b2712c92d43d Nov 02 10:03:21 devstack sudo[89010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:03:21 devstack sudo[89010]: pam_unix(sudo:session): session closed for user root Nov 02 10:03:21 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-4a926028-1d08-4ec3-ab53-62d937183def tempest-DeleteServersTestJSON-304380531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-1c8547a2-eab7-4b0f-8da1-b2712c92d43d" returned: 0 in 0.350s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:03:21 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-4a926028-1d08-4ec3-ab53-62d937183def tempest-DeleteServersTestJSON-304380531 None] Lock "cinder-quobyte-1c8547a2-eab7-4b0f-8da1-b2712c92d43d" released by "delete_volume" :: held 1.132s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:03:21 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-4a926028-1d08-4ec3-ab53-62d937183def tempest-DeleteServersTestJSON-304380531 None] Created reservations ['1077fd79-815e-4693-bb5a-64b1982c1551', 'b6f3a135-4480-4f6a-a338-cfa04e314ac8', 'b554dc0e-8097-46cc-9b4a-a6451e118169', 'b92d8d3d-f294-4972-aa46-8e0aca35bf3b'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:03:21 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-4a926028-1d08-4ec3-ab53-62d937183def tempest-DeleteServersTestJSON-304380531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:03:21 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-4a926028-1d08-4ec3-ab53-62d937183def tempest-DeleteServersTestJSON-304380531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:03:21 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-4a926028-1d08-4ec3-ab53-62d937183def tempest-DeleteServersTestJSON-304380531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:03:21 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-4a926028-1d08-4ec3-ab53-62d937183def tempest-DeleteServersTestJSON-304380531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:03:21 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-4a926028-1d08-4ec3-ab53-62d937183def tempest-DeleteServersTestJSON-304380531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:03:21 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-4a926028-1d08-4ec3-ab53-62d937183def tempest-DeleteServersTestJSON-304380531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:03:21 devstack sudo[89013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:03:21 devstack sudo[89013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:03:21 devstack sudo[89013]: pam_unix(sudo:session): session closed for user root Nov 02 10:03:21 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-4a926028-1d08-4ec3-ab53-62d937183def tempest-DeleteServersTestJSON-304380531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.409s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:03:21 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-4a926028-1d08-4ec3-ab53-62d937183def tempest-DeleteServersTestJSON-304380531 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:03:21 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-4a926028-1d08-4ec3-ab53-62d937183def tempest-DeleteServersTestJSON-304380531 None] Deleted volume successfully. Nov 02 10:03:22 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-4a926028-1d08-4ec3-ab53-62d937183def tempest-DeleteServersTestJSON-304380531 None] Lock "cinder-1c8547a2-eab7-4b0f-8da1-b2712c92d43d-delete_volume" released by "delete_volume" :: held 1.864s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:03:31 devstack cinder-volume[86890]: DEBUG dbcounter [-] [86890] Writing DB stats cinder:UPDATE=18,cinder:SELECT=22,cinder:DELETE=1,cinder:INSERT=3 {{(pid=86890) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:03:32 devstack cinder-volume[86890]: DEBUG dbcounter [-] [86890] Writing DB stats cinder:SELECT=35,cinder:INSERT=3,cinder:UPDATE=17,cinder:DELETE=1 {{(pid=86890) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:03:34 devstack cinder-volume[86890]: DEBUG oslo_service.periodic_task [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86890) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:03:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:03:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:03:34 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:03:34 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:03:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:03:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:03:34 devstack sudo[89053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:03:34 devstack sudo[89053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:03:35 devstack sudo[89053]: pam_unix(sudo:session): session closed for user root Nov 02 10:03:35 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.539s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:03:35 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:03:35 devstack cinder-volume[86890]: DEBUG oslo_service.periodic_task [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Running periodic task VolumeManager._thread_info {{(pid=86890) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:03:35 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] thread count: 8 {{(pid=86890) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:03:35 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] thread info: [<_MainThread(MainThread, started 133913319395456)>, , , , , , , ] {{(pid=86890) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:03:38 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-27acf02c-b128-479a-85a6-39018a80d90a tempest-TaggedAttachmentsTest-1004175425 None] Acquiring lock "cinder-9476181d-385b-46d4-b594-f641000ad2a3-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:03:38 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-27acf02c-b128-479a-85a6-39018a80d90a tempest-TaggedAttachmentsTest-1004175425 None] Lock "cinder-9476181d-385b-46d4-b594-f641000ad2a3-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:03:38 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-27acf02c-b128-479a-85a6-39018a80d90a tempest-TaggedAttachmentsTest-1004175425 None] Acquiring lock "cinder-quobyte-9476181d-385b-46d4-b594-f641000ad2a3" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:03:38 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-27acf02c-b128-479a-85a6-39018a80d90a tempest-TaggedAttachmentsTest-1004175425 None] Lock "cinder-quobyte-9476181d-385b-46d4-b594-f641000ad2a3" acquired by "delete_volume" :: waited 0.018s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:03:38 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0004065-1cfd-4cac-b393-d09d48df1106]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:03:38 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-27acf02c-b128-479a-85a6-39018a80d90a tempest-TaggedAttachmentsTest-1004175425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-9476181d-385b-46d4-b594-f641000ad2a3 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:03:38 devstack sudo[89072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-9476181d-385b-46d4-b594-f641000ad2a3 Nov 02 10:03:38 devstack sudo[89072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:03:39 devstack sudo[89072]: pam_unix(sudo:session): session closed for user root Nov 02 10:03:39 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-27acf02c-b128-479a-85a6-39018a80d90a tempest-TaggedAttachmentsTest-1004175425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-9476181d-385b-46d4-b594-f641000ad2a3" returned: 0 in 0.719s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:03:39 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-27acf02c-b128-479a-85a6-39018a80d90a tempest-TaggedAttachmentsTest-1004175425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-9476181d-385b-46d4-b594-f641000ad2a3 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:03:39 devstack sudo[89090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-9476181d-385b-46d4-b594-f641000ad2a3 Nov 02 10:03:39 devstack sudo[89090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:03:39 devstack sudo[89090]: pam_unix(sudo:session): session closed for user root Nov 02 10:03:39 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-27acf02c-b128-479a-85a6-39018a80d90a tempest-TaggedAttachmentsTest-1004175425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-9476181d-385b-46d4-b594-f641000ad2a3" returned: 0 in 0.543s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:03:39 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-27acf02c-b128-479a-85a6-39018a80d90a tempest-TaggedAttachmentsTest-1004175425 None] Lock "cinder-quobyte-9476181d-385b-46d4-b594-f641000ad2a3" released by "delete_volume" :: held 1.371s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:03:39 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-27acf02c-b128-479a-85a6-39018a80d90a tempest-TaggedAttachmentsTest-1004175425 None] Created reservations ['8bcb63d4-bb59-4f06-9879-729850f36557', '0e8da933-e158-4f57-8fce-aec0e1c7b2b9', '647e2596-1a93-4c9e-b1ff-14a9e1943230', '9eb2823b-2b9a-45a0-93b4-ac1589f71d03'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:03:40 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-27acf02c-b128-479a-85a6-39018a80d90a tempest-TaggedAttachmentsTest-1004175425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:03:40 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-27acf02c-b128-479a-85a6-39018a80d90a tempest-TaggedAttachmentsTest-1004175425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:03:40 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-27acf02c-b128-479a-85a6-39018a80d90a tempest-TaggedAttachmentsTest-1004175425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:03:40 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-27acf02c-b128-479a-85a6-39018a80d90a tempest-TaggedAttachmentsTest-1004175425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:03:40 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-27acf02c-b128-479a-85a6-39018a80d90a tempest-TaggedAttachmentsTest-1004175425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:03:40 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-27acf02c-b128-479a-85a6-39018a80d90a tempest-TaggedAttachmentsTest-1004175425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:03:40 devstack sudo[89097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:03:40 devstack sudo[89097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:03:40 devstack sudo[89097]: pam_unix(sudo:session): session closed for user root Nov 02 10:03:40 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-27acf02c-b128-479a-85a6-39018a80d90a tempest-TaggedAttachmentsTest-1004175425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.377s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:03:40 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-27acf02c-b128-479a-85a6-39018a80d90a tempest-TaggedAttachmentsTest-1004175425 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:03:40 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-27acf02c-b128-479a-85a6-39018a80d90a tempest-TaggedAttachmentsTest-1004175425 None] Deleted volume successfully. Nov 02 10:03:40 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-27acf02c-b128-479a-85a6-39018a80d90a tempest-TaggedAttachmentsTest-1004175425 None] Lock "cinder-9476181d-385b-46d4-b594-f641000ad2a3-delete_volume" released by "delete_volume" :: held 2.177s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:03:42 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba6f95e8-29a7-4cb6-88ea-c516088e6c37 tempest-VolumeQuotasAdminTestJSON-416053644 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:03:42 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-ba6f95e8-29a7-4cb6-88ea-c516088e6c37 tempest-VolumeQuotasAdminTestJSON-416053644 None] Flow 'volume_create_manager' (d6ad4012-ede4-436d-b029-5020c318d897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:03:42 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-ba6f95e8-29a7-4cb6-88ea-c516088e6c37 tempest-VolumeQuotasAdminTestJSON-416053644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (288d3dec-8208-471a-b3fe-88a398b0375e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:03:42 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-ba6f95e8-29a7-4cb6-88ea-c516088e6c37 tempest-VolumeQuotasAdminTestJSON-416053644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (288d3dec-8208-471a-b3fe-88a398b0375e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:03:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2135661809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=625cc94d-0259-4cd9-bd11-c93a8d20a67c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14f0a273c79e4ab9b3a75cb5424fcde2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:03:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:03:42Z,use_quota=True,user_id='dabbb24be5c44cff8f8d92794fd9f190',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:03:42 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-ba6f95e8-29a7-4cb6-88ea-c516088e6c37 tempest-VolumeQuotasAdminTestJSON-416053644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6054cde-2a7a-4dcd-88dd-601565961438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:03:42 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-ba6f95e8-29a7-4cb6-88ea-c516088e6c37 tempest-VolumeQuotasAdminTestJSON-416053644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6054cde-2a7a-4dcd-88dd-601565961438) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:03:42 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-ba6f95e8-29a7-4cb6-88ea-c516088e6c37 tempest-VolumeQuotasAdminTestJSON-416053644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08e9c37d-87ad-4c57-bf7b-ef27ee1b030b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:03:42 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-ba6f95e8-29a7-4cb6-88ea-c516088e6c37 tempest-VolumeQuotasAdminTestJSON-416053644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08e9c37d-87ad-4c57-bf7b-ef27ee1b030b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '625cc94d-0259-4cd9-bd11-c93a8d20a67c', 'volume_name': 'volume-625cc94d-0259-4cd9-bd11-c93a8d20a67c', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:03:42 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-ba6f95e8-29a7-4cb6-88ea-c516088e6c37 tempest-VolumeQuotasAdminTestJSON-416053644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbb02dfb-004a-4232-b3ff-db458850795f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:03:42 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-ba6f95e8-29a7-4cb6-88ea-c516088e6c37 tempest-VolumeQuotasAdminTestJSON-416053644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbb02dfb-004a-4232-b3ff-db458850795f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:03:42 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-ba6f95e8-29a7-4cb6-88ea-c516088e6c37 tempest-VolumeQuotasAdminTestJSON-416053644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ab12a1a-c2c4-430f-9c6d-3a807820f86f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:03:42 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-ba6f95e8-29a7-4cb6-88ea-c516088e6c37 tempest-VolumeQuotasAdminTestJSON-416053644 None] Volume 625cc94d-0259-4cd9-bd11-c93a8d20a67c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-625cc94d-0259-4cd9-bd11-c93a8d20a67c', 'volume_size': 1} Nov 02 10:03:42 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-ba6f95e8-29a7-4cb6-88ea-c516088e6c37 tempest-VolumeQuotasAdminTestJSON-416053644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:03:42 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-ba6f95e8-29a7-4cb6-88ea-c516088e6c37 tempest-VolumeQuotasAdminTestJSON-416053644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:03:42 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-ba6f95e8-29a7-4cb6-88ea-c516088e6c37 tempest-VolumeQuotasAdminTestJSON-416053644 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:03:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2135661809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=625cc94d-0259-4cd9-bd11-c93a8d20a67c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14f0a273c79e4ab9b3a75cb5424fcde2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:03:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:03:42Z,use_quota=True,user_id='dabbb24be5c44cff8f8d92794fd9f190',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:03:42 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-ba6f95e8-29a7-4cb6-88ea-c516088e6c37 tempest-VolumeQuotasAdminTestJSON-416053644 None] Creating volume 625cc94d-0259-4cd9-bd11-c93a8d20a67c {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:03:42 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-ba6f95e8-29a7-4cb6-88ea-c516088e6c37 tempest-VolumeQuotasAdminTestJSON-416053644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:03:42 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-ba6f95e8-29a7-4cb6-88ea-c516088e6c37 tempest-VolumeQuotasAdminTestJSON-416053644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:03:42 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-ba6f95e8-29a7-4cb6-88ea-c516088e6c37 tempest-VolumeQuotasAdminTestJSON-416053644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:03:42 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-ba6f95e8-29a7-4cb6-88ea-c516088e6c37 tempest-VolumeQuotasAdminTestJSON-416053644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:03:42 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-ba6f95e8-29a7-4cb6-88ea-c516088e6c37 tempest-VolumeQuotasAdminTestJSON-416053644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:03:42 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-ba6f95e8-29a7-4cb6-88ea-c516088e6c37 tempest-VolumeQuotasAdminTestJSON-416053644 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:03:42 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-ba6f95e8-29a7-4cb6-88ea-c516088e6c37 tempest-VolumeQuotasAdminTestJSON-416053644 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:03:42 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ba6f95e8-29a7-4cb6-88ea-c516088e6c37 tempest-VolumeQuotasAdminTestJSON-416053644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-625cc94d-0259-4cd9-bd11-c93a8d20a67c 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:03:42 devstack sudo[89119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-625cc94d-0259-4cd9-bd11-c93a8d20a67c 1073741824 Nov 02 10:03:42 devstack sudo[89119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:03:43 devstack sudo[89119]: pam_unix(sudo:session): session closed for user root Nov 02 10:03:43 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ba6f95e8-29a7-4cb6-88ea-c516088e6c37 tempest-VolumeQuotasAdminTestJSON-416053644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-625cc94d-0259-4cd9-bd11-c93a8d20a67c 1073741824" returned: 0 in 0.568s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:03:43 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ba6f95e8-29a7-4cb6-88ea-c516088e6c37 tempest-VolumeQuotasAdminTestJSON-416053644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-625cc94d-0259-4cd9-bd11-c93a8d20a67c {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:03:43 devstack sudo[89126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-625cc94d-0259-4cd9-bd11-c93a8d20a67c Nov 02 10:03:43 devstack sudo[89126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:03:43 devstack sudo[89126]: pam_unix(sudo:session): session closed for user root Nov 02 10:03:43 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ba6f95e8-29a7-4cb6-88ea-c516088e6c37 tempest-VolumeQuotasAdminTestJSON-416053644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-625cc94d-0259-4cd9-bd11-c93a8d20a67c" returned: 0 in 0.297s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:03:43 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-ba6f95e8-29a7-4cb6-88ea-c516088e6c37 tempest-VolumeQuotasAdminTestJSON-416053644 None] <== create_volume: return (927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:03:43 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-ba6f95e8-29a7-4cb6-88ea-c516088e6c37 tempest-VolumeQuotasAdminTestJSON-416053644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:03:43 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-ba6f95e8-29a7-4cb6-88ea-c516088e6c37 tempest-VolumeQuotasAdminTestJSON-416053644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ab12a1a-c2c4-430f-9c6d-3a807820f86f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-625cc94d-0259-4cd9-bd11-c93a8d20a67c', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:03:43 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-ba6f95e8-29a7-4cb6-88ea-c516088e6c37 tempest-VolumeQuotasAdminTestJSON-416053644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74ceb569-f691-4c14-a284-c768b7dd2e62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:03:43 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-ba6f95e8-29a7-4cb6-88ea-c516088e6c37 tempest-VolumeQuotasAdminTestJSON-416053644 None] Volume volume-625cc94d-0259-4cd9-bd11-c93a8d20a67c (625cc94d-0259-4cd9-bd11-c93a8d20a67c): created successfully Nov 02 10:03:43 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-ba6f95e8-29a7-4cb6-88ea-c516088e6c37 tempest-VolumeQuotasAdminTestJSON-416053644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74ceb569-f691-4c14-a284-c768b7dd2e62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:03:43 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-ba6f95e8-29a7-4cb6-88ea-c516088e6c37 tempest-VolumeQuotasAdminTestJSON-416053644 None] Flow 'volume_create_manager' (d6ad4012-ede4-436d-b029-5020c318d897) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:03:43 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-ba6f95e8-29a7-4cb6-88ea-c516088e6c37 tempest-VolumeQuotasAdminTestJSON-416053644 None] Created volume successfully. Nov 02 10:03:44 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-361675ed-c1aa-4aa8-9fbc-fc281bbd9105 tempest-VolumeQuotasAdminTestJSON-416053644 None] Acquiring lock "cinder-625cc94d-0259-4cd9-bd11-c93a8d20a67c-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:03:44 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-361675ed-c1aa-4aa8-9fbc-fc281bbd9105 tempest-VolumeQuotasAdminTestJSON-416053644 None] Lock "cinder-625cc94d-0259-4cd9-bd11-c93a8d20a67c-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:03:44 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-361675ed-c1aa-4aa8-9fbc-fc281bbd9105 tempest-VolumeQuotasAdminTestJSON-416053644 None] Acquiring lock "cinder-quobyte-625cc94d-0259-4cd9-bd11-c93a8d20a67c" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:03:44 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-361675ed-c1aa-4aa8-9fbc-fc281bbd9105 tempest-VolumeQuotasAdminTestJSON-416053644 None] Lock "cinder-quobyte-625cc94d-0259-4cd9-bd11-c93a8d20a67c" acquired by "delete_volume" :: waited 0.020s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:03:44 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[2346f8f9-6a77-48e2-a082-a460679d9fae]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:03:44 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-361675ed-c1aa-4aa8-9fbc-fc281bbd9105 tempest-VolumeQuotasAdminTestJSON-416053644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-625cc94d-0259-4cd9-bd11-c93a8d20a67c {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:03:44 devstack sudo[89130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-625cc94d-0259-4cd9-bd11-c93a8d20a67c Nov 02 10:03:44 devstack sudo[89130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:03:45 devstack sudo[89130]: pam_unix(sudo:session): session closed for user root Nov 02 10:03:45 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-361675ed-c1aa-4aa8-9fbc-fc281bbd9105 tempest-VolumeQuotasAdminTestJSON-416053644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-625cc94d-0259-4cd9-bd11-c93a8d20a67c" returned: 0 in 0.517s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:03:45 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-361675ed-c1aa-4aa8-9fbc-fc281bbd9105 tempest-VolumeQuotasAdminTestJSON-416053644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-625cc94d-0259-4cd9-bd11-c93a8d20a67c {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:03:45 devstack sudo[89136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-625cc94d-0259-4cd9-bd11-c93a8d20a67c Nov 02 10:03:45 devstack sudo[89136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:03:45 devstack sudo[89136]: pam_unix(sudo:session): session closed for user root Nov 02 10:03:45 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-361675ed-c1aa-4aa8-9fbc-fc281bbd9105 tempest-VolumeQuotasAdminTestJSON-416053644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-625cc94d-0259-4cd9-bd11-c93a8d20a67c" returned: 0 in 0.313s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:03:45 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-361675ed-c1aa-4aa8-9fbc-fc281bbd9105 tempest-VolumeQuotasAdminTestJSON-416053644 None] Lock "cinder-quobyte-625cc94d-0259-4cd9-bd11-c93a8d20a67c" released by "delete_volume" :: held 0.939s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:03:45 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-361675ed-c1aa-4aa8-9fbc-fc281bbd9105 tempest-VolumeQuotasAdminTestJSON-416053644 None] Created reservations ['49acf81a-fdd1-4bb4-a98e-e94930d89c2e', '3f3a937b-1ea1-4ff9-a248-cd29e34ea174', '3697ed24-a564-45ba-af25-6e000eb4c53d', '0ff0c285-d52e-45aa-b997-37a51393ba2c'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:03:45 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-361675ed-c1aa-4aa8-9fbc-fc281bbd9105 tempest-VolumeQuotasAdminTestJSON-416053644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:03:45 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-361675ed-c1aa-4aa8-9fbc-fc281bbd9105 tempest-VolumeQuotasAdminTestJSON-416053644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:03:45 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-361675ed-c1aa-4aa8-9fbc-fc281bbd9105 tempest-VolumeQuotasAdminTestJSON-416053644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:03:45 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-361675ed-c1aa-4aa8-9fbc-fc281bbd9105 tempest-VolumeQuotasAdminTestJSON-416053644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:03:45 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-361675ed-c1aa-4aa8-9fbc-fc281bbd9105 tempest-VolumeQuotasAdminTestJSON-416053644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:03:45 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-361675ed-c1aa-4aa8-9fbc-fc281bbd9105 tempest-VolumeQuotasAdminTestJSON-416053644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:03:45 devstack sudo[89141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:03:45 devstack sudo[89141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:03:46 devstack sudo[89141]: pam_unix(sudo:session): session closed for user root Nov 02 10:03:46 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-361675ed-c1aa-4aa8-9fbc-fc281bbd9105 tempest-VolumeQuotasAdminTestJSON-416053644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.333s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:03:46 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-361675ed-c1aa-4aa8-9fbc-fc281bbd9105 tempest-VolumeQuotasAdminTestJSON-416053644 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:03:46 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-361675ed-c1aa-4aa8-9fbc-fc281bbd9105 tempest-VolumeQuotasAdminTestJSON-416053644 None] Deleted volume successfully. Nov 02 10:03:46 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-361675ed-c1aa-4aa8-9fbc-fc281bbd9105 tempest-VolumeQuotasAdminTestJSON-416053644 None] Lock "cinder-625cc94d-0259-4cd9-bd11-c93a8d20a67c-delete_volume" released by "delete_volume" :: held 1.617s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:03:47 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7d77e30-2181-4c06-8076-5842aeae3ad2 tempest-VolumeQuotasAdminTestJSON-416053644 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:03:47 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c7d77e30-2181-4c06-8076-5842aeae3ad2 tempest-VolumeQuotasAdminTestJSON-416053644 None] Flow 'volume_create_manager' (7e668b63-313c-4b8e-bad6-59c00c9bce45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:03:47 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c7d77e30-2181-4c06-8076-5842aeae3ad2 tempest-VolumeQuotasAdminTestJSON-416053644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b50531e6-3c17-4b87-ba4c-bc85d858d58b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:03:47 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c7d77e30-2181-4c06-8076-5842aeae3ad2 tempest-VolumeQuotasAdminTestJSON-416053644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b50531e6-3c17-4b87-ba4c-bc85d858d58b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:03:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1650859891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59151a2b-c51e-47ad-9080-5a60006dd18e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14f0a273c79e4ab9b3a75cb5424fcde2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:03:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:03:48Z,use_quota=True,user_id='dabbb24be5c44cff8f8d92794fd9f190',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:03:47 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c7d77e30-2181-4c06-8076-5842aeae3ad2 tempest-VolumeQuotasAdminTestJSON-416053644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dd03de9-efba-4739-a71b-feedc4d53af5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:03:47 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c7d77e30-2181-4c06-8076-5842aeae3ad2 tempest-VolumeQuotasAdminTestJSON-416053644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dd03de9-efba-4739-a71b-feedc4d53af5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:03:47 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c7d77e30-2181-4c06-8076-5842aeae3ad2 tempest-VolumeQuotasAdminTestJSON-416053644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45a4525f-0b7c-4884-afdf-bc505761881b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:03:47 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c7d77e30-2181-4c06-8076-5842aeae3ad2 tempest-VolumeQuotasAdminTestJSON-416053644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45a4525f-0b7c-4884-afdf-bc505761881b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59151a2b-c51e-47ad-9080-5a60006dd18e', 'volume_name': 'volume-59151a2b-c51e-47ad-9080-5a60006dd18e', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:03:47 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c7d77e30-2181-4c06-8076-5842aeae3ad2 tempest-VolumeQuotasAdminTestJSON-416053644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3a0856a-4be2-4012-b843-0f217a9bd257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:03:47 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c7d77e30-2181-4c06-8076-5842aeae3ad2 tempest-VolumeQuotasAdminTestJSON-416053644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3a0856a-4be2-4012-b843-0f217a9bd257) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:03:47 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c7d77e30-2181-4c06-8076-5842aeae3ad2 tempest-VolumeQuotasAdminTestJSON-416053644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fc8fc06-a9d5-4837-a22f-ec3823b6745a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:03:47 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-c7d77e30-2181-4c06-8076-5842aeae3ad2 tempest-VolumeQuotasAdminTestJSON-416053644 None] Volume 59151a2b-c51e-47ad-9080-5a60006dd18e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59151a2b-c51e-47ad-9080-5a60006dd18e', 'volume_size': 1} Nov 02 10:03:47 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c7d77e30-2181-4c06-8076-5842aeae3ad2 tempest-VolumeQuotasAdminTestJSON-416053644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:03:47 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c7d77e30-2181-4c06-8076-5842aeae3ad2 tempest-VolumeQuotasAdminTestJSON-416053644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:03:47 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c7d77e30-2181-4c06-8076-5842aeae3ad2 tempest-VolumeQuotasAdminTestJSON-416053644 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:03:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1650859891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59151a2b-c51e-47ad-9080-5a60006dd18e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14f0a273c79e4ab9b3a75cb5424fcde2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:03:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:03:48Z,use_quota=True,user_id='dabbb24be5c44cff8f8d92794fd9f190',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:03:47 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-c7d77e30-2181-4c06-8076-5842aeae3ad2 tempest-VolumeQuotasAdminTestJSON-416053644 None] Creating volume 59151a2b-c51e-47ad-9080-5a60006dd18e {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:03:47 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c7d77e30-2181-4c06-8076-5842aeae3ad2 tempest-VolumeQuotasAdminTestJSON-416053644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:03:47 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c7d77e30-2181-4c06-8076-5842aeae3ad2 tempest-VolumeQuotasAdminTestJSON-416053644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:03:47 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c7d77e30-2181-4c06-8076-5842aeae3ad2 tempest-VolumeQuotasAdminTestJSON-416053644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:03:47 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c7d77e30-2181-4c06-8076-5842aeae3ad2 tempest-VolumeQuotasAdminTestJSON-416053644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:03:47 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c7d77e30-2181-4c06-8076-5842aeae3ad2 tempest-VolumeQuotasAdminTestJSON-416053644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:03:47 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c7d77e30-2181-4c06-8076-5842aeae3ad2 tempest-VolumeQuotasAdminTestJSON-416053644 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:03:47 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-c7d77e30-2181-4c06-8076-5842aeae3ad2 tempest-VolumeQuotasAdminTestJSON-416053644 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:03:47 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c7d77e30-2181-4c06-8076-5842aeae3ad2 tempest-VolumeQuotasAdminTestJSON-416053644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-59151a2b-c51e-47ad-9080-5a60006dd18e 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:03:47 devstack sudo[89144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-59151a2b-c51e-47ad-9080-5a60006dd18e 1073741824 Nov 02 10:03:47 devstack sudo[89144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:03:48 devstack sudo[89144]: pam_unix(sudo:session): session closed for user root Nov 02 10:03:48 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c7d77e30-2181-4c06-8076-5842aeae3ad2 tempest-VolumeQuotasAdminTestJSON-416053644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-59151a2b-c51e-47ad-9080-5a60006dd18e 1073741824" returned: 0 in 0.562s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:03:48 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c7d77e30-2181-4c06-8076-5842aeae3ad2 tempest-VolumeQuotasAdminTestJSON-416053644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-59151a2b-c51e-47ad-9080-5a60006dd18e {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:03:48 devstack sudo[89150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-59151a2b-c51e-47ad-9080-5a60006dd18e Nov 02 10:03:48 devstack sudo[89150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:03:48 devstack sudo[89150]: pam_unix(sudo:session): session closed for user root Nov 02 10:03:48 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c7d77e30-2181-4c06-8076-5842aeae3ad2 tempest-VolumeQuotasAdminTestJSON-416053644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-59151a2b-c51e-47ad-9080-5a60006dd18e" returned: 0 in 0.431s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:03:48 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c7d77e30-2181-4c06-8076-5842aeae3ad2 tempest-VolumeQuotasAdminTestJSON-416053644 None] <== create_volume: return (1063ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:03:48 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c7d77e30-2181-4c06-8076-5842aeae3ad2 tempest-VolumeQuotasAdminTestJSON-416053644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.068s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:03:48 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c7d77e30-2181-4c06-8076-5842aeae3ad2 tempest-VolumeQuotasAdminTestJSON-416053644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fc8fc06-a9d5-4837-a22f-ec3823b6745a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59151a2b-c51e-47ad-9080-5a60006dd18e', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:03:48 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c7d77e30-2181-4c06-8076-5842aeae3ad2 tempest-VolumeQuotasAdminTestJSON-416053644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8772eb5f-82ca-4713-a287-e00237a63835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:03:48 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-c7d77e30-2181-4c06-8076-5842aeae3ad2 tempest-VolumeQuotasAdminTestJSON-416053644 None] Volume volume-59151a2b-c51e-47ad-9080-5a60006dd18e (59151a2b-c51e-47ad-9080-5a60006dd18e): created successfully Nov 02 10:03:48 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c7d77e30-2181-4c06-8076-5842aeae3ad2 tempest-VolumeQuotasAdminTestJSON-416053644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8772eb5f-82ca-4713-a287-e00237a63835) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:03:48 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c7d77e30-2181-4c06-8076-5842aeae3ad2 tempest-VolumeQuotasAdminTestJSON-416053644 None] Flow 'volume_create_manager' (7e668b63-313c-4b8e-bad6-59c00c9bce45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:03:48 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-c7d77e30-2181-4c06-8076-5842aeae3ad2 tempest-VolumeQuotasAdminTestJSON-416053644 None] Created volume successfully. Nov 02 10:03:51 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-dfbd51db-a5ec-4458-8d10-f6baec4f80bc tempest-VolumeQuotasAdminTestJSON-1259616578 None] Transfer volume completed successfully. Nov 02 10:03:52 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-b6d4f0d2-aac3-412c-b989-0e0bb6bcf158 tempest-VolumeQuotasAdminTestJSON-244717819 None] Acquiring lock "cinder-59151a2b-c51e-47ad-9080-5a60006dd18e-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:03:52 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-b6d4f0d2-aac3-412c-b989-0e0bb6bcf158 tempest-VolumeQuotasAdminTestJSON-244717819 None] Lock "cinder-59151a2b-c51e-47ad-9080-5a60006dd18e-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:03:52 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-b6d4f0d2-aac3-412c-b989-0e0bb6bcf158 tempest-VolumeQuotasAdminTestJSON-244717819 None] Acquiring lock "cinder-quobyte-59151a2b-c51e-47ad-9080-5a60006dd18e" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:03:52 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-b6d4f0d2-aac3-412c-b989-0e0bb6bcf158 tempest-VolumeQuotasAdminTestJSON-244717819 None] Lock "cinder-quobyte-59151a2b-c51e-47ad-9080-5a60006dd18e" acquired by "delete_volume" :: waited 0.026s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:03:52 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[3adb9da4-6755-45a3-90f8-239a6a526b07]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:03:52 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-b6d4f0d2-aac3-412c-b989-0e0bb6bcf158 tempest-VolumeQuotasAdminTestJSON-244717819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-59151a2b-c51e-47ad-9080-5a60006dd18e {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:03:53 devstack sudo[89225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-59151a2b-c51e-47ad-9080-5a60006dd18e Nov 02 10:03:53 devstack sudo[89225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:03:53 devstack sudo[89225]: pam_unix(sudo:session): session closed for user root Nov 02 10:03:53 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-b6d4f0d2-aac3-412c-b989-0e0bb6bcf158 tempest-VolumeQuotasAdminTestJSON-244717819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-59151a2b-c51e-47ad-9080-5a60006dd18e" returned: 0 in 0.663s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:03:53 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-b6d4f0d2-aac3-412c-b989-0e0bb6bcf158 tempest-VolumeQuotasAdminTestJSON-244717819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-59151a2b-c51e-47ad-9080-5a60006dd18e {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:03:53 devstack sudo[89231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-59151a2b-c51e-47ad-9080-5a60006dd18e Nov 02 10:03:53 devstack sudo[89231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:03:54 devstack sudo[89231]: pam_unix(sudo:session): session closed for user root Nov 02 10:03:54 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-b6d4f0d2-aac3-412c-b989-0e0bb6bcf158 tempest-VolumeQuotasAdminTestJSON-244717819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-59151a2b-c51e-47ad-9080-5a60006dd18e" returned: 0 in 0.477s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:03:54 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-b6d4f0d2-aac3-412c-b989-0e0bb6bcf158 tempest-VolumeQuotasAdminTestJSON-244717819 None] Lock "cinder-quobyte-59151a2b-c51e-47ad-9080-5a60006dd18e" released by "delete_volume" :: held 1.229s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:03:54 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-b6d4f0d2-aac3-412c-b989-0e0bb6bcf158 tempest-VolumeQuotasAdminTestJSON-244717819 None] Created reservations ['79fd749c-9576-452b-9e3d-0df08d8b83c1', 'ca35134a-a7c1-49cd-bc02-175b00c6347a', 'd2c5a730-32f1-4a57-ae2a-4e7ee277c2a6', '4d1fbc7a-3940-487d-b8fb-d7de4b8f429e'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:03:54 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-b6d4f0d2-aac3-412c-b989-0e0bb6bcf158 tempest-VolumeQuotasAdminTestJSON-244717819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:03:54 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-b6d4f0d2-aac3-412c-b989-0e0bb6bcf158 tempest-VolumeQuotasAdminTestJSON-244717819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:03:54 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-b6d4f0d2-aac3-412c-b989-0e0bb6bcf158 tempest-VolumeQuotasAdminTestJSON-244717819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:03:54 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-b6d4f0d2-aac3-412c-b989-0e0bb6bcf158 tempest-VolumeQuotasAdminTestJSON-244717819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:03:54 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-b6d4f0d2-aac3-412c-b989-0e0bb6bcf158 tempest-VolumeQuotasAdminTestJSON-244717819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:03:54 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-b6d4f0d2-aac3-412c-b989-0e0bb6bcf158 tempest-VolumeQuotasAdminTestJSON-244717819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:03:54 devstack sudo[89235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:03:54 devstack sudo[89235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:03:54 devstack sudo[89235]: pam_unix(sudo:session): session closed for user root Nov 02 10:03:54 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-b6d4f0d2-aac3-412c-b989-0e0bb6bcf158 tempest-VolumeQuotasAdminTestJSON-244717819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.593s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:03:54 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-b6d4f0d2-aac3-412c-b989-0e0bb6bcf158 tempest-VolumeQuotasAdminTestJSON-244717819 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:03:54 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-b6d4f0d2-aac3-412c-b989-0e0bb6bcf158 tempest-VolumeQuotasAdminTestJSON-244717819 None] Deleted volume successfully. Nov 02 10:03:55 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-b6d4f0d2-aac3-412c-b989-0e0bb6bcf158 tempest-VolumeQuotasAdminTestJSON-244717819 None] Lock "cinder-59151a2b-c51e-47ad-9080-5a60006dd18e-delete_volume" released by "delete_volume" :: held 2.299s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:04:04 devstack cinder-volume[86890]: DEBUG dbcounter [-] [86890] Writing DB stats cinder:UPDATE=29,cinder:SELECT=20,cinder:INSERT=7,cinder:DELETE=3 {{(pid=86890) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:04:04 devstack cinder-volume[86890]: DEBUG dbcounter [-] [86890] Writing DB stats cinder:SELECT=19,cinder:INSERT=7,cinder:UPDATE=31,cinder:DELETE=2 {{(pid=86890) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:04:22 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e3be317-8cff-4167-966e-32fca968bae4 tempest-ServerRescueNegativeTestJSON-857146046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:04:22 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-9e3be317-8cff-4167-966e-32fca968bae4 tempest-ServerRescueNegativeTestJSON-857146046 None] Flow 'volume_create_manager' (510b2a0f-7326-4ddd-9e19-68b898b4c38b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:04:22 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-9e3be317-8cff-4167-966e-32fca968bae4 tempest-ServerRescueNegativeTestJSON-857146046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4fb5db5-5e6d-40c5-a74b-26da94a56ee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:04:22 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-9e3be317-8cff-4167-966e-32fca968bae4 tempest-ServerRescueNegativeTestJSON-857146046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4fb5db5-5e6d-40c5-a74b-26da94a56ee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:04:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-2081756584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87e262ec-98e7-4c0a-89cb-84cc183938a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a82ce1a8c1d647eb9130db7f8ccc54a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:04:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:04:22Z,use_quota=True,user_id='244accc8ddf147f9baf701f1e7a0ef26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:04:22 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-9e3be317-8cff-4167-966e-32fca968bae4 tempest-ServerRescueNegativeTestJSON-857146046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ad2c7c7-20e3-4a13-b2db-2cb06c556995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:04:22 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-9e3be317-8cff-4167-966e-32fca968bae4 tempest-ServerRescueNegativeTestJSON-857146046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ad2c7c7-20e3-4a13-b2db-2cb06c556995) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:04:22 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-9e3be317-8cff-4167-966e-32fca968bae4 tempest-ServerRescueNegativeTestJSON-857146046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dadfb26b-aee1-4438-b237-e7a49d4a8b7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:04:22 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-9e3be317-8cff-4167-966e-32fca968bae4 tempest-ServerRescueNegativeTestJSON-857146046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dadfb26b-aee1-4438-b237-e7a49d4a8b7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87e262ec-98e7-4c0a-89cb-84cc183938a1', 'volume_name': 'volume-87e262ec-98e7-4c0a-89cb-84cc183938a1', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:04:22 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-9e3be317-8cff-4167-966e-32fca968bae4 tempest-ServerRescueNegativeTestJSON-857146046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (818f5dcb-73b2-46f3-b32c-371e64b18267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:04:22 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-9e3be317-8cff-4167-966e-32fca968bae4 tempest-ServerRescueNegativeTestJSON-857146046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (818f5dcb-73b2-46f3-b32c-371e64b18267) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:04:22 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-9e3be317-8cff-4167-966e-32fca968bae4 tempest-ServerRescueNegativeTestJSON-857146046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d79d015-51d4-448c-be2f-54311622c4f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:04:22 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-9e3be317-8cff-4167-966e-32fca968bae4 tempest-ServerRescueNegativeTestJSON-857146046 None] Volume 87e262ec-98e7-4c0a-89cb-84cc183938a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87e262ec-98e7-4c0a-89cb-84cc183938a1', 'volume_size': 1} Nov 02 10:04:22 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-9e3be317-8cff-4167-966e-32fca968bae4 tempest-ServerRescueNegativeTestJSON-857146046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:04:22 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-9e3be317-8cff-4167-966e-32fca968bae4 tempest-ServerRescueNegativeTestJSON-857146046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:04:22 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-9e3be317-8cff-4167-966e-32fca968bae4 tempest-ServerRescueNegativeTestJSON-857146046 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:04:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-2081756584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87e262ec-98e7-4c0a-89cb-84cc183938a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a82ce1a8c1d647eb9130db7f8ccc54a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:04:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:04:22Z,use_quota=True,user_id='244accc8ddf147f9baf701f1e7a0ef26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:04:22 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-9e3be317-8cff-4167-966e-32fca968bae4 tempest-ServerRescueNegativeTestJSON-857146046 None] Creating volume 87e262ec-98e7-4c0a-89cb-84cc183938a1 {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:04:22 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-9e3be317-8cff-4167-966e-32fca968bae4 tempest-ServerRescueNegativeTestJSON-857146046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:04:22 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-9e3be317-8cff-4167-966e-32fca968bae4 tempest-ServerRescueNegativeTestJSON-857146046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:04:22 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-9e3be317-8cff-4167-966e-32fca968bae4 tempest-ServerRescueNegativeTestJSON-857146046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:04:22 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-9e3be317-8cff-4167-966e-32fca968bae4 tempest-ServerRescueNegativeTestJSON-857146046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:04:22 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-9e3be317-8cff-4167-966e-32fca968bae4 tempest-ServerRescueNegativeTestJSON-857146046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:04:22 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-9e3be317-8cff-4167-966e-32fca968bae4 tempest-ServerRescueNegativeTestJSON-857146046 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:04:22 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-9e3be317-8cff-4167-966e-32fca968bae4 tempest-ServerRescueNegativeTestJSON-857146046 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:04:22 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-9e3be317-8cff-4167-966e-32fca968bae4 tempest-ServerRescueNegativeTestJSON-857146046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-87e262ec-98e7-4c0a-89cb-84cc183938a1 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:22 devstack sudo[89504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-87e262ec-98e7-4c0a-89cb-84cc183938a1 1073741824 Nov 02 10:04:22 devstack sudo[89504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:23 devstack sudo[89504]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:23 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-9e3be317-8cff-4167-966e-32fca968bae4 tempest-ServerRescueNegativeTestJSON-857146046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-87e262ec-98e7-4c0a-89cb-84cc183938a1 1073741824" returned: 0 in 1.183s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:23 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-9e3be317-8cff-4167-966e-32fca968bae4 tempest-ServerRescueNegativeTestJSON-857146046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-87e262ec-98e7-4c0a-89cb-84cc183938a1 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:23 devstack sudo[89510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-87e262ec-98e7-4c0a-89cb-84cc183938a1 Nov 02 10:04:23 devstack sudo[89510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:24 devstack sudo[89510]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:24 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-9e3be317-8cff-4167-966e-32fca968bae4 tempest-ServerRescueNegativeTestJSON-857146046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-87e262ec-98e7-4c0a-89cb-84cc183938a1" returned: 0 in 0.500s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:24 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-9e3be317-8cff-4167-966e-32fca968bae4 tempest-ServerRescueNegativeTestJSON-857146046 None] <== create_volume: return (1757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:04:24 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-9e3be317-8cff-4167-966e-32fca968bae4 tempest-ServerRescueNegativeTestJSON-857146046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.765s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:04:24 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-9e3be317-8cff-4167-966e-32fca968bae4 tempest-ServerRescueNegativeTestJSON-857146046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d79d015-51d4-448c-be2f-54311622c4f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87e262ec-98e7-4c0a-89cb-84cc183938a1', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:04:24 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-9e3be317-8cff-4167-966e-32fca968bae4 tempest-ServerRescueNegativeTestJSON-857146046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cb28c5b-5bef-4c83-95d4-1ce0b366a96e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:04:24 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-9e3be317-8cff-4167-966e-32fca968bae4 tempest-ServerRescueNegativeTestJSON-857146046 None] Volume volume-87e262ec-98e7-4c0a-89cb-84cc183938a1 (87e262ec-98e7-4c0a-89cb-84cc183938a1): created successfully Nov 02 10:04:24 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-9e3be317-8cff-4167-966e-32fca968bae4 tempest-ServerRescueNegativeTestJSON-857146046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cb28c5b-5bef-4c83-95d4-1ce0b366a96e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:04:24 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-9e3be317-8cff-4167-966e-32fca968bae4 tempest-ServerRescueNegativeTestJSON-857146046 None] Flow 'volume_create_manager' (510b2a0f-7326-4ddd-9e19-68b898b4c38b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:04:24 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-9e3be317-8cff-4167-966e-32fca968bae4 tempest-ServerRescueNegativeTestJSON-857146046 None] Created volume successfully. Nov 02 10:04:34 devstack cinder-volume[86890]: DEBUG dbcounter [-] [86890] Writing DB stats cinder:UPDATE=2,cinder:SELECT=1,cinder:INSERT=1 {{(pid=86890) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:04:34 devstack cinder-volume[86890]: DEBUG dbcounter [-] [86890] Writing DB stats cinder:SELECT=3,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=86890) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:04:34 devstack cinder-volume[86890]: DEBUG oslo_service.periodic_task [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86890) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:04:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:04:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:04:34 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:04:34 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:04:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:04:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:34 devstack sudo[89587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:04:34 devstack sudo[89587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:35 devstack sudo[89587]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:35 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.523s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:35 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:04:35 devstack cinder-volume[86890]: DEBUG oslo_service.periodic_task [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Running periodic task VolumeManager._thread_info {{(pid=86890) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:04:35 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] thread count: 8 {{(pid=86890) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:04:35 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] thread info: [<_MainThread(MainThread, started 133913319395456)>, , , , , , , ] {{(pid=86890) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:04:40 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-f3e65a59-6471-46f9-b8c5-b7503ec6540f tempest-ServerRescueNegativeTestJSON-857146046 None] Acquiring lock "cinder-87e262ec-98e7-4c0a-89cb-84cc183938a1-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:04:40 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-f3e65a59-6471-46f9-b8c5-b7503ec6540f tempest-ServerRescueNegativeTestJSON-857146046 None] Lock "cinder-87e262ec-98e7-4c0a-89cb-84cc183938a1-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:04:40 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-f3e65a59-6471-46f9-b8c5-b7503ec6540f tempest-ServerRescueNegativeTestJSON-857146046 None] Acquiring lock "cinder-quobyte-87e262ec-98e7-4c0a-89cb-84cc183938a1" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:04:40 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-f3e65a59-6471-46f9-b8c5-b7503ec6540f tempest-ServerRescueNegativeTestJSON-857146046 None] Lock "cinder-quobyte-87e262ec-98e7-4c0a-89cb-84cc183938a1" acquired by "delete_volume" :: waited 0.026s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:04:40 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0534701-7730-447f-aaf3-856cff623aed]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:04:40 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-f3e65a59-6471-46f9-b8c5-b7503ec6540f tempest-ServerRescueNegativeTestJSON-857146046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-87e262ec-98e7-4c0a-89cb-84cc183938a1 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:41 devstack sudo[89651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-87e262ec-98e7-4c0a-89cb-84cc183938a1 Nov 02 10:04:41 devstack sudo[89651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:41 devstack sudo[89651]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:41 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-f3e65a59-6471-46f9-b8c5-b7503ec6540f tempest-ServerRescueNegativeTestJSON-857146046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-87e262ec-98e7-4c0a-89cb-84cc183938a1" returned: 0 in 0.756s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:41 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-f3e65a59-6471-46f9-b8c5-b7503ec6540f tempest-ServerRescueNegativeTestJSON-857146046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-87e262ec-98e7-4c0a-89cb-84cc183938a1 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:41 devstack sudo[89656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-87e262ec-98e7-4c0a-89cb-84cc183938a1 Nov 02 10:04:41 devstack sudo[89656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:42 devstack sudo[89656]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:42 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-f3e65a59-6471-46f9-b8c5-b7503ec6540f tempest-ServerRescueNegativeTestJSON-857146046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-87e262ec-98e7-4c0a-89cb-84cc183938a1" returned: 0 in 0.355s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:42 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-f3e65a59-6471-46f9-b8c5-b7503ec6540f tempest-ServerRescueNegativeTestJSON-857146046 None] Lock "cinder-quobyte-87e262ec-98e7-4c0a-89cb-84cc183938a1" released by "delete_volume" :: held 1.205s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:04:42 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-f3e65a59-6471-46f9-b8c5-b7503ec6540f tempest-ServerRescueNegativeTestJSON-857146046 None] Created reservations ['d41de804-b2b0-4564-9c0a-caddda6ac068', 'b8ae4540-3f61-44dd-80a2-fc56cf68e5ad', '993337e9-6b58-429e-96fc-5e906c768873', '6ddbeed8-cf6d-47dd-adad-c61f1dc55a00'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:04:42 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-f3e65a59-6471-46f9-b8c5-b7503ec6540f tempest-ServerRescueNegativeTestJSON-857146046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:04:42 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-f3e65a59-6471-46f9-b8c5-b7503ec6540f tempest-ServerRescueNegativeTestJSON-857146046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:04:42 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-f3e65a59-6471-46f9-b8c5-b7503ec6540f tempest-ServerRescueNegativeTestJSON-857146046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:04:42 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-f3e65a59-6471-46f9-b8c5-b7503ec6540f tempest-ServerRescueNegativeTestJSON-857146046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:04:42 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-f3e65a59-6471-46f9-b8c5-b7503ec6540f tempest-ServerRescueNegativeTestJSON-857146046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:04:42 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-f3e65a59-6471-46f9-b8c5-b7503ec6540f tempest-ServerRescueNegativeTestJSON-857146046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:42 devstack sudo[89659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:04:42 devstack sudo[89659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:42 devstack sudo[89659]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:42 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-f3e65a59-6471-46f9-b8c5-b7503ec6540f tempest-ServerRescueNegativeTestJSON-857146046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.474s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:42 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-f3e65a59-6471-46f9-b8c5-b7503ec6540f tempest-ServerRescueNegativeTestJSON-857146046 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:04:42 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-f3e65a59-6471-46f9-b8c5-b7503ec6540f tempest-ServerRescueNegativeTestJSON-857146046 None] Deleted volume successfully. Nov 02 10:04:42 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-f3e65a59-6471-46f9-b8c5-b7503ec6540f tempest-ServerRescueNegativeTestJSON-857146046 None] Lock "cinder-87e262ec-98e7-4c0a-89cb-84cc183938a1-delete_volume" released by "delete_volume" :: held 2.165s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:04:51 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-53cf4257-7489-4757-ba2f-f778df18e0a0 tempest-ServerActionsTestOtherA-634183357 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:04:51 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-53cf4257-7489-4757-ba2f-f778df18e0a0 tempest-ServerActionsTestOtherA-634183357 None] Flow 'volume_create_manager' (3105fa1b-948c-413b-9824-ce490db97a76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:04:51 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-53cf4257-7489-4757-ba2f-f778df18e0a0 tempest-ServerActionsTestOtherA-634183357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c0bb5e1-1d18-4103-8f38-bf772442dc39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:04:51 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-53cf4257-7489-4757-ba2f-f778df18e0a0 tempest-ServerActionsTestOtherA-634183357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c0bb5e1-1d18-4103-8f38-bf772442dc39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:04:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-639547209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff9a5863-3f98-4ed2-8e0b-b6323204b916,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af61e3c9113b42269134b4a5c4b58a6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:04:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:04:51Z,use_quota=True,user_id='8ed51f11f81c48ab98f8d76dbe2b26e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:04:51 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-53cf4257-7489-4757-ba2f-f778df18e0a0 tempest-ServerActionsTestOtherA-634183357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60d3eee8-8485-455d-b5e4-f1c9bcd211f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:04:51 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-53cf4257-7489-4757-ba2f-f778df18e0a0 tempest-ServerActionsTestOtherA-634183357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60d3eee8-8485-455d-b5e4-f1c9bcd211f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:04:51 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-53cf4257-7489-4757-ba2f-f778df18e0a0 tempest-ServerActionsTestOtherA-634183357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b23bb45-e9ec-466b-8fd8-a6f974338ad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:04:51 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-53cf4257-7489-4757-ba2f-f778df18e0a0 tempest-ServerActionsTestOtherA-634183357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b23bb45-e9ec-466b-8fd8-a6f974338ad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff9a5863-3f98-4ed2-8e0b-b6323204b916', 'volume_name': 'volume-ff9a5863-3f98-4ed2-8e0b-b6323204b916', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:04:51 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-53cf4257-7489-4757-ba2f-f778df18e0a0 tempest-ServerActionsTestOtherA-634183357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdde3aa3-9a9e-4e8f-befd-5fa050124785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:04:51 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-53cf4257-7489-4757-ba2f-f778df18e0a0 tempest-ServerActionsTestOtherA-634183357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdde3aa3-9a9e-4e8f-befd-5fa050124785) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:04:51 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-53cf4257-7489-4757-ba2f-f778df18e0a0 tempest-ServerActionsTestOtherA-634183357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb3db8b0-4c95-4251-a593-4a838f948445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:04:51 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-53cf4257-7489-4757-ba2f-f778df18e0a0 tempest-ServerActionsTestOtherA-634183357 None] Volume ff9a5863-3f98-4ed2-8e0b-b6323204b916: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff9a5863-3f98-4ed2-8e0b-b6323204b916', 'volume_size': 1} Nov 02 10:04:51 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-53cf4257-7489-4757-ba2f-f778df18e0a0 tempest-ServerActionsTestOtherA-634183357 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:04:51 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-53cf4257-7489-4757-ba2f-f778df18e0a0 tempest-ServerActionsTestOtherA-634183357 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:04:51 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-53cf4257-7489-4757-ba2f-f778df18e0a0 tempest-ServerActionsTestOtherA-634183357 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:04:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-639547209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff9a5863-3f98-4ed2-8e0b-b6323204b916,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af61e3c9113b42269134b4a5c4b58a6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:04:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:04:51Z,use_quota=True,user_id='8ed51f11f81c48ab98f8d76dbe2b26e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:04:51 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-53cf4257-7489-4757-ba2f-f778df18e0a0 tempest-ServerActionsTestOtherA-634183357 None] Creating volume ff9a5863-3f98-4ed2-8e0b-b6323204b916 {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:04:51 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-53cf4257-7489-4757-ba2f-f778df18e0a0 tempest-ServerActionsTestOtherA-634183357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:04:51 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-53cf4257-7489-4757-ba2f-f778df18e0a0 tempest-ServerActionsTestOtherA-634183357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:04:51 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-53cf4257-7489-4757-ba2f-f778df18e0a0 tempest-ServerActionsTestOtherA-634183357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:04:51 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-53cf4257-7489-4757-ba2f-f778df18e0a0 tempest-ServerActionsTestOtherA-634183357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:04:51 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-53cf4257-7489-4757-ba2f-f778df18e0a0 tempest-ServerActionsTestOtherA-634183357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:04:51 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-53cf4257-7489-4757-ba2f-f778df18e0a0 tempest-ServerActionsTestOtherA-634183357 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:04:51 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-53cf4257-7489-4757-ba2f-f778df18e0a0 tempest-ServerActionsTestOtherA-634183357 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:04:51 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-53cf4257-7489-4757-ba2f-f778df18e0a0 tempest-ServerActionsTestOtherA-634183357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ff9a5863-3f98-4ed2-8e0b-b6323204b916 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:51 devstack sudo[89808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ff9a5863-3f98-4ed2-8e0b-b6323204b916 1073741824 Nov 02 10:04:51 devstack sudo[89808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:52 devstack sudo[89808]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:52 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-53cf4257-7489-4757-ba2f-f778df18e0a0 tempest-ServerActionsTestOtherA-634183357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ff9a5863-3f98-4ed2-8e0b-b6323204b916 1073741824" returned: 0 in 0.754s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:52 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-53cf4257-7489-4757-ba2f-f778df18e0a0 tempest-ServerActionsTestOtherA-634183357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ff9a5863-3f98-4ed2-8e0b-b6323204b916 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:52 devstack sudo[89816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ff9a5863-3f98-4ed2-8e0b-b6323204b916 Nov 02 10:04:52 devstack sudo[89816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:52 devstack sudo[89816]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:52 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-53cf4257-7489-4757-ba2f-f778df18e0a0 tempest-ServerActionsTestOtherA-634183357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ff9a5863-3f98-4ed2-8e0b-b6323204b916" returned: 0 in 0.694s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:52 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-53cf4257-7489-4757-ba2f-f778df18e0a0 tempest-ServerActionsTestOtherA-634183357 None] <== create_volume: return (1543ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:04:52 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-53cf4257-7489-4757-ba2f-f778df18e0a0 tempest-ServerActionsTestOtherA-634183357 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.546s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:04:52 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-53cf4257-7489-4757-ba2f-f778df18e0a0 tempest-ServerActionsTestOtherA-634183357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb3db8b0-4c95-4251-a593-4a838f948445) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff9a5863-3f98-4ed2-8e0b-b6323204b916', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:04:53 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-53cf4257-7489-4757-ba2f-f778df18e0a0 tempest-ServerActionsTestOtherA-634183357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3c8e659-80f5-49dd-8925-69771db8d624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:04:53 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-53cf4257-7489-4757-ba2f-f778df18e0a0 tempest-ServerActionsTestOtherA-634183357 None] Volume volume-ff9a5863-3f98-4ed2-8e0b-b6323204b916 (ff9a5863-3f98-4ed2-8e0b-b6323204b916): created successfully Nov 02 10:04:53 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-53cf4257-7489-4757-ba2f-f778df18e0a0 tempest-ServerActionsTestOtherA-634183357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3c8e659-80f5-49dd-8925-69771db8d624) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:04:53 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-53cf4257-7489-4757-ba2f-f778df18e0a0 tempest-ServerActionsTestOtherA-634183357 None] Flow 'volume_create_manager' (3105fa1b-948c-413b-9824-ce490db97a76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:04:53 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-53cf4257-7489-4757-ba2f-f778df18e0a0 tempest-ServerActionsTestOtherA-634183357 None] Created volume successfully. Nov 02 10:05:06 devstack cinder-volume[86890]: DEBUG dbcounter [-] [86890] Writing DB stats cinder:UPDATE=11,cinder:SELECT=9,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86890) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:05:06 devstack cinder-volume[86890]: DEBUG dbcounter [-] [86890] Writing DB stats cinder:SELECT=6,cinder:INSERT=4,cinder:UPDATE=12,cinder:DELETE=1 {{(pid=86890) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:05:21 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-c75b9e22-cccc-40d2-a027-110053ee5032 tempest-AttachVolumeTestJSON-1128520514 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:05:21 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c75b9e22-cccc-40d2-a027-110053ee5032 tempest-AttachVolumeTestJSON-1128520514 None] Flow 'volume_create_manager' (3d5ca6f0-a32c-476c-9202-534255c15df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:05:21 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c75b9e22-cccc-40d2-a027-110053ee5032 tempest-AttachVolumeTestJSON-1128520514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85bae851-67c8-4440-b3b0-f5dc94c83c4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:05:21 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c75b9e22-cccc-40d2-a027-110053ee5032 tempest-AttachVolumeTestJSON-1128520514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85bae851-67c8-4440-b3b0-f5dc94c83c4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:05:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1918380651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e8cc696-07b4-4105-b5c8-1c691d34b5e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f315bd8f9434f8496c9c5a883a8e212',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:05:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:05:21Z,use_quota=True,user_id='9b183a2bae364d0f87f382fea89e3ada',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:05:21 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c75b9e22-cccc-40d2-a027-110053ee5032 tempest-AttachVolumeTestJSON-1128520514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b87e0c5-2e99-4e18-bf64-982e8c645055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:05:21 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c75b9e22-cccc-40d2-a027-110053ee5032 tempest-AttachVolumeTestJSON-1128520514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b87e0c5-2e99-4e18-bf64-982e8c645055) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:05:21 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c75b9e22-cccc-40d2-a027-110053ee5032 tempest-AttachVolumeTestJSON-1128520514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ab7d3c3-ac30-4d47-a1c3-8932b638051d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:05:21 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c75b9e22-cccc-40d2-a027-110053ee5032 tempest-AttachVolumeTestJSON-1128520514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ab7d3c3-ac30-4d47-a1c3-8932b638051d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e8cc696-07b4-4105-b5c8-1c691d34b5e4', 'volume_name': 'volume-8e8cc696-07b4-4105-b5c8-1c691d34b5e4', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:05:21 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c75b9e22-cccc-40d2-a027-110053ee5032 tempest-AttachVolumeTestJSON-1128520514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ea996c6-8c59-451a-8e9e-d9485a2bdd8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:05:21 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c75b9e22-cccc-40d2-a027-110053ee5032 tempest-AttachVolumeTestJSON-1128520514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ea996c6-8c59-451a-8e9e-d9485a2bdd8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:05:21 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c75b9e22-cccc-40d2-a027-110053ee5032 tempest-AttachVolumeTestJSON-1128520514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe360cc1-3fc4-426d-8821-4f3bb0d0a3de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:05:21 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-c75b9e22-cccc-40d2-a027-110053ee5032 tempest-AttachVolumeTestJSON-1128520514 None] Volume 8e8cc696-07b4-4105-b5c8-1c691d34b5e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e8cc696-07b4-4105-b5c8-1c691d34b5e4', 'volume_size': 1} Nov 02 10:05:21 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c75b9e22-cccc-40d2-a027-110053ee5032 tempest-AttachVolumeTestJSON-1128520514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:05:21 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c75b9e22-cccc-40d2-a027-110053ee5032 tempest-AttachVolumeTestJSON-1128520514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:05:21 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c75b9e22-cccc-40d2-a027-110053ee5032 tempest-AttachVolumeTestJSON-1128520514 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:05:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1918380651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e8cc696-07b4-4105-b5c8-1c691d34b5e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f315bd8f9434f8496c9c5a883a8e212',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:05:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:05:21Z,use_quota=True,user_id='9b183a2bae364d0f87f382fea89e3ada',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:05:21 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-c75b9e22-cccc-40d2-a027-110053ee5032 tempest-AttachVolumeTestJSON-1128520514 None] Creating volume 8e8cc696-07b4-4105-b5c8-1c691d34b5e4 {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:05:21 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c75b9e22-cccc-40d2-a027-110053ee5032 tempest-AttachVolumeTestJSON-1128520514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:05:21 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c75b9e22-cccc-40d2-a027-110053ee5032 tempest-AttachVolumeTestJSON-1128520514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:05:21 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c75b9e22-cccc-40d2-a027-110053ee5032 tempest-AttachVolumeTestJSON-1128520514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:05:21 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c75b9e22-cccc-40d2-a027-110053ee5032 tempest-AttachVolumeTestJSON-1128520514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:05:21 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c75b9e22-cccc-40d2-a027-110053ee5032 tempest-AttachVolumeTestJSON-1128520514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:05:21 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c75b9e22-cccc-40d2-a027-110053ee5032 tempest-AttachVolumeTestJSON-1128520514 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:05:21 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-c75b9e22-cccc-40d2-a027-110053ee5032 tempest-AttachVolumeTestJSON-1128520514 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:05:21 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c75b9e22-cccc-40d2-a027-110053ee5032 tempest-AttachVolumeTestJSON-1128520514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-8e8cc696-07b4-4105-b5c8-1c691d34b5e4 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:21 devstack sudo[89986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-8e8cc696-07b4-4105-b5c8-1c691d34b5e4 1073741824 Nov 02 10:05:21 devstack sudo[89986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:22 devstack sudo[89986]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:22 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c75b9e22-cccc-40d2-a027-110053ee5032 tempest-AttachVolumeTestJSON-1128520514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-8e8cc696-07b4-4105-b5c8-1c691d34b5e4 1073741824" returned: 0 in 0.680s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:22 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c75b9e22-cccc-40d2-a027-110053ee5032 tempest-AttachVolumeTestJSON-1128520514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-8e8cc696-07b4-4105-b5c8-1c691d34b5e4 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:22 devstack sudo[89993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-8e8cc696-07b4-4105-b5c8-1c691d34b5e4 Nov 02 10:05:22 devstack sudo[89993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:22 devstack sudo[89993]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:22 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c75b9e22-cccc-40d2-a027-110053ee5032 tempest-AttachVolumeTestJSON-1128520514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-8e8cc696-07b4-4105-b5c8-1c691d34b5e4" returned: 0 in 0.392s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:22 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c75b9e22-cccc-40d2-a027-110053ee5032 tempest-AttachVolumeTestJSON-1128520514 None] <== create_volume: return (1163ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:05:22 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c75b9e22-cccc-40d2-a027-110053ee5032 tempest-AttachVolumeTestJSON-1128520514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.168s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:05:22 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c75b9e22-cccc-40d2-a027-110053ee5032 tempest-AttachVolumeTestJSON-1128520514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe360cc1-3fc4-426d-8821-4f3bb0d0a3de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e8cc696-07b4-4105-b5c8-1c691d34b5e4', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:05:22 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c75b9e22-cccc-40d2-a027-110053ee5032 tempest-AttachVolumeTestJSON-1128520514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (208e9ee4-4dfe-457e-b517-8fea5214a931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:05:22 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-c75b9e22-cccc-40d2-a027-110053ee5032 tempest-AttachVolumeTestJSON-1128520514 None] Volume volume-8e8cc696-07b4-4105-b5c8-1c691d34b5e4 (8e8cc696-07b4-4105-b5c8-1c691d34b5e4): created successfully Nov 02 10:05:22 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c75b9e22-cccc-40d2-a027-110053ee5032 tempest-AttachVolumeTestJSON-1128520514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (208e9ee4-4dfe-457e-b517-8fea5214a931) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:05:22 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c75b9e22-cccc-40d2-a027-110053ee5032 tempest-AttachVolumeTestJSON-1128520514 None] Flow 'volume_create_manager' (3d5ca6f0-a32c-476c-9202-534255c15df7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:05:22 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-c75b9e22-cccc-40d2-a027-110053ee5032 tempest-AttachVolumeTestJSON-1128520514 None] Created volume successfully. Nov 02 10:05:25 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [req-f775be9f-7192-4c66-9400-db7fae0183aa req-fbd27ad0-cd34-4086-817c-a30ae6bc7982 tempest-AttachVolumeTestJSON-1128520514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:05:25 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [req-f775be9f-7192-4c66-9400-db7fae0183aa req-fbd27ad0-cd34-4086-817c-a30ae6bc7982 tempest-AttachVolumeTestJSON-1128520514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:05:25 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [req-f775be9f-7192-4c66-9400-db7fae0183aa req-fbd27ad0-cd34-4086-817c-a30ae6bc7982 tempest-AttachVolumeTestJSON-1128520514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:05:25 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [req-f775be9f-7192-4c66-9400-db7fae0183aa req-fbd27ad0-cd34-4086-817c-a30ae6bc7982 tempest-AttachVolumeTestJSON-1128520514 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67', 'name': 'volume-8e8cc696-07b4-4105-b5c8-1c691d34b5e4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a7cab607-837e-423c-a185-6f82100f533a', 'enforce_multipath': True} {{(pid=86890) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:05:25 devstack cinder-volume[86890]: INFO cinder.volume.manager [req-f775be9f-7192-4c66-9400-db7fae0183aa req-fbd27ad0-cd34-4086-817c-a30ae6bc7982 tempest-AttachVolumeTestJSON-1128520514 None] attachment_update completed successfully. Nov 02 10:05:34 devstack cinder-volume[86890]: DEBUG oslo_service.periodic_task [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86890) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:05:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:05:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:05:34 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:05:34 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:05:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:05:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:34 devstack sudo[90500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:05:34 devstack sudo[90500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:35 devstack sudo[90500]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:35 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.395s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:35 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:05:35 devstack cinder-volume[86890]: DEBUG oslo_service.periodic_task [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Running periodic task VolumeManager._thread_info {{(pid=86890) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:05:35 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] thread count: 8 {{(pid=86890) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:05:35 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] thread info: [<_MainThread(MainThread, started 133913319395456)>, , , , , , , ] {{(pid=86890) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:05:35 devstack cinder-volume[86890]: DEBUG dbcounter [-] [86890] Writing DB stats cinder:SELECT=9,cinder:UPDATE=4,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86890) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:05:35 devstack cinder-volume[86890]: DEBUG dbcounter [-] [86890] Writing DB stats cinder:SELECT=8,cinder:UPDATE=5 {{(pid=86890) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:05:50 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [req-6f2fbf88-a669-4b7e-9a52-148437c2a4e2 req-118a244f-1bfb-47e8-ac11-88ff70468dea tempest-ServerActionsTestOtherA-634183357 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:05:50 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [req-6f2fbf88-a669-4b7e-9a52-148437c2a4e2 req-118a244f-1bfb-47e8-ac11-88ff70468dea tempest-ServerActionsTestOtherA-634183357 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:05:50 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [req-6f2fbf88-a669-4b7e-9a52-148437c2a4e2 req-118a244f-1bfb-47e8-ac11-88ff70468dea tempest-ServerActionsTestOtherA-634183357 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.094s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:05:50 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [req-6f2fbf88-a669-4b7e-9a52-148437c2a4e2 req-118a244f-1bfb-47e8-ac11-88ff70468dea tempest-ServerActionsTestOtherA-634183357 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67', 'name': 'volume-ff9a5863-3f98-4ed2-8e0b-b6323204b916', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4f61ae20-5abc-4fd9-afb5-0781a7e85c14', 'enforce_multipath': True} {{(pid=86890) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:05:50 devstack cinder-volume[86890]: INFO cinder.volume.manager [req-6f2fbf88-a669-4b7e-9a52-148437c2a4e2 req-118a244f-1bfb-47e8-ac11-88ff70468dea tempest-ServerActionsTestOtherA-634183357 None] attachment_update completed successfully. Nov 02 10:05:56 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-302a3891-d64a-44fb-ac41-eea76550db54 tempest-VolumesActionsTest-355688864 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:05:56 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-302a3891-d64a-44fb-ac41-eea76550db54 tempest-VolumesActionsTest-355688864 None] Flow 'volume_create_manager' (30192633-ddde-4d43-8f75-6bd18df0043a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:05:56 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-302a3891-d64a-44fb-ac41-eea76550db54 tempest-VolumesActionsTest-355688864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f41c950-e25d-4cfb-b783-f706857284dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:05:56 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-302a3891-d64a-44fb-ac41-eea76550db54 tempest-VolumesActionsTest-355688864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f41c950-e25d-4cfb-b783-f706857284dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:05:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-857046841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c3344b1-54dc-477c-ad9f-0de1281416a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fee095d18d9419b960140531043b06b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:05:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:05:57Z,use_quota=True,user_id='80fda34e687840e191563730e0c26dfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:05:56 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-302a3891-d64a-44fb-ac41-eea76550db54 tempest-VolumesActionsTest-355688864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f3f9ee3-b544-414e-9e0a-a3bb6d4bbe8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:05:56 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-302a3891-d64a-44fb-ac41-eea76550db54 tempest-VolumesActionsTest-355688864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f3f9ee3-b544-414e-9e0a-a3bb6d4bbe8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:05:56 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-302a3891-d64a-44fb-ac41-eea76550db54 tempest-VolumesActionsTest-355688864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0c79d34-f176-47dc-942f-cdca14aea919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:05:56 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-302a3891-d64a-44fb-ac41-eea76550db54 tempest-VolumesActionsTest-355688864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0c79d34-f176-47dc-942f-cdca14aea919) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c3344b1-54dc-477c-ad9f-0de1281416a5', 'volume_name': 'volume-7c3344b1-54dc-477c-ad9f-0de1281416a5', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:05:57 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-302a3891-d64a-44fb-ac41-eea76550db54 tempest-VolumesActionsTest-355688864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20fce308-7858-4bbf-a445-2e23c3970d40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:05:57 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-302a3891-d64a-44fb-ac41-eea76550db54 tempest-VolumesActionsTest-355688864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20fce308-7858-4bbf-a445-2e23c3970d40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:05:57 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-302a3891-d64a-44fb-ac41-eea76550db54 tempest-VolumesActionsTest-355688864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82d57a5a-54a5-4c4c-aded-36e1189acaf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:05:57 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-302a3891-d64a-44fb-ac41-eea76550db54 tempest-VolumesActionsTest-355688864 None] Volume 7c3344b1-54dc-477c-ad9f-0de1281416a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c3344b1-54dc-477c-ad9f-0de1281416a5', 'volume_size': 1} Nov 02 10:05:57 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-302a3891-d64a-44fb-ac41-eea76550db54 tempest-VolumesActionsTest-355688864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:05:57 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-302a3891-d64a-44fb-ac41-eea76550db54 tempest-VolumesActionsTest-355688864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:05:57 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-302a3891-d64a-44fb-ac41-eea76550db54 tempest-VolumesActionsTest-355688864 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:05:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-857046841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c3344b1-54dc-477c-ad9f-0de1281416a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fee095d18d9419b960140531043b06b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:05:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:05:57Z,use_quota=True,user_id='80fda34e687840e191563730e0c26dfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:05:57 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-302a3891-d64a-44fb-ac41-eea76550db54 tempest-VolumesActionsTest-355688864 None] Creating volume 7c3344b1-54dc-477c-ad9f-0de1281416a5 {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:05:57 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-302a3891-d64a-44fb-ac41-eea76550db54 tempest-VolumesActionsTest-355688864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:05:57 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-302a3891-d64a-44fb-ac41-eea76550db54 tempest-VolumesActionsTest-355688864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:05:57 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-302a3891-d64a-44fb-ac41-eea76550db54 tempest-VolumesActionsTest-355688864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:05:57 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-302a3891-d64a-44fb-ac41-eea76550db54 tempest-VolumesActionsTest-355688864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:05:57 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-302a3891-d64a-44fb-ac41-eea76550db54 tempest-VolumesActionsTest-355688864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:05:57 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-302a3891-d64a-44fb-ac41-eea76550db54 tempest-VolumesActionsTest-355688864 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:05:57 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-302a3891-d64a-44fb-ac41-eea76550db54 tempest-VolumesActionsTest-355688864 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:05:57 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-302a3891-d64a-44fb-ac41-eea76550db54 tempest-VolumesActionsTest-355688864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-7c3344b1-54dc-477c-ad9f-0de1281416a5 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:57 devstack sudo[91318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-7c3344b1-54dc-477c-ad9f-0de1281416a5 1073741824 Nov 02 10:05:57 devstack sudo[91318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:57 devstack sudo[91318]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:57 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-302a3891-d64a-44fb-ac41-eea76550db54 tempest-VolumesActionsTest-355688864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-7c3344b1-54dc-477c-ad9f-0de1281416a5 1073741824" returned: 0 in 0.838s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:57 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-302a3891-d64a-44fb-ac41-eea76550db54 tempest-VolumesActionsTest-355688864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-7c3344b1-54dc-477c-ad9f-0de1281416a5 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:58 devstack sudo[91355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-7c3344b1-54dc-477c-ad9f-0de1281416a5 Nov 02 10:05:58 devstack sudo[91355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:58 devstack cinder-volume[86890]: INFO cinder.volume.manager [req-bd456691-bad0-41ea-a1cf-0a9a3a0013a3 req-82dc9ca6-58b3-4aca-8f45-adbbf0decfa5 tempest-ServerActionsTestOtherA-634183357 None] Terminate volume connection completed successfully. Nov 02 10:05:58 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [req-bd456691-bad0-41ea-a1cf-0a9a3a0013a3 req-82dc9ca6-58b3-4aca-8f45-adbbf0decfa5 tempest-ServerActionsTestOtherA-634183357 None] Deleting attachment 4f61ae20-5abc-4fd9-afb5-0781a7e85c14. {{(pid=86890) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:05:58 devstack sudo[91355]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:58 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-302a3891-d64a-44fb-ac41-eea76550db54 tempest-VolumesActionsTest-355688864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-7c3344b1-54dc-477c-ad9f-0de1281416a5" returned: 0 in 0.787s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:58 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-302a3891-d64a-44fb-ac41-eea76550db54 tempest-VolumesActionsTest-355688864 None] <== create_volume: return (1742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:05:58 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-302a3891-d64a-44fb-ac41-eea76550db54 tempest-VolumesActionsTest-355688864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.751s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:05:58 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-302a3891-d64a-44fb-ac41-eea76550db54 tempest-VolumesActionsTest-355688864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82d57a5a-54a5-4c4c-aded-36e1189acaf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c3344b1-54dc-477c-ad9f-0de1281416a5', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:05:58 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-302a3891-d64a-44fb-ac41-eea76550db54 tempest-VolumesActionsTest-355688864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f2e7ec4-b725-41d3-8177-81f1d137dfe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:05:58 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-302a3891-d64a-44fb-ac41-eea76550db54 tempest-VolumesActionsTest-355688864 None] Volume volume-7c3344b1-54dc-477c-ad9f-0de1281416a5 (7c3344b1-54dc-477c-ad9f-0de1281416a5): created successfully Nov 02 10:05:58 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-302a3891-d64a-44fb-ac41-eea76550db54 tempest-VolumesActionsTest-355688864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f2e7ec4-b725-41d3-8177-81f1d137dfe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:05:58 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-302a3891-d64a-44fb-ac41-eea76550db54 tempest-VolumesActionsTest-355688864 None] Flow 'volume_create_manager' (30192633-ddde-4d43-8f75-6bd18df0043a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:05:58 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-302a3891-d64a-44fb-ac41-eea76550db54 tempest-VolumesActionsTest-355688864 None] Created volume successfully. Nov 02 10:06:00 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-5de9a3c5-2e09-4b74-8899-81be14d7a61e tempest-VolumesActionsTest-355688864 None] Acquiring lock "cinder-7c3344b1-54dc-477c-ad9f-0de1281416a5" by "attach_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:06:00 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-5de9a3c5-2e09-4b74-8899-81be14d7a61e tempest-VolumesActionsTest-355688864 None] Lock "cinder-7c3344b1-54dc-477c-ad9f-0de1281416a5" acquired by "attach_volume" :: waited 0.065s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:06:00 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-5de9a3c5-2e09-4b74-8899-81be14d7a61e tempest-VolumesActionsTest-355688864 None] Attaching volume 7c3344b1-54dc-477c-ad9f-0de1281416a5 to instance 4ed65d27-03d0-4d0d-a6ff-d1fed2703a74 at mountpoint /dev/vdb on host None. Nov 02 10:06:00 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-5de9a3c5-2e09-4b74-8899-81be14d7a61e tempest-VolumesActionsTest-355688864 None] Attach volume completed successfully. Nov 02 10:06:00 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-5de9a3c5-2e09-4b74-8899-81be14d7a61e tempest-VolumesActionsTest-355688864 None] Lock "cinder-7c3344b1-54dc-477c-ad9f-0de1281416a5" released by "attach_volume" :: held 0.552s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:06:01 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [req-bd456691-bad0-41ea-a1cf-0a9a3a0013a3 req-4ca0d8e4-c713-421f-8027-09167187f9e3 tempest-ServerActionsTestOtherA-634183357 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:06:01 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [req-bd456691-bad0-41ea-a1cf-0a9a3a0013a3 req-4ca0d8e4-c713-421f-8027-09167187f9e3 tempest-ServerActionsTestOtherA-634183357 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:06:01 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [req-bd456691-bad0-41ea-a1cf-0a9a3a0013a3 req-4ca0d8e4-c713-421f-8027-09167187f9e3 tempest-ServerActionsTestOtherA-634183357 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.046s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:06:01 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [req-bd456691-bad0-41ea-a1cf-0a9a3a0013a3 req-4ca0d8e4-c713-421f-8027-09167187f9e3 tempest-ServerActionsTestOtherA-634183357 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67', 'name': 'volume-ff9a5863-3f98-4ed2-8e0b-b6323204b916', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'eeef60d2-4988-4306-bc25-32dce079cb3d', 'enforce_multipath': True} {{(pid=86890) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:06:01 devstack cinder-volume[86890]: INFO cinder.volume.manager [req-bd456691-bad0-41ea-a1cf-0a9a3a0013a3 req-4ca0d8e4-c713-421f-8027-09167187f9e3 tempest-ServerActionsTestOtherA-634183357 None] attachment_update completed successfully. Nov 02 10:06:03 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-040f6a34-dbd7-41c7-82b8-38db13284ea2 tempest-VolumesActionsTest-656454676 None] Terminate volume connection completed successfully. Nov 02 10:06:03 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-040f6a34-dbd7-41c7-82b8-38db13284ea2 tempest-VolumesActionsTest-656454676 None] Acquiring lock "cinder-7c3344b1-54dc-477c-ad9f-0de1281416a5-detach_volume" by "detach_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:06:03 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-040f6a34-dbd7-41c7-82b8-38db13284ea2 tempest-VolumesActionsTest-656454676 None] Lock "cinder-7c3344b1-54dc-477c-ad9f-0de1281416a5-detach_volume" acquired by "detach_volume" :: waited 0.061s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:06:03 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-040f6a34-dbd7-41c7-82b8-38db13284ea2 tempest-VolumesActionsTest-656454676 None] Detaching volume 7c3344b1-54dc-477c-ad9f-0de1281416a5 from instance 4ed65d27-03d0-4d0d-a6ff-d1fed2703a74. Nov 02 10:06:04 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-040f6a34-dbd7-41c7-82b8-38db13284ea2 tempest-VolumesActionsTest-656454676 None] Detach volume completed successfully. Nov 02 10:06:04 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-040f6a34-dbd7-41c7-82b8-38db13284ea2 tempest-VolumesActionsTest-656454676 None] Lock "cinder-7c3344b1-54dc-477c-ad9f-0de1281416a5-detach_volume" released by "detach_volume" :: held 0.217s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:06:04 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-b7422b48-0346-41e9-bf47-bf572d730171 tempest-VolumesActionsTest-355688864 None] Acquiring lock "cinder-7c3344b1-54dc-477c-ad9f-0de1281416a5-detach_volume" by "detach_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:06:04 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-b7422b48-0346-41e9-bf47-bf572d730171 tempest-VolumesActionsTest-355688864 None] Lock "cinder-7c3344b1-54dc-477c-ad9f-0de1281416a5-detach_volume" acquired by "detach_volume" :: waited 0.051s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:06:04 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-b7422b48-0346-41e9-bf47-bf572d730171 tempest-VolumesActionsTest-355688864 None] Volume detach called, but volume not attached. Nov 02 10:06:04 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-b7422b48-0346-41e9-bf47-bf572d730171 tempest-VolumesActionsTest-355688864 None] Lock "cinder-7c3344b1-54dc-477c-ad9f-0de1281416a5-detach_volume" released by "detach_volume" :: held 0.062s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:06:05 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-11b1aea5-685e-4f38-ba0c-fa25dc1fa14f tempest-VolumesActionsTest-355688864 None] Acquiring lock "cinder-7c3344b1-54dc-477c-ad9f-0de1281416a5-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:06:05 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-11b1aea5-685e-4f38-ba0c-fa25dc1fa14f tempest-VolumesActionsTest-355688864 None] Lock "cinder-7c3344b1-54dc-477c-ad9f-0de1281416a5-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:06:05 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-11b1aea5-685e-4f38-ba0c-fa25dc1fa14f tempest-VolumesActionsTest-355688864 None] Acquiring lock "cinder-quobyte-7c3344b1-54dc-477c-ad9f-0de1281416a5" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:06:05 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-11b1aea5-685e-4f38-ba0c-fa25dc1fa14f tempest-VolumesActionsTest-355688864 None] Lock "cinder-quobyte-7c3344b1-54dc-477c-ad9f-0de1281416a5" acquired by "delete_volume" :: waited 0.060s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:06:05 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[d429a5d6-50ae-4e9e-b697-2ee613196979]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:06:05 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-11b1aea5-685e-4f38-ba0c-fa25dc1fa14f tempest-VolumesActionsTest-355688864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-7c3344b1-54dc-477c-ad9f-0de1281416a5 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:05 devstack sudo[91503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-7c3344b1-54dc-477c-ad9f-0de1281416a5 Nov 02 10:06:05 devstack sudo[91503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:06 devstack sudo[91503]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:06 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-11b1aea5-685e-4f38-ba0c-fa25dc1fa14f tempest-VolumesActionsTest-355688864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-7c3344b1-54dc-477c-ad9f-0de1281416a5" returned: 0 in 0.653s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:06 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-11b1aea5-685e-4f38-ba0c-fa25dc1fa14f tempest-VolumesActionsTest-355688864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-7c3344b1-54dc-477c-ad9f-0de1281416a5 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:06 devstack sudo[91555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-7c3344b1-54dc-477c-ad9f-0de1281416a5 Nov 02 10:06:06 devstack sudo[91555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:06 devstack sudo[91555]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:06 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-11b1aea5-685e-4f38-ba0c-fa25dc1fa14f tempest-VolumesActionsTest-355688864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-7c3344b1-54dc-477c-ad9f-0de1281416a5" returned: 0 in 0.504s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:06 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-11b1aea5-685e-4f38-ba0c-fa25dc1fa14f tempest-VolumesActionsTest-355688864 None] Lock "cinder-quobyte-7c3344b1-54dc-477c-ad9f-0de1281416a5" released by "delete_volume" :: held 1.300s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:06:06 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-11b1aea5-685e-4f38-ba0c-fa25dc1fa14f tempest-VolumesActionsTest-355688864 None] Created reservations ['5f7adcdd-db6c-4679-b539-7fa619710360', '3f68d06c-13be-4d88-8605-a1d00b31257d', '2cfd8d92-7189-4660-997a-f750393e1ef3', '3eddb488-b161-434d-81f1-fcc78194a7f2'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:06:07 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-11b1aea5-685e-4f38-ba0c-fa25dc1fa14f tempest-VolumesActionsTest-355688864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:06:07 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-11b1aea5-685e-4f38-ba0c-fa25dc1fa14f tempest-VolumesActionsTest-355688864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:06:07 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-11b1aea5-685e-4f38-ba0c-fa25dc1fa14f tempest-VolumesActionsTest-355688864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:06:07 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-11b1aea5-685e-4f38-ba0c-fa25dc1fa14f tempest-VolumesActionsTest-355688864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:06:07 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-11b1aea5-685e-4f38-ba0c-fa25dc1fa14f tempest-VolumesActionsTest-355688864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:06:07 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-11b1aea5-685e-4f38-ba0c-fa25dc1fa14f tempest-VolumesActionsTest-355688864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:07 devstack sudo[91562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:06:07 devstack sudo[91562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:07 devstack sudo[91562]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:07 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-11b1aea5-685e-4f38-ba0c-fa25dc1fa14f tempest-VolumesActionsTest-355688864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.339s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:07 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-11b1aea5-685e-4f38-ba0c-fa25dc1fa14f tempest-VolumesActionsTest-355688864 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:06:07 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-11b1aea5-685e-4f38-ba0c-fa25dc1fa14f tempest-VolumesActionsTest-355688864 None] Deleted volume successfully. Nov 02 10:06:07 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-11b1aea5-685e-4f38-ba0c-fa25dc1fa14f tempest-VolumesActionsTest-355688864 None] Lock "cinder-7c3344b1-54dc-477c-ad9f-0de1281416a5-delete_volume" released by "delete_volume" :: held 2.126s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:06:07 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-24deb7e0-f11d-487f-aafb-367ee53da5a1 tempest-ServersNegativeTestJSON-313444455 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:06:07 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-24deb7e0-f11d-487f-aafb-367ee53da5a1 tempest-ServersNegativeTestJSON-313444455 None] Flow 'volume_create_manager' (402b4f2b-5583-4a79-bcba-25000f01d08d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:06:07 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-24deb7e0-f11d-487f-aafb-367ee53da5a1 tempest-ServersNegativeTestJSON-313444455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (096a4cb6-f7ec-4af9-b3f4-804115195313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:07 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-24deb7e0-f11d-487f-aafb-367ee53da5a1 tempest-ServersNegativeTestJSON-313444455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (096a4cb6-f7ec-4af9-b3f4-804115195313) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:06:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1369605164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1489a89c-9138-4c47-8932-7cba0a3fe177,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f0c0dbeea434b1b8210c2fb6ca0dcfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:06:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:06:07Z,use_quota=True,user_id='9fe69aa6072242dcaa58f67d226acb83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:07 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-24deb7e0-f11d-487f-aafb-367ee53da5a1 tempest-ServersNegativeTestJSON-313444455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13c665e5-83be-4834-b4be-6d1053056b3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:07 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-24deb7e0-f11d-487f-aafb-367ee53da5a1 tempest-ServersNegativeTestJSON-313444455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13c665e5-83be-4834-b4be-6d1053056b3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:07 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-24deb7e0-f11d-487f-aafb-367ee53da5a1 tempest-ServersNegativeTestJSON-313444455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8eabb063-0a41-4513-8d47-894c2d12e5c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:07 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-24deb7e0-f11d-487f-aafb-367ee53da5a1 tempest-ServersNegativeTestJSON-313444455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8eabb063-0a41-4513-8d47-894c2d12e5c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1489a89c-9138-4c47-8932-7cba0a3fe177', 'volume_name': 'volume-1489a89c-9138-4c47-8932-7cba0a3fe177', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:07 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-24deb7e0-f11d-487f-aafb-367ee53da5a1 tempest-ServersNegativeTestJSON-313444455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a56f8ef-4aff-4585-a1e7-c2e0bfa6b474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:07 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-24deb7e0-f11d-487f-aafb-367ee53da5a1 tempest-ServersNegativeTestJSON-313444455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a56f8ef-4aff-4585-a1e7-c2e0bfa6b474) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:07 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-24deb7e0-f11d-487f-aafb-367ee53da5a1 tempest-ServersNegativeTestJSON-313444455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10f905f6-8e8b-4144-af3f-84fb09834e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:07 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-24deb7e0-f11d-487f-aafb-367ee53da5a1 tempest-ServersNegativeTestJSON-313444455 None] Volume 1489a89c-9138-4c47-8932-7cba0a3fe177: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1489a89c-9138-4c47-8932-7cba0a3fe177', 'volume_size': 1} Nov 02 10:06:07 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-24deb7e0-f11d-487f-aafb-367ee53da5a1 tempest-ServersNegativeTestJSON-313444455 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:06:07 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-24deb7e0-f11d-487f-aafb-367ee53da5a1 tempest-ServersNegativeTestJSON-313444455 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:06:07 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-24deb7e0-f11d-487f-aafb-367ee53da5a1 tempest-ServersNegativeTestJSON-313444455 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:06:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1369605164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1489a89c-9138-4c47-8932-7cba0a3fe177,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f0c0dbeea434b1b8210c2fb6ca0dcfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:06:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:06:07Z,use_quota=True,user_id='9fe69aa6072242dcaa58f67d226acb83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:06:07 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-24deb7e0-f11d-487f-aafb-367ee53da5a1 tempest-ServersNegativeTestJSON-313444455 None] Creating volume 1489a89c-9138-4c47-8932-7cba0a3fe177 {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:06:07 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-24deb7e0-f11d-487f-aafb-367ee53da5a1 tempest-ServersNegativeTestJSON-313444455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:06:07 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-24deb7e0-f11d-487f-aafb-367ee53da5a1 tempest-ServersNegativeTestJSON-313444455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:06:07 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-24deb7e0-f11d-487f-aafb-367ee53da5a1 tempest-ServersNegativeTestJSON-313444455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:06:07 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-24deb7e0-f11d-487f-aafb-367ee53da5a1 tempest-ServersNegativeTestJSON-313444455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:06:07 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-24deb7e0-f11d-487f-aafb-367ee53da5a1 tempest-ServersNegativeTestJSON-313444455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:06:07 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-24deb7e0-f11d-487f-aafb-367ee53da5a1 tempest-ServersNegativeTestJSON-313444455 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:06:07 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-24deb7e0-f11d-487f-aafb-367ee53da5a1 tempest-ServersNegativeTestJSON-313444455 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:06:07 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-24deb7e0-f11d-487f-aafb-367ee53da5a1 tempest-ServersNegativeTestJSON-313444455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-1489a89c-9138-4c47-8932-7cba0a3fe177 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:07 devstack sudo[91567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-1489a89c-9138-4c47-8932-7cba0a3fe177 1073741824 Nov 02 10:06:07 devstack sudo[91567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:08 devstack sudo[91567]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:08 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-24deb7e0-f11d-487f-aafb-367ee53da5a1 tempest-ServersNegativeTestJSON-313444455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-1489a89c-9138-4c47-8932-7cba0a3fe177 1073741824" returned: 0 in 1.150s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:09 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-24deb7e0-f11d-487f-aafb-367ee53da5a1 tempest-ServersNegativeTestJSON-313444455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-1489a89c-9138-4c47-8932-7cba0a3fe177 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:09 devstack sudo[91591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-1489a89c-9138-4c47-8932-7cba0a3fe177 Nov 02 10:06:09 devstack sudo[91591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:09 devstack sudo[91591]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:09 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-24deb7e0-f11d-487f-aafb-367ee53da5a1 tempest-ServersNegativeTestJSON-313444455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-1489a89c-9138-4c47-8932-7cba0a3fe177" returned: 0 in 0.528s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:09 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-24deb7e0-f11d-487f-aafb-367ee53da5a1 tempest-ServersNegativeTestJSON-313444455 None] <== create_volume: return (1883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:06:09 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-24deb7e0-f11d-487f-aafb-367ee53da5a1 tempest-ServersNegativeTestJSON-313444455 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.896s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:06:09 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-24deb7e0-f11d-487f-aafb-367ee53da5a1 tempest-ServersNegativeTestJSON-313444455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10f905f6-8e8b-4144-af3f-84fb09834e71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1489a89c-9138-4c47-8932-7cba0a3fe177', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:09 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-24deb7e0-f11d-487f-aafb-367ee53da5a1 tempest-ServersNegativeTestJSON-313444455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a66176f2-f8e2-46cb-864b-d5fc8d2593fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:09 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-24deb7e0-f11d-487f-aafb-367ee53da5a1 tempest-ServersNegativeTestJSON-313444455 None] Volume volume-1489a89c-9138-4c47-8932-7cba0a3fe177 (1489a89c-9138-4c47-8932-7cba0a3fe177): created successfully Nov 02 10:06:09 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-24deb7e0-f11d-487f-aafb-367ee53da5a1 tempest-ServersNegativeTestJSON-313444455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a66176f2-f8e2-46cb-864b-d5fc8d2593fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:09 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-24deb7e0-f11d-487f-aafb-367ee53da5a1 tempest-ServersNegativeTestJSON-313444455 None] Flow 'volume_create_manager' (402b4f2b-5583-4a79-bcba-25000f01d08d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:06:09 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-24deb7e0-f11d-487f-aafb-367ee53da5a1 tempest-ServersNegativeTestJSON-313444455 None] Created volume successfully. Nov 02 10:06:12 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-96c949d3-0aae-4cd8-bb37-0c8abaeef989 tempest-ServersNegativeTestJSON-313444455 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:06:12 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-96c949d3-0aae-4cd8-bb37-0c8abaeef989 tempest-ServersNegativeTestJSON-313444455 None] Flow 'volume_create_manager' (ad126fb1-8848-43a4-9e91-acc4be868880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:06:12 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-96c949d3-0aae-4cd8-bb37-0c8abaeef989 tempest-ServersNegativeTestJSON-313444455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a97bc13-7719-48f0-b02f-3f1a05a0bc85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:12 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-96c949d3-0aae-4cd8-bb37-0c8abaeef989 tempest-ServersNegativeTestJSON-313444455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a97bc13-7719-48f0-b02f-3f1a05a0bc85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:06:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1745934554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ade6bf26-d529-4f3b-9d2f-cf44a2032b4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f0c0dbeea434b1b8210c2fb6ca0dcfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:06:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:06:12Z,use_quota=True,user_id='9fe69aa6072242dcaa58f67d226acb83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:12 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-96c949d3-0aae-4cd8-bb37-0c8abaeef989 tempest-ServersNegativeTestJSON-313444455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f0c45e4-19cf-40d3-94ee-6b1b031040ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:12 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-96c949d3-0aae-4cd8-bb37-0c8abaeef989 tempest-ServersNegativeTestJSON-313444455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f0c45e4-19cf-40d3-94ee-6b1b031040ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:12 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-96c949d3-0aae-4cd8-bb37-0c8abaeef989 tempest-ServersNegativeTestJSON-313444455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04a9abf4-63a3-430c-8e77-20f04da75376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:12 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-96c949d3-0aae-4cd8-bb37-0c8abaeef989 tempest-ServersNegativeTestJSON-313444455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04a9abf4-63a3-430c-8e77-20f04da75376) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ade6bf26-d529-4f3b-9d2f-cf44a2032b4e', 'volume_name': 'volume-ade6bf26-d529-4f3b-9d2f-cf44a2032b4e', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:12 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-96c949d3-0aae-4cd8-bb37-0c8abaeef989 tempest-ServersNegativeTestJSON-313444455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac642e8a-8751-49ef-8c21-232e23d12292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:12 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-96c949d3-0aae-4cd8-bb37-0c8abaeef989 tempest-ServersNegativeTestJSON-313444455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac642e8a-8751-49ef-8c21-232e23d12292) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:12 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-96c949d3-0aae-4cd8-bb37-0c8abaeef989 tempest-ServersNegativeTestJSON-313444455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02270e54-6391-4934-9792-76d7adcdb23f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:12 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-96c949d3-0aae-4cd8-bb37-0c8abaeef989 tempest-ServersNegativeTestJSON-313444455 None] Volume ade6bf26-d529-4f3b-9d2f-cf44a2032b4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ade6bf26-d529-4f3b-9d2f-cf44a2032b4e', 'volume_size': 1} Nov 02 10:06:12 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-96c949d3-0aae-4cd8-bb37-0c8abaeef989 tempest-ServersNegativeTestJSON-313444455 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:06:12 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-96c949d3-0aae-4cd8-bb37-0c8abaeef989 tempest-ServersNegativeTestJSON-313444455 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:06:12 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-96c949d3-0aae-4cd8-bb37-0c8abaeef989 tempest-ServersNegativeTestJSON-313444455 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:06:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1745934554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ade6bf26-d529-4f3b-9d2f-cf44a2032b4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f0c0dbeea434b1b8210c2fb6ca0dcfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:06:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:06:12Z,use_quota=True,user_id='9fe69aa6072242dcaa58f67d226acb83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:06:12 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-96c949d3-0aae-4cd8-bb37-0c8abaeef989 tempest-ServersNegativeTestJSON-313444455 None] Creating volume ade6bf26-d529-4f3b-9d2f-cf44a2032b4e {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:06:12 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-96c949d3-0aae-4cd8-bb37-0c8abaeef989 tempest-ServersNegativeTestJSON-313444455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:06:12 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-96c949d3-0aae-4cd8-bb37-0c8abaeef989 tempest-ServersNegativeTestJSON-313444455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:06:12 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-96c949d3-0aae-4cd8-bb37-0c8abaeef989 tempest-ServersNegativeTestJSON-313444455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:06:12 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-96c949d3-0aae-4cd8-bb37-0c8abaeef989 tempest-ServersNegativeTestJSON-313444455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:06:12 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-96c949d3-0aae-4cd8-bb37-0c8abaeef989 tempest-ServersNegativeTestJSON-313444455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:06:12 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-96c949d3-0aae-4cd8-bb37-0c8abaeef989 tempest-ServersNegativeTestJSON-313444455 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:06:12 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-96c949d3-0aae-4cd8-bb37-0c8abaeef989 tempest-ServersNegativeTestJSON-313444455 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:06:12 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-96c949d3-0aae-4cd8-bb37-0c8abaeef989 tempest-ServersNegativeTestJSON-313444455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ade6bf26-d529-4f3b-9d2f-cf44a2032b4e 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:12 devstack sudo[91603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ade6bf26-d529-4f3b-9d2f-cf44a2032b4e 1073741824 Nov 02 10:06:12 devstack sudo[91603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:12 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9e1824a-f590-43be-9a50-f3d4810e5c61 tempest-VolumesActionsTest-355688864 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:06:12 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-b9e1824a-f590-43be-9a50-f3d4810e5c61 tempest-VolumesActionsTest-355688864 None] Flow 'volume_create_manager' (9e8d5591-2989-40da-a6f9-bab039db37b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:06:12 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-b9e1824a-f590-43be-9a50-f3d4810e5c61 tempest-VolumesActionsTest-355688864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76ec192b-362b-41e0-bc2e-3dd293d922d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:12 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-b9e1824a-f590-43be-9a50-f3d4810e5c61 tempest-VolumesActionsTest-355688864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76ec192b-362b-41e0-bc2e-3dd293d922d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:06:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1031454885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6527e3a4-76e7-4ab7-96ea-d14eb350948c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fee095d18d9419b960140531043b06b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:06:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:06:13Z,use_quota=True,user_id='80fda34e687840e191563730e0c26dfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:12 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-b9e1824a-f590-43be-9a50-f3d4810e5c61 tempest-VolumesActionsTest-355688864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (843ffa6a-c66b-4865-94f3-5b33ff37d8c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:12 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-b9e1824a-f590-43be-9a50-f3d4810e5c61 tempest-VolumesActionsTest-355688864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (843ffa6a-c66b-4865-94f3-5b33ff37d8c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:12 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-b9e1824a-f590-43be-9a50-f3d4810e5c61 tempest-VolumesActionsTest-355688864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (154c5ce2-a6a6-4a72-bc92-65687f200c41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:12 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-b9e1824a-f590-43be-9a50-f3d4810e5c61 tempest-VolumesActionsTest-355688864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (154c5ce2-a6a6-4a72-bc92-65687f200c41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6527e3a4-76e7-4ab7-96ea-d14eb350948c', 'volume_name': 'volume-6527e3a4-76e7-4ab7-96ea-d14eb350948c', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:12 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-b9e1824a-f590-43be-9a50-f3d4810e5c61 tempest-VolumesActionsTest-355688864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (977fddde-9384-4c05-a790-5d83faaf05db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:12 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-b9e1824a-f590-43be-9a50-f3d4810e5c61 tempest-VolumesActionsTest-355688864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (977fddde-9384-4c05-a790-5d83faaf05db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:12 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-b9e1824a-f590-43be-9a50-f3d4810e5c61 tempest-VolumesActionsTest-355688864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3210068f-d9d8-418d-b7d7-c6535f60c03a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:12 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-b9e1824a-f590-43be-9a50-f3d4810e5c61 tempest-VolumesActionsTest-355688864 None] Volume 6527e3a4-76e7-4ab7-96ea-d14eb350948c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6527e3a4-76e7-4ab7-96ea-d14eb350948c', 'volume_size': 1} Nov 02 10:06:12 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-b9e1824a-f590-43be-9a50-f3d4810e5c61 tempest-VolumesActionsTest-355688864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:06:12 devstack sudo[91603]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:12 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-96c949d3-0aae-4cd8-bb37-0c8abaeef989 tempest-ServersNegativeTestJSON-313444455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ade6bf26-d529-4f3b-9d2f-cf44a2032b4e 1073741824" returned: 0 in 0.420s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:12 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-96c949d3-0aae-4cd8-bb37-0c8abaeef989 tempest-ServersNegativeTestJSON-313444455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ade6bf26-d529-4f3b-9d2f-cf44a2032b4e {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:13 devstack sudo[91608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ade6bf26-d529-4f3b-9d2f-cf44a2032b4e Nov 02 10:06:13 devstack sudo[91608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:13 devstack sudo[91608]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:13 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-96c949d3-0aae-4cd8-bb37-0c8abaeef989 tempest-ServersNegativeTestJSON-313444455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ade6bf26-d529-4f3b-9d2f-cf44a2032b4e" returned: 0 in 0.257s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:13 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-96c949d3-0aae-4cd8-bb37-0c8abaeef989 tempest-ServersNegativeTestJSON-313444455 None] <== create_volume: return (714ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:06:13 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-96c949d3-0aae-4cd8-bb37-0c8abaeef989 tempest-ServersNegativeTestJSON-313444455 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.719s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:06:13 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-b9e1824a-f590-43be-9a50-f3d4810e5c61 tempest-VolumesActionsTest-355688864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.580s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:06:13 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-b9e1824a-f590-43be-9a50-f3d4810e5c61 tempest-VolumesActionsTest-355688864 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:06:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1031454885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6527e3a4-76e7-4ab7-96ea-d14eb350948c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fee095d18d9419b960140531043b06b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:06:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:06:13Z,use_quota=True,user_id='80fda34e687840e191563730e0c26dfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:06:13 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-b9e1824a-f590-43be-9a50-f3d4810e5c61 tempest-VolumesActionsTest-355688864 None] Creating volume 6527e3a4-76e7-4ab7-96ea-d14eb350948c {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:06:13 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-b9e1824a-f590-43be-9a50-f3d4810e5c61 tempest-VolumesActionsTest-355688864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:06:13 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-b9e1824a-f590-43be-9a50-f3d4810e5c61 tempest-VolumesActionsTest-355688864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:06:13 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-b9e1824a-f590-43be-9a50-f3d4810e5c61 tempest-VolumesActionsTest-355688864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:06:13 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-b9e1824a-f590-43be-9a50-f3d4810e5c61 tempest-VolumesActionsTest-355688864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:06:13 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-b9e1824a-f590-43be-9a50-f3d4810e5c61 tempest-VolumesActionsTest-355688864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:06:13 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-b9e1824a-f590-43be-9a50-f3d4810e5c61 tempest-VolumesActionsTest-355688864 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:06:13 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-b9e1824a-f590-43be-9a50-f3d4810e5c61 tempest-VolumesActionsTest-355688864 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:06:13 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-b9e1824a-f590-43be-9a50-f3d4810e5c61 tempest-VolumesActionsTest-355688864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-6527e3a4-76e7-4ab7-96ea-d14eb350948c 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:13 devstack sudo[91612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-6527e3a4-76e7-4ab7-96ea-d14eb350948c 1073741824 Nov 02 10:06:13 devstack sudo[91612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:13 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-96c949d3-0aae-4cd8-bb37-0c8abaeef989 tempest-ServersNegativeTestJSON-313444455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02270e54-6391-4934-9792-76d7adcdb23f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ade6bf26-d529-4f3b-9d2f-cf44a2032b4e', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:13 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-96c949d3-0aae-4cd8-bb37-0c8abaeef989 tempest-ServersNegativeTestJSON-313444455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4333a077-826b-4cb9-a9b5-9e5e0c1d14c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:13 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-96c949d3-0aae-4cd8-bb37-0c8abaeef989 tempest-ServersNegativeTestJSON-313444455 None] Volume volume-ade6bf26-d529-4f3b-9d2f-cf44a2032b4e (ade6bf26-d529-4f3b-9d2f-cf44a2032b4e): created successfully Nov 02 10:06:13 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-96c949d3-0aae-4cd8-bb37-0c8abaeef989 tempest-ServersNegativeTestJSON-313444455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4333a077-826b-4cb9-a9b5-9e5e0c1d14c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:13 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-96c949d3-0aae-4cd8-bb37-0c8abaeef989 tempest-ServersNegativeTestJSON-313444455 None] Flow 'volume_create_manager' (ad126fb1-8848-43a4-9e91-acc4be868880) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:06:13 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-96c949d3-0aae-4cd8-bb37-0c8abaeef989 tempest-ServersNegativeTestJSON-313444455 None] Created volume successfully. Nov 02 10:06:13 devstack sudo[91612]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:13 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-b9e1824a-f590-43be-9a50-f3d4810e5c61 tempest-VolumesActionsTest-355688864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-6527e3a4-76e7-4ab7-96ea-d14eb350948c 1073741824" returned: 0 in 0.436s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:13 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-b9e1824a-f590-43be-9a50-f3d4810e5c61 tempest-VolumesActionsTest-355688864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-6527e3a4-76e7-4ab7-96ea-d14eb350948c {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:13 devstack sudo[91617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-6527e3a4-76e7-4ab7-96ea-d14eb350948c Nov 02 10:06:13 devstack sudo[91617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:14 devstack sudo[91617]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:14 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-b9e1824a-f590-43be-9a50-f3d4810e5c61 tempest-VolumesActionsTest-355688864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-6527e3a4-76e7-4ab7-96ea-d14eb350948c" returned: 0 in 0.287s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:14 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-b9e1824a-f590-43be-9a50-f3d4810e5c61 tempest-VolumesActionsTest-355688864 None] <== create_volume: return (772ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:06:14 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-b9e1824a-f590-43be-9a50-f3d4810e5c61 tempest-VolumesActionsTest-355688864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.776s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:06:14 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-b9e1824a-f590-43be-9a50-f3d4810e5c61 tempest-VolumesActionsTest-355688864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3210068f-d9d8-418d-b7d7-c6535f60c03a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6527e3a4-76e7-4ab7-96ea-d14eb350948c', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:14 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-b9e1824a-f590-43be-9a50-f3d4810e5c61 tempest-VolumesActionsTest-355688864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0145d5eb-604c-47e0-8d92-1115b45d75f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:14 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-b9e1824a-f590-43be-9a50-f3d4810e5c61 tempest-VolumesActionsTest-355688864 None] Volume volume-6527e3a4-76e7-4ab7-96ea-d14eb350948c (6527e3a4-76e7-4ab7-96ea-d14eb350948c): created successfully Nov 02 10:06:14 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-b9e1824a-f590-43be-9a50-f3d4810e5c61 tempest-VolumesActionsTest-355688864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0145d5eb-604c-47e0-8d92-1115b45d75f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:14 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-b9e1824a-f590-43be-9a50-f3d4810e5c61 tempest-VolumesActionsTest-355688864 None] Flow 'volume_create_manager' (9e8d5591-2989-40da-a6f9-bab039db37b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:06:14 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-b9e1824a-f590-43be-9a50-f3d4810e5c61 tempest-VolumesActionsTest-355688864 None] Created volume successfully. Nov 02 10:06:14 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-5ab666b8-d58f-43de-9905-89ff5440afc0 tempest-VolumesActionsTest-656454676 None] Acquiring lock "cinder-6527e3a4-76e7-4ab7-96ea-d14eb350948c-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:06:14 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-5ab666b8-d58f-43de-9905-89ff5440afc0 tempest-VolumesActionsTest-656454676 None] Lock "cinder-6527e3a4-76e7-4ab7-96ea-d14eb350948c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:06:14 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-597ae934-49b0-4888-8d93-337b5fd6a763 tempest-ServersNegativeTestJSON-313444455 None] Acquiring lock "cinder-ade6bf26-d529-4f3b-9d2f-cf44a2032b4e-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:06:14 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-5ab666b8-d58f-43de-9905-89ff5440afc0 tempest-VolumesActionsTest-656454676 None] Acquiring lock "cinder-quobyte-6527e3a4-76e7-4ab7-96ea-d14eb350948c" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:06:14 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-597ae934-49b0-4888-8d93-337b5fd6a763 tempest-ServersNegativeTestJSON-313444455 None] Lock "cinder-ade6bf26-d529-4f3b-9d2f-cf44a2032b4e-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:06:14 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-5ab666b8-d58f-43de-9905-89ff5440afc0 tempest-VolumesActionsTest-656454676 None] Lock "cinder-quobyte-6527e3a4-76e7-4ab7-96ea-d14eb350948c" acquired by "delete_volume" :: waited 0.062s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:06:14 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[90b6c923-a500-4e41-847f-2eeccae57883]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:06:14 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-5ab666b8-d58f-43de-9905-89ff5440afc0 tempest-VolumesActionsTest-656454676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-6527e3a4-76e7-4ab7-96ea-d14eb350948c {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:14 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-597ae934-49b0-4888-8d93-337b5fd6a763 tempest-ServersNegativeTestJSON-313444455 None] Acquiring lock "cinder-quobyte-ade6bf26-d529-4f3b-9d2f-cf44a2032b4e" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:06:14 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-597ae934-49b0-4888-8d93-337b5fd6a763 tempest-ServersNegativeTestJSON-313444455 None] Lock "cinder-quobyte-ade6bf26-d529-4f3b-9d2f-cf44a2032b4e" acquired by "delete_volume" :: waited 0.020s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:06:15 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[472442bb-17cb-466b-a4f4-4ac8ed2d64e6]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:06:15 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-597ae934-49b0-4888-8d93-337b5fd6a763 tempest-ServersNegativeTestJSON-313444455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ade6bf26-d529-4f3b-9d2f-cf44a2032b4e {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:15 devstack sudo[91624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-6527e3a4-76e7-4ab7-96ea-d14eb350948c Nov 02 10:06:15 devstack sudo[91624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:15 devstack sudo[91628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ade6bf26-d529-4f3b-9d2f-cf44a2032b4e Nov 02 10:06:15 devstack sudo[91628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:15 devstack sudo[91624]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:15 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-5ab666b8-d58f-43de-9905-89ff5440afc0 tempest-VolumesActionsTest-656454676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-6527e3a4-76e7-4ab7-96ea-d14eb350948c" returned: 0 in 0.385s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:15 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-5ab666b8-d58f-43de-9905-89ff5440afc0 tempest-VolumesActionsTest-656454676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-6527e3a4-76e7-4ab7-96ea-d14eb350948c {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:15 devstack sudo[91636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-6527e3a4-76e7-4ab7-96ea-d14eb350948c Nov 02 10:06:15 devstack sudo[91636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:15 devstack sudo[91628]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:15 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-597ae934-49b0-4888-8d93-337b5fd6a763 tempest-ServersNegativeTestJSON-313444455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ade6bf26-d529-4f3b-9d2f-cf44a2032b4e" returned: 0 in 0.394s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:15 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-597ae934-49b0-4888-8d93-337b5fd6a763 tempest-ServersNegativeTestJSON-313444455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ade6bf26-d529-4f3b-9d2f-cf44a2032b4e {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:15 devstack sudo[91639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ade6bf26-d529-4f3b-9d2f-cf44a2032b4e Nov 02 10:06:15 devstack sudo[91639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:15 devstack sudo[91636]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:15 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-5ab666b8-d58f-43de-9905-89ff5440afc0 tempest-VolumesActionsTest-656454676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-6527e3a4-76e7-4ab7-96ea-d14eb350948c" returned: 0 in 0.300s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:15 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-5ab666b8-d58f-43de-9905-89ff5440afc0 tempest-VolumesActionsTest-656454676 None] Lock "cinder-quobyte-6527e3a4-76e7-4ab7-96ea-d14eb350948c" released by "delete_volume" :: held 0.755s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:06:15 devstack sudo[91639]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:15 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-5ab666b8-d58f-43de-9905-89ff5440afc0 tempest-VolumesActionsTest-656454676 None] Created reservations ['1fd64345-81f2-4b0b-aef3-862362cfcdd3', '75e747a9-0f90-49fa-9781-36db8237fc7e', '045d36c2-25da-4b6b-80f6-a7b8dca4c88e', '4f9707e5-da47-44b8-b036-f554652df901'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:06:15 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-597ae934-49b0-4888-8d93-337b5fd6a763 tempest-ServersNegativeTestJSON-313444455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ade6bf26-d529-4f3b-9d2f-cf44a2032b4e" returned: 0 in 0.304s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:15 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-597ae934-49b0-4888-8d93-337b5fd6a763 tempest-ServersNegativeTestJSON-313444455 None] Lock "cinder-quobyte-ade6bf26-d529-4f3b-9d2f-cf44a2032b4e" released by "delete_volume" :: held 0.746s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:06:15 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-5ab666b8-d58f-43de-9905-89ff5440afc0 tempest-VolumesActionsTest-656454676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:06:15 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-5ab666b8-d58f-43de-9905-89ff5440afc0 tempest-VolumesActionsTest-656454676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:06:15 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-5ab666b8-d58f-43de-9905-89ff5440afc0 tempest-VolumesActionsTest-656454676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:06:15 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-5ab666b8-d58f-43de-9905-89ff5440afc0 tempest-VolumesActionsTest-656454676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:06:15 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-5ab666b8-d58f-43de-9905-89ff5440afc0 tempest-VolumesActionsTest-656454676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:06:15 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-5ab666b8-d58f-43de-9905-89ff5440afc0 tempest-VolumesActionsTest-656454676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:15 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-597ae934-49b0-4888-8d93-337b5fd6a763 tempest-ServersNegativeTestJSON-313444455 None] Created reservations ['5311fc8f-1c98-426e-92a0-e2e7a68a308e', '25d1031a-76e2-4b31-8660-a87f18ae467c', '5ec17f99-76d1-4e1e-b3e6-b87f276495fb', '5d9ecded-eef9-4faa-82a3-8260b6db088a'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:06:15 devstack sudo[91643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:06:15 devstack sudo[91643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:15 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-597ae934-49b0-4888-8d93-337b5fd6a763 tempest-ServersNegativeTestJSON-313444455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:06:15 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-597ae934-49b0-4888-8d93-337b5fd6a763 tempest-ServersNegativeTestJSON-313444455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:06:15 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-597ae934-49b0-4888-8d93-337b5fd6a763 tempest-ServersNegativeTestJSON-313444455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:06:15 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-597ae934-49b0-4888-8d93-337b5fd6a763 tempest-ServersNegativeTestJSON-313444455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:06:15 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-597ae934-49b0-4888-8d93-337b5fd6a763 tempest-ServersNegativeTestJSON-313444455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:06:15 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-597ae934-49b0-4888-8d93-337b5fd6a763 tempest-ServersNegativeTestJSON-313444455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:16 devstack sudo[91645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:06:16 devstack sudo[91645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:16 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-52bddffc-fa76-4ff7-809d-417281467fe0 tempest-ServersNegativeTestJSON-313444455 None] Acquiring lock "cinder-1489a89c-9138-4c47-8932-7cba0a3fe177-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:06:16 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-52bddffc-fa76-4ff7-809d-417281467fe0 tempest-ServersNegativeTestJSON-313444455 None] Lock "cinder-1489a89c-9138-4c47-8932-7cba0a3fe177-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:06:16 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-52bddffc-fa76-4ff7-809d-417281467fe0 tempest-ServersNegativeTestJSON-313444455 None] Acquiring lock "cinder-quobyte-1489a89c-9138-4c47-8932-7cba0a3fe177" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:06:16 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-52bddffc-fa76-4ff7-809d-417281467fe0 tempest-ServersNegativeTestJSON-313444455 None] Lock "cinder-quobyte-1489a89c-9138-4c47-8932-7cba0a3fe177" acquired by "delete_volume" :: waited 0.037s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:06:16 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[deb5a91b-4801-4522-9830-a19e53452ad6]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:06:16 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-52bddffc-fa76-4ff7-809d-417281467fe0 tempest-ServersNegativeTestJSON-313444455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-1489a89c-9138-4c47-8932-7cba0a3fe177 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:16 devstack sudo[91643]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:16 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-5ab666b8-d58f-43de-9905-89ff5440afc0 tempest-VolumesActionsTest-656454676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.528s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:16 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-5ab666b8-d58f-43de-9905-89ff5440afc0 tempest-VolumesActionsTest-656454676 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:06:16 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-5ab666b8-d58f-43de-9905-89ff5440afc0 tempest-VolumesActionsTest-656454676 None] Deleted volume successfully. Nov 02 10:06:16 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-5ab666b8-d58f-43de-9905-89ff5440afc0 tempest-VolumesActionsTest-656454676 None] Lock "cinder-6527e3a4-76e7-4ab7-96ea-d14eb350948c-delete_volume" released by "delete_volume" :: held 1.691s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:06:16 devstack sudo[91648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-1489a89c-9138-4c47-8932-7cba0a3fe177 Nov 02 10:06:16 devstack sudo[91648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:16 devstack sudo[91645]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:16 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-597ae934-49b0-4888-8d93-337b5fd6a763 tempest-ServersNegativeTestJSON-313444455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.639s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:16 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-597ae934-49b0-4888-8d93-337b5fd6a763 tempest-ServersNegativeTestJSON-313444455 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:06:16 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-597ae934-49b0-4888-8d93-337b5fd6a763 tempest-ServersNegativeTestJSON-313444455 None] Deleted volume successfully. Nov 02 10:06:16 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-597ae934-49b0-4888-8d93-337b5fd6a763 tempest-ServersNegativeTestJSON-313444455 None] Lock "cinder-ade6bf26-d529-4f3b-9d2f-cf44a2032b4e-delete_volume" released by "delete_volume" :: held 1.805s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:06:16 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0b01488-c275-4848-ab3b-46ad09ec44ed tempest-VolumesActionsTest-355688864 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:06:16 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c0b01488-c275-4848-ab3b-46ad09ec44ed tempest-VolumesActionsTest-355688864 None] Flow 'volume_create_manager' (20300c2f-3239-4aa7-ac1b-e9845d402d21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:06:16 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c0b01488-c275-4848-ab3b-46ad09ec44ed tempest-VolumesActionsTest-355688864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d911197a-84ed-439a-b305-f238853714cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:16 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c0b01488-c275-4848-ab3b-46ad09ec44ed tempest-VolumesActionsTest-355688864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d911197a-84ed-439a-b305-f238853714cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:06:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1070978482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b5c341b-5a85-46cc-918b-3a4f3c033cf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fee095d18d9419b960140531043b06b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:06:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:06:17Z,use_quota=True,user_id='80fda34e687840e191563730e0c26dfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:16 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c0b01488-c275-4848-ab3b-46ad09ec44ed tempest-VolumesActionsTest-355688864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2328b798-c0a2-4e07-bda6-9ae1b06d8f97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:16 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c0b01488-c275-4848-ab3b-46ad09ec44ed tempest-VolumesActionsTest-355688864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2328b798-c0a2-4e07-bda6-9ae1b06d8f97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:16 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c0b01488-c275-4848-ab3b-46ad09ec44ed tempest-VolumesActionsTest-355688864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43699d6c-53df-4847-ad51-79dd593fb564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:16 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c0b01488-c275-4848-ab3b-46ad09ec44ed tempest-VolumesActionsTest-355688864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43699d6c-53df-4847-ad51-79dd593fb564) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b5c341b-5a85-46cc-918b-3a4f3c033cf1', 'volume_name': 'volume-1b5c341b-5a85-46cc-918b-3a4f3c033cf1', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:16 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c0b01488-c275-4848-ab3b-46ad09ec44ed tempest-VolumesActionsTest-355688864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fdd995b-f466-47bb-80e8-b65937b67b84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:16 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c0b01488-c275-4848-ab3b-46ad09ec44ed tempest-VolumesActionsTest-355688864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fdd995b-f466-47bb-80e8-b65937b67b84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:16 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c0b01488-c275-4848-ab3b-46ad09ec44ed tempest-VolumesActionsTest-355688864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b6b6912-6abd-4b0a-b730-d2b3de672534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:16 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-c0b01488-c275-4848-ab3b-46ad09ec44ed tempest-VolumesActionsTest-355688864 None] Volume 1b5c341b-5a85-46cc-918b-3a4f3c033cf1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b5c341b-5a85-46cc-918b-3a4f3c033cf1', 'volume_size': 1} Nov 02 10:06:16 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c0b01488-c275-4848-ab3b-46ad09ec44ed tempest-VolumesActionsTest-355688864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:06:16 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c0b01488-c275-4848-ab3b-46ad09ec44ed tempest-VolumesActionsTest-355688864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:06:16 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c0b01488-c275-4848-ab3b-46ad09ec44ed tempest-VolumesActionsTest-355688864 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:06:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1070978482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b5c341b-5a85-46cc-918b-3a4f3c033cf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fee095d18d9419b960140531043b06b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:06:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:06:17Z,use_quota=True,user_id='80fda34e687840e191563730e0c26dfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:06:16 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-c0b01488-c275-4848-ab3b-46ad09ec44ed tempest-VolumesActionsTest-355688864 None] Creating volume 1b5c341b-5a85-46cc-918b-3a4f3c033cf1 {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:06:16 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c0b01488-c275-4848-ab3b-46ad09ec44ed tempest-VolumesActionsTest-355688864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:06:16 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c0b01488-c275-4848-ab3b-46ad09ec44ed tempest-VolumesActionsTest-355688864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:06:16 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c0b01488-c275-4848-ab3b-46ad09ec44ed tempest-VolumesActionsTest-355688864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:06:16 devstack sudo[91648]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:16 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c0b01488-c275-4848-ab3b-46ad09ec44ed tempest-VolumesActionsTest-355688864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:06:16 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c0b01488-c275-4848-ab3b-46ad09ec44ed tempest-VolumesActionsTest-355688864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:06:16 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c0b01488-c275-4848-ab3b-46ad09ec44ed tempest-VolumesActionsTest-355688864 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:06:16 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-c0b01488-c275-4848-ab3b-46ad09ec44ed tempest-VolumesActionsTest-355688864 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:06:16 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c0b01488-c275-4848-ab3b-46ad09ec44ed tempest-VolumesActionsTest-355688864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-1b5c341b-5a85-46cc-918b-3a4f3c033cf1 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:16 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-52bddffc-fa76-4ff7-809d-417281467fe0 tempest-ServersNegativeTestJSON-313444455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-1489a89c-9138-4c47-8932-7cba0a3fe177" returned: 0 in 0.550s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:16 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-52bddffc-fa76-4ff7-809d-417281467fe0 tempest-ServersNegativeTestJSON-313444455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-1489a89c-9138-4c47-8932-7cba0a3fe177 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:16 devstack sudo[91656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-1b5c341b-5a85-46cc-918b-3a4f3c033cf1 1073741824 Nov 02 10:06:16 devstack sudo[91656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:16 devstack sudo[91657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-1489a89c-9138-4c47-8932-7cba0a3fe177 Nov 02 10:06:16 devstack sudo[91657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:17 devstack sudo[91657]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:17 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-52bddffc-fa76-4ff7-809d-417281467fe0 tempest-ServersNegativeTestJSON-313444455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-1489a89c-9138-4c47-8932-7cba0a3fe177" returned: 0 in 0.274s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:17 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-52bddffc-fa76-4ff7-809d-417281467fe0 tempest-ServersNegativeTestJSON-313444455 None] Lock "cinder-quobyte-1489a89c-9138-4c47-8932-7cba0a3fe177" released by "delete_volume" :: held 0.907s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:06:17 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-52bddffc-fa76-4ff7-809d-417281467fe0 tempest-ServersNegativeTestJSON-313444455 None] Created reservations ['aae33870-e02a-4d6e-a3c3-9bff93ab7fdd', '6a8bafbf-20a4-4128-a84e-b023f6d520e5', 'b5d8699d-1830-4c68-b781-96a4b528a2d8', '406061d9-4b78-4c0d-b4bb-1977287369c4'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:06:17 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-52bddffc-fa76-4ff7-809d-417281467fe0 tempest-ServersNegativeTestJSON-313444455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:06:17 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-52bddffc-fa76-4ff7-809d-417281467fe0 tempest-ServersNegativeTestJSON-313444455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:06:17 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-52bddffc-fa76-4ff7-809d-417281467fe0 tempest-ServersNegativeTestJSON-313444455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:06:17 devstack sudo[91656]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:17 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-52bddffc-fa76-4ff7-809d-417281467fe0 tempest-ServersNegativeTestJSON-313444455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:06:17 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-52bddffc-fa76-4ff7-809d-417281467fe0 tempest-ServersNegativeTestJSON-313444455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:06:17 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-52bddffc-fa76-4ff7-809d-417281467fe0 tempest-ServersNegativeTestJSON-313444455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:17 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c0b01488-c275-4848-ab3b-46ad09ec44ed tempest-VolumesActionsTest-355688864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-1b5c341b-5a85-46cc-918b-3a4f3c033cf1 1073741824" returned: 0 in 0.500s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:17 devstack sudo[91665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:06:17 devstack sudo[91665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:17 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c0b01488-c275-4848-ab3b-46ad09ec44ed tempest-VolumesActionsTest-355688864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-1b5c341b-5a85-46cc-918b-3a4f3c033cf1 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:17 devstack sudo[91667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-1b5c341b-5a85-46cc-918b-3a4f3c033cf1 Nov 02 10:06:17 devstack sudo[91667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:17 devstack sudo[91665]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:17 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-52bddffc-fa76-4ff7-809d-417281467fe0 tempest-ServersNegativeTestJSON-313444455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.317s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:17 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-52bddffc-fa76-4ff7-809d-417281467fe0 tempest-ServersNegativeTestJSON-313444455 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:06:17 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-52bddffc-fa76-4ff7-809d-417281467fe0 tempest-ServersNegativeTestJSON-313444455 None] Deleted volume successfully. Nov 02 10:06:17 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-52bddffc-fa76-4ff7-809d-417281467fe0 tempest-ServersNegativeTestJSON-313444455 None] Lock "cinder-1489a89c-9138-4c47-8932-7cba0a3fe177-delete_volume" released by "delete_volume" :: held 1.576s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:06:17 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c0b01488-c275-4848-ab3b-46ad09ec44ed tempest-VolumesActionsTest-355688864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-1b5c341b-5a85-46cc-918b-3a4f3c033cf1" returned: 0 in 0.403s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:17 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c0b01488-c275-4848-ab3b-46ad09ec44ed tempest-VolumesActionsTest-355688864 None] <== create_volume: return (968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:06:17 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c0b01488-c275-4848-ab3b-46ad09ec44ed tempest-VolumesActionsTest-355688864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.971s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:06:17 devstack sudo[91667]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:17 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c0b01488-c275-4848-ab3b-46ad09ec44ed tempest-VolumesActionsTest-355688864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b6b6912-6abd-4b0a-b730-d2b3de672534) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b5c341b-5a85-46cc-918b-3a4f3c033cf1', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:17 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c0b01488-c275-4848-ab3b-46ad09ec44ed tempest-VolumesActionsTest-355688864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (076f0821-a35a-4c7c-9800-caed1deedec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:17 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-c0b01488-c275-4848-ab3b-46ad09ec44ed tempest-VolumesActionsTest-355688864 None] Volume volume-1b5c341b-5a85-46cc-918b-3a4f3c033cf1 (1b5c341b-5a85-46cc-918b-3a4f3c033cf1): created successfully Nov 02 10:06:17 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c0b01488-c275-4848-ab3b-46ad09ec44ed tempest-VolumesActionsTest-355688864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (076f0821-a35a-4c7c-9800-caed1deedec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:17 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c0b01488-c275-4848-ab3b-46ad09ec44ed tempest-VolumesActionsTest-355688864 None] Flow 'volume_create_manager' (20300c2f-3239-4aa7-ac1b-e9845d402d21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:06:17 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-c0b01488-c275-4848-ab3b-46ad09ec44ed tempest-VolumesActionsTest-355688864 None] Created volume successfully. Nov 02 10:06:19 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-bf0d8233-c267-4b36-a569-b81610249902 tempest-VolumesActionsTest-656454676 None] Acquiring lock "cinder-1b5c341b-5a85-46cc-918b-3a4f3c033cf1-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:06:19 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-bf0d8233-c267-4b36-a569-b81610249902 tempest-VolumesActionsTest-656454676 None] Lock "cinder-1b5c341b-5a85-46cc-918b-3a4f3c033cf1-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:06:19 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-bf0d8233-c267-4b36-a569-b81610249902 tempest-VolumesActionsTest-656454676 None] Acquiring lock "cinder-quobyte-1b5c341b-5a85-46cc-918b-3a4f3c033cf1" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:06:19 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-bf0d8233-c267-4b36-a569-b81610249902 tempest-VolumesActionsTest-656454676 None] Lock "cinder-quobyte-1b5c341b-5a85-46cc-918b-3a4f3c033cf1" acquired by "delete_volume" :: waited 0.020s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:06:19 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3dc216d-9c25-43c7-9a35-f5bfd128e0b6]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:06:19 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-bf0d8233-c267-4b36-a569-b81610249902 tempest-VolumesActionsTest-656454676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-1b5c341b-5a85-46cc-918b-3a4f3c033cf1 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:19 devstack sudo[91694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-1b5c341b-5a85-46cc-918b-3a4f3c033cf1 Nov 02 10:06:19 devstack sudo[91694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:19 devstack sudo[91694]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:19 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-bf0d8233-c267-4b36-a569-b81610249902 tempest-VolumesActionsTest-656454676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-1b5c341b-5a85-46cc-918b-3a4f3c033cf1" returned: 0 in 0.633s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:19 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-bf0d8233-c267-4b36-a569-b81610249902 tempest-VolumesActionsTest-656454676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-1b5c341b-5a85-46cc-918b-3a4f3c033cf1 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:20 devstack sudo[91704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-1b5c341b-5a85-46cc-918b-3a4f3c033cf1 Nov 02 10:06:20 devstack sudo[91704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:20 devstack sudo[91704]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:20 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-bf0d8233-c267-4b36-a569-b81610249902 tempest-VolumesActionsTest-656454676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-1b5c341b-5a85-46cc-918b-3a4f3c033cf1" returned: 0 in 0.328s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:20 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-bf0d8233-c267-4b36-a569-b81610249902 tempest-VolumesActionsTest-656454676 None] Lock "cinder-quobyte-1b5c341b-5a85-46cc-918b-3a4f3c033cf1" released by "delete_volume" :: held 1.040s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:06:20 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-bf0d8233-c267-4b36-a569-b81610249902 tempest-VolumesActionsTest-656454676 None] Created reservations ['aa64ef7f-ccf5-42c9-8fbc-8da0cd35b1e3', '0f96799c-31d9-4fa6-a8e0-15fe49c1bc3c', '1d77ad3a-38b9-4614-b3fb-55e126c359f7', 'd5ab4a28-dfca-4044-a2be-032cfc8a05ea'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:06:20 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-bf0d8233-c267-4b36-a569-b81610249902 tempest-VolumesActionsTest-656454676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:06:20 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-bf0d8233-c267-4b36-a569-b81610249902 tempest-VolumesActionsTest-656454676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:06:20 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-bf0d8233-c267-4b36-a569-b81610249902 tempest-VolumesActionsTest-656454676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:06:20 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-bf0d8233-c267-4b36-a569-b81610249902 tempest-VolumesActionsTest-656454676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:06:20 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-bf0d8233-c267-4b36-a569-b81610249902 tempest-VolumesActionsTest-656454676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:06:20 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-bf0d8233-c267-4b36-a569-b81610249902 tempest-VolumesActionsTest-656454676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:20 devstack sudo[91708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:06:20 devstack sudo[91708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:20 devstack cinder-volume[86890]: INFO cinder.volume.manager [req-35fc1748-4873-4044-ab6b-0910122eba22 req-0fbe17cc-33a9-4757-96b5-b0e68f04134f tempest-AttachVolumeTestJSON-1128520514 None] Terminate volume connection completed successfully. Nov 02 10:06:20 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [req-35fc1748-4873-4044-ab6b-0910122eba22 req-0fbe17cc-33a9-4757-96b5-b0e68f04134f tempest-AttachVolumeTestJSON-1128520514 None] Deleting attachment a7cab607-837e-423c-a185-6f82100f533a. {{(pid=86890) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:06:21 devstack sudo[91708]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:21 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-bf0d8233-c267-4b36-a569-b81610249902 tempest-VolumesActionsTest-656454676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.318s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:21 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-bf0d8233-c267-4b36-a569-b81610249902 tempest-VolumesActionsTest-656454676 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:06:21 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-bf0d8233-c267-4b36-a569-b81610249902 tempest-VolumesActionsTest-656454676 None] Deleted volume successfully. Nov 02 10:06:21 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-bf0d8233-c267-4b36-a569-b81610249902 tempest-VolumesActionsTest-656454676 None] Lock "cinder-1b5c341b-5a85-46cc-918b-3a4f3c033cf1-delete_volume" released by "delete_volume" :: held 1.859s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:06:22 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-0244450a-0b4f-4508-b786-0c36b0cfd654 tempest-VolumesActionsTest-355688864 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:06:22 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-0244450a-0b4f-4508-b786-0c36b0cfd654 tempest-VolumesActionsTest-355688864 None] Flow 'volume_create_manager' (12a64eab-0a23-4b28-965c-c24feeec7a32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:06:22 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-0244450a-0b4f-4508-b786-0c36b0cfd654 tempest-VolumesActionsTest-355688864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aabb159b-9900-47f7-9f36-22b6b78b0f5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:22 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-0244450a-0b4f-4508-b786-0c36b0cfd654 tempest-VolumesActionsTest-355688864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aabb159b-9900-47f7-9f36-22b6b78b0f5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:06:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1520052327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e713bc45-2cad-4dee-8020-7f5380ac0a97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fee095d18d9419b960140531043b06b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:06:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:06:23Z,use_quota=True,user_id='80fda34e687840e191563730e0c26dfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:22 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-0244450a-0b4f-4508-b786-0c36b0cfd654 tempest-VolumesActionsTest-355688864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (348dfac9-a0a8-40a6-ae60-848bc6a06753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:22 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-0244450a-0b4f-4508-b786-0c36b0cfd654 tempest-VolumesActionsTest-355688864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (348dfac9-a0a8-40a6-ae60-848bc6a06753) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:22 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-0244450a-0b4f-4508-b786-0c36b0cfd654 tempest-VolumesActionsTest-355688864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbe0f17b-2cf9-497a-9531-fd568441293e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:22 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-0244450a-0b4f-4508-b786-0c36b0cfd654 tempest-VolumesActionsTest-355688864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbe0f17b-2cf9-497a-9531-fd568441293e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e713bc45-2cad-4dee-8020-7f5380ac0a97', 'volume_name': 'volume-e713bc45-2cad-4dee-8020-7f5380ac0a97', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:22 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-0244450a-0b4f-4508-b786-0c36b0cfd654 tempest-VolumesActionsTest-355688864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b32349a-bfbb-4a7d-846d-e63440c9d97c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:22 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-0244450a-0b4f-4508-b786-0c36b0cfd654 tempest-VolumesActionsTest-355688864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b32349a-bfbb-4a7d-846d-e63440c9d97c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:22 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-0244450a-0b4f-4508-b786-0c36b0cfd654 tempest-VolumesActionsTest-355688864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86e0fab7-8699-4bdd-b712-e42882e5bfae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:22 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-0244450a-0b4f-4508-b786-0c36b0cfd654 tempest-VolumesActionsTest-355688864 None] Volume e713bc45-2cad-4dee-8020-7f5380ac0a97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e713bc45-2cad-4dee-8020-7f5380ac0a97', 'volume_size': 1} Nov 02 10:06:22 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-0244450a-0b4f-4508-b786-0c36b0cfd654 tempest-VolumesActionsTest-355688864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:06:22 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-0244450a-0b4f-4508-b786-0c36b0cfd654 tempest-VolumesActionsTest-355688864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:06:22 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-0244450a-0b4f-4508-b786-0c36b0cfd654 tempest-VolumesActionsTest-355688864 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:06:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1520052327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e713bc45-2cad-4dee-8020-7f5380ac0a97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fee095d18d9419b960140531043b06b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:06:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:06:23Z,use_quota=True,user_id='80fda34e687840e191563730e0c26dfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:06:22 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-0244450a-0b4f-4508-b786-0c36b0cfd654 tempest-VolumesActionsTest-355688864 None] Creating volume e713bc45-2cad-4dee-8020-7f5380ac0a97 {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:06:22 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-0244450a-0b4f-4508-b786-0c36b0cfd654 tempest-VolumesActionsTest-355688864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:06:22 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-0244450a-0b4f-4508-b786-0c36b0cfd654 tempest-VolumesActionsTest-355688864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:06:22 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-0244450a-0b4f-4508-b786-0c36b0cfd654 tempest-VolumesActionsTest-355688864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:06:22 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-0244450a-0b4f-4508-b786-0c36b0cfd654 tempest-VolumesActionsTest-355688864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:06:22 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-0244450a-0b4f-4508-b786-0c36b0cfd654 tempest-VolumesActionsTest-355688864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:06:22 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-0244450a-0b4f-4508-b786-0c36b0cfd654 tempest-VolumesActionsTest-355688864 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:06:22 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-0244450a-0b4f-4508-b786-0c36b0cfd654 tempest-VolumesActionsTest-355688864 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:06:22 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-0244450a-0b4f-4508-b786-0c36b0cfd654 tempest-VolumesActionsTest-355688864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e713bc45-2cad-4dee-8020-7f5380ac0a97 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:22 devstack sudo[91734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e713bc45-2cad-4dee-8020-7f5380ac0a97 1073741824 Nov 02 10:06:22 devstack sudo[91734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:23 devstack sudo[91734]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:23 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-0244450a-0b4f-4508-b786-0c36b0cfd654 tempest-VolumesActionsTest-355688864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e713bc45-2cad-4dee-8020-7f5380ac0a97 1073741824" returned: 0 in 0.404s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:23 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-0244450a-0b4f-4508-b786-0c36b0cfd654 tempest-VolumesActionsTest-355688864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e713bc45-2cad-4dee-8020-7f5380ac0a97 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:23 devstack sudo[91741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e713bc45-2cad-4dee-8020-7f5380ac0a97 Nov 02 10:06:23 devstack sudo[91741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:23 devstack sudo[91741]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:23 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-0244450a-0b4f-4508-b786-0c36b0cfd654 tempest-VolumesActionsTest-355688864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e713bc45-2cad-4dee-8020-7f5380ac0a97" returned: 0 in 0.273s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:23 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-0244450a-0b4f-4508-b786-0c36b0cfd654 tempest-VolumesActionsTest-355688864 None] <== create_volume: return (719ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:06:23 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-0244450a-0b4f-4508-b786-0c36b0cfd654 tempest-VolumesActionsTest-355688864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.723s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:06:23 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-0244450a-0b4f-4508-b786-0c36b0cfd654 tempest-VolumesActionsTest-355688864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86e0fab7-8699-4bdd-b712-e42882e5bfae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e713bc45-2cad-4dee-8020-7f5380ac0a97', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:23 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-0244450a-0b4f-4508-b786-0c36b0cfd654 tempest-VolumesActionsTest-355688864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5034d2ae-6921-456e-a163-6388ddae7d4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:23 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-0244450a-0b4f-4508-b786-0c36b0cfd654 tempest-VolumesActionsTest-355688864 None] Volume volume-e713bc45-2cad-4dee-8020-7f5380ac0a97 (e713bc45-2cad-4dee-8020-7f5380ac0a97): created successfully Nov 02 10:06:23 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-0244450a-0b4f-4508-b786-0c36b0cfd654 tempest-VolumesActionsTest-355688864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5034d2ae-6921-456e-a163-6388ddae7d4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:23 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-0244450a-0b4f-4508-b786-0c36b0cfd654 tempest-VolumesActionsTest-355688864 None] Flow 'volume_create_manager' (12a64eab-0a23-4b28-965c-c24feeec7a32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:06:23 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-0244450a-0b4f-4508-b786-0c36b0cfd654 tempest-VolumesActionsTest-355688864 None] Created volume successfully. Nov 02 10:06:23 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-d0f3c7ae-e17c-46eb-abd2-6ca6a7bf972c tempest-VolumesActionsTest-656454676 None] Acquiring lock "cinder-e713bc45-2cad-4dee-8020-7f5380ac0a97-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:06:23 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-d0f3c7ae-e17c-46eb-abd2-6ca6a7bf972c tempest-VolumesActionsTest-656454676 None] Lock "cinder-e713bc45-2cad-4dee-8020-7f5380ac0a97-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:06:23 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-d0f3c7ae-e17c-46eb-abd2-6ca6a7bf972c tempest-VolumesActionsTest-656454676 None] Acquiring lock "cinder-quobyte-e713bc45-2cad-4dee-8020-7f5380ac0a97" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:06:24 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-d0f3c7ae-e17c-46eb-abd2-6ca6a7bf972c tempest-VolumesActionsTest-656454676 None] Lock "cinder-quobyte-e713bc45-2cad-4dee-8020-7f5380ac0a97" acquired by "delete_volume" :: waited 0.045s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:06:24 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[594c85f4-e6bd-46a4-95b3-60909804a405]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:06:24 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-d0f3c7ae-e17c-46eb-abd2-6ca6a7bf972c tempest-VolumesActionsTest-656454676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e713bc45-2cad-4dee-8020-7f5380ac0a97 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:24 devstack sudo[91747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e713bc45-2cad-4dee-8020-7f5380ac0a97 Nov 02 10:06:24 devstack sudo[91747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:24 devstack sudo[91747]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:24 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-d0f3c7ae-e17c-46eb-abd2-6ca6a7bf972c tempest-VolumesActionsTest-656454676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e713bc45-2cad-4dee-8020-7f5380ac0a97" returned: 0 in 0.477s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:24 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-d0f3c7ae-e17c-46eb-abd2-6ca6a7bf972c tempest-VolumesActionsTest-656454676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e713bc45-2cad-4dee-8020-7f5380ac0a97 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:24 devstack sudo[91752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e713bc45-2cad-4dee-8020-7f5380ac0a97 Nov 02 10:06:24 devstack sudo[91752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:24 devstack sudo[91752]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:24 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-d0f3c7ae-e17c-46eb-abd2-6ca6a7bf972c tempest-VolumesActionsTest-656454676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e713bc45-2cad-4dee-8020-7f5380ac0a97" returned: 0 in 0.319s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:24 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-d0f3c7ae-e17c-46eb-abd2-6ca6a7bf972c tempest-VolumesActionsTest-656454676 None] Lock "cinder-quobyte-e713bc45-2cad-4dee-8020-7f5380ac0a97" released by "delete_volume" :: held 0.876s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:06:24 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-d0f3c7ae-e17c-46eb-abd2-6ca6a7bf972c tempest-VolumesActionsTest-656454676 None] Created reservations ['d800aa1b-30a1-4a45-bea9-653c4178b221', '0482202d-e843-460f-aeb7-79cf2dd8c00c', 'cbec903b-8dc6-454b-b262-b8945e053abb', '8eacd7f6-568a-4171-aaf1-6855ff52e982'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:06:25 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-d0f3c7ae-e17c-46eb-abd2-6ca6a7bf972c tempest-VolumesActionsTest-656454676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:06:25 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-d0f3c7ae-e17c-46eb-abd2-6ca6a7bf972c tempest-VolumesActionsTest-656454676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:06:25 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-d0f3c7ae-e17c-46eb-abd2-6ca6a7bf972c tempest-VolumesActionsTest-656454676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:06:25 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-d0f3c7ae-e17c-46eb-abd2-6ca6a7bf972c tempest-VolumesActionsTest-656454676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:06:25 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-d0f3c7ae-e17c-46eb-abd2-6ca6a7bf972c tempest-VolumesActionsTest-656454676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:06:25 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-d0f3c7ae-e17c-46eb-abd2-6ca6a7bf972c tempest-VolumesActionsTest-656454676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:25 devstack sudo[91764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:06:25 devstack sudo[91764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:25 devstack sudo[91764]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:25 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-d0f3c7ae-e17c-46eb-abd2-6ca6a7bf972c tempest-VolumesActionsTest-656454676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.536s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:25 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-d0f3c7ae-e17c-46eb-abd2-6ca6a7bf972c tempest-VolumesActionsTest-656454676 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:06:25 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-d0f3c7ae-e17c-46eb-abd2-6ca6a7bf972c tempest-VolumesActionsTest-656454676 None] Deleted volume successfully. Nov 02 10:06:25 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-d0f3c7ae-e17c-46eb-abd2-6ca6a7bf972c tempest-VolumesActionsTest-656454676 None] Lock "cinder-e713bc45-2cad-4dee-8020-7f5380ac0a97-delete_volume" released by "delete_volume" :: held 1.809s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:06:26 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2b83427-c98d-4f0a-ac8f-47b558c2fbd4 tempest-VolumesActionsTest-355688864 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:06:26 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c2b83427-c98d-4f0a-ac8f-47b558c2fbd4 tempest-VolumesActionsTest-355688864 None] Flow 'volume_create_manager' (512771c7-be33-4527-a12d-90b2dc0a6e6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:06:26 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c2b83427-c98d-4f0a-ac8f-47b558c2fbd4 tempest-VolumesActionsTest-355688864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4233b3c3-79b6-4224-80e3-762cf1b2d095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:26 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c2b83427-c98d-4f0a-ac8f-47b558c2fbd4 tempest-VolumesActionsTest-355688864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4233b3c3-79b6-4224-80e3-762cf1b2d095) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:06:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2012908804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57f77b1d-0456-4da1-982a-10bc0bf03fe2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fee095d18d9419b960140531043b06b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:06:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:06:26Z,use_quota=True,user_id='80fda34e687840e191563730e0c26dfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:26 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c2b83427-c98d-4f0a-ac8f-47b558c2fbd4 tempest-VolumesActionsTest-355688864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f66fdb58-df5b-47ff-98c4-f6297bd0307a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:26 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c2b83427-c98d-4f0a-ac8f-47b558c2fbd4 tempest-VolumesActionsTest-355688864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f66fdb58-df5b-47ff-98c4-f6297bd0307a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:26 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c2b83427-c98d-4f0a-ac8f-47b558c2fbd4 tempest-VolumesActionsTest-355688864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70ffa426-728c-40ac-9770-91fdd36be32b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:26 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c2b83427-c98d-4f0a-ac8f-47b558c2fbd4 tempest-VolumesActionsTest-355688864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70ffa426-728c-40ac-9770-91fdd36be32b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57f77b1d-0456-4da1-982a-10bc0bf03fe2', 'volume_name': 'volume-57f77b1d-0456-4da1-982a-10bc0bf03fe2', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:26 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c2b83427-c98d-4f0a-ac8f-47b558c2fbd4 tempest-VolumesActionsTest-355688864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adcc8587-0c94-4112-91e1-8da52d9b678c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:26 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c2b83427-c98d-4f0a-ac8f-47b558c2fbd4 tempest-VolumesActionsTest-355688864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adcc8587-0c94-4112-91e1-8da52d9b678c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:26 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c2b83427-c98d-4f0a-ac8f-47b558c2fbd4 tempest-VolumesActionsTest-355688864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07970346-73bb-4c38-894e-d311bf7ee31e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:26 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-c2b83427-c98d-4f0a-ac8f-47b558c2fbd4 tempest-VolumesActionsTest-355688864 None] Volume 57f77b1d-0456-4da1-982a-10bc0bf03fe2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57f77b1d-0456-4da1-982a-10bc0bf03fe2', 'volume_size': 1} Nov 02 10:06:26 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c2b83427-c98d-4f0a-ac8f-47b558c2fbd4 tempest-VolumesActionsTest-355688864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:06:26 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c2b83427-c98d-4f0a-ac8f-47b558c2fbd4 tempest-VolumesActionsTest-355688864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:06:26 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c2b83427-c98d-4f0a-ac8f-47b558c2fbd4 tempest-VolumesActionsTest-355688864 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:06:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2012908804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57f77b1d-0456-4da1-982a-10bc0bf03fe2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fee095d18d9419b960140531043b06b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:06:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:06:26Z,use_quota=True,user_id='80fda34e687840e191563730e0c26dfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:06:26 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-c2b83427-c98d-4f0a-ac8f-47b558c2fbd4 tempest-VolumesActionsTest-355688864 None] Creating volume 57f77b1d-0456-4da1-982a-10bc0bf03fe2 {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:06:26 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c2b83427-c98d-4f0a-ac8f-47b558c2fbd4 tempest-VolumesActionsTest-355688864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:06:26 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c2b83427-c98d-4f0a-ac8f-47b558c2fbd4 tempest-VolumesActionsTest-355688864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:06:26 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c2b83427-c98d-4f0a-ac8f-47b558c2fbd4 tempest-VolumesActionsTest-355688864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:06:26 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c2b83427-c98d-4f0a-ac8f-47b558c2fbd4 tempest-VolumesActionsTest-355688864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:06:26 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c2b83427-c98d-4f0a-ac8f-47b558c2fbd4 tempest-VolumesActionsTest-355688864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:06:26 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c2b83427-c98d-4f0a-ac8f-47b558c2fbd4 tempest-VolumesActionsTest-355688864 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:06:26 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-c2b83427-c98d-4f0a-ac8f-47b558c2fbd4 tempest-VolumesActionsTest-355688864 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:06:26 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c2b83427-c98d-4f0a-ac8f-47b558c2fbd4 tempest-VolumesActionsTest-355688864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-57f77b1d-0456-4da1-982a-10bc0bf03fe2 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:26 devstack sudo[91839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-57f77b1d-0456-4da1-982a-10bc0bf03fe2 1073741824 Nov 02 10:06:26 devstack sudo[91839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:27 devstack sudo[91839]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:27 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c2b83427-c98d-4f0a-ac8f-47b558c2fbd4 tempest-VolumesActionsTest-355688864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-57f77b1d-0456-4da1-982a-10bc0bf03fe2 1073741824" returned: 0 in 0.825s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:27 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c2b83427-c98d-4f0a-ac8f-47b558c2fbd4 tempest-VolumesActionsTest-355688864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-57f77b1d-0456-4da1-982a-10bc0bf03fe2 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:27 devstack sudo[91861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-57f77b1d-0456-4da1-982a-10bc0bf03fe2 Nov 02 10:06:27 devstack sudo[91861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:27 devstack sudo[91861]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:28 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c2b83427-c98d-4f0a-ac8f-47b558c2fbd4 tempest-VolumesActionsTest-355688864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-57f77b1d-0456-4da1-982a-10bc0bf03fe2" returned: 0 in 0.455s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:28 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c2b83427-c98d-4f0a-ac8f-47b558c2fbd4 tempest-VolumesActionsTest-355688864 None] <== create_volume: return (1382ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:06:28 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c2b83427-c98d-4f0a-ac8f-47b558c2fbd4 tempest-VolumesActionsTest-355688864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.387s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:06:28 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c2b83427-c98d-4f0a-ac8f-47b558c2fbd4 tempest-VolumesActionsTest-355688864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07970346-73bb-4c38-894e-d311bf7ee31e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57f77b1d-0456-4da1-982a-10bc0bf03fe2', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:28 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c2b83427-c98d-4f0a-ac8f-47b558c2fbd4 tempest-VolumesActionsTest-355688864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9294922-487a-4fe9-917f-68b4f9bd8744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:28 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-c2b83427-c98d-4f0a-ac8f-47b558c2fbd4 tempest-VolumesActionsTest-355688864 None] Volume volume-57f77b1d-0456-4da1-982a-10bc0bf03fe2 (57f77b1d-0456-4da1-982a-10bc0bf03fe2): created successfully Nov 02 10:06:28 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c2b83427-c98d-4f0a-ac8f-47b558c2fbd4 tempest-VolumesActionsTest-355688864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9294922-487a-4fe9-917f-68b4f9bd8744) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:28 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c2b83427-c98d-4f0a-ac8f-47b558c2fbd4 tempest-VolumesActionsTest-355688864 None] Flow 'volume_create_manager' (512771c7-be33-4527-a12d-90b2dc0a6e6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:06:28 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-c2b83427-c98d-4f0a-ac8f-47b558c2fbd4 tempest-VolumesActionsTest-355688864 None] Created volume successfully. Nov 02 10:06:28 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-c46ab8ce-0652-4d2d-89c2-5d571c9d3d80 tempest-VolumesActionsTest-656454676 None] Acquiring lock "cinder-57f77b1d-0456-4da1-982a-10bc0bf03fe2-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:06:28 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-c46ab8ce-0652-4d2d-89c2-5d571c9d3d80 tempest-VolumesActionsTest-656454676 None] Lock "cinder-57f77b1d-0456-4da1-982a-10bc0bf03fe2-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:06:28 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-c46ab8ce-0652-4d2d-89c2-5d571c9d3d80 tempest-VolumesActionsTest-656454676 None] Acquiring lock "cinder-quobyte-57f77b1d-0456-4da1-982a-10bc0bf03fe2" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:06:28 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-c46ab8ce-0652-4d2d-89c2-5d571c9d3d80 tempest-VolumesActionsTest-656454676 None] Lock "cinder-quobyte-57f77b1d-0456-4da1-982a-10bc0bf03fe2" acquired by "delete_volume" :: waited 0.043s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:06:28 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0197166-b63c-4f31-b235-ca26316dc0d8]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:06:28 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c46ab8ce-0652-4d2d-89c2-5d571c9d3d80 tempest-VolumesActionsTest-656454676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-57f77b1d-0456-4da1-982a-10bc0bf03fe2 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:28 devstack sudo[91868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-57f77b1d-0456-4da1-982a-10bc0bf03fe2 Nov 02 10:06:28 devstack sudo[91868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:29 devstack sudo[91868]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:29 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c46ab8ce-0652-4d2d-89c2-5d571c9d3d80 tempest-VolumesActionsTest-656454676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-57f77b1d-0456-4da1-982a-10bc0bf03fe2" returned: 0 in 0.653s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:29 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c46ab8ce-0652-4d2d-89c2-5d571c9d3d80 tempest-VolumesActionsTest-656454676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-57f77b1d-0456-4da1-982a-10bc0bf03fe2 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:29 devstack sudo[91873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-57f77b1d-0456-4da1-982a-10bc0bf03fe2 Nov 02 10:06:29 devstack sudo[91873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:29 devstack sudo[91873]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:29 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c46ab8ce-0652-4d2d-89c2-5d571c9d3d80 tempest-VolumesActionsTest-656454676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-57f77b1d-0456-4da1-982a-10bc0bf03fe2" returned: 0 in 0.488s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:29 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-c46ab8ce-0652-4d2d-89c2-5d571c9d3d80 tempest-VolumesActionsTest-656454676 None] Lock "cinder-quobyte-57f77b1d-0456-4da1-982a-10bc0bf03fe2" released by "delete_volume" :: held 1.226s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:06:29 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-c46ab8ce-0652-4d2d-89c2-5d571c9d3d80 tempest-VolumesActionsTest-656454676 None] Created reservations ['9e8f8849-aa75-483d-afc3-a6acae145eec', '7573f6c2-4223-4179-9304-724d505a3cc2', '87c649a1-20b6-4481-b110-51bfc22c64f7', 'd913f907-0bec-4e02-b509-5c19ff0db557'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:06:30 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c46ab8ce-0652-4d2d-89c2-5d571c9d3d80 tempest-VolumesActionsTest-656454676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:06:30 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c46ab8ce-0652-4d2d-89c2-5d571c9d3d80 tempest-VolumesActionsTest-656454676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:06:30 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c46ab8ce-0652-4d2d-89c2-5d571c9d3d80 tempest-VolumesActionsTest-656454676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:06:30 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c46ab8ce-0652-4d2d-89c2-5d571c9d3d80 tempest-VolumesActionsTest-656454676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:06:30 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c46ab8ce-0652-4d2d-89c2-5d571c9d3d80 tempest-VolumesActionsTest-656454676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:06:30 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c46ab8ce-0652-4d2d-89c2-5d571c9d3d80 tempest-VolumesActionsTest-656454676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:30 devstack sudo[91876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:06:30 devstack sudo[91876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:30 devstack sudo[91876]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:30 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c46ab8ce-0652-4d2d-89c2-5d571c9d3d80 tempest-VolumesActionsTest-656454676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.309s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:30 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-c46ab8ce-0652-4d2d-89c2-5d571c9d3d80 tempest-VolumesActionsTest-656454676 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:06:30 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-c46ab8ce-0652-4d2d-89c2-5d571c9d3d80 tempest-VolumesActionsTest-656454676 None] Deleted volume successfully. Nov 02 10:06:30 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-c46ab8ce-0652-4d2d-89c2-5d571c9d3d80 tempest-VolumesActionsTest-656454676 None] Lock "cinder-57f77b1d-0456-4da1-982a-10bc0bf03fe2-delete_volume" released by "delete_volume" :: held 1.984s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:06:31 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-43835095-b04c-48fc-8d5d-72284807aa8f tempest-VolumesActionsTest-355688864 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:06:31 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-43835095-b04c-48fc-8d5d-72284807aa8f tempest-VolumesActionsTest-355688864 None] Flow 'volume_create_manager' (471c143f-487b-46bf-9f0d-366c9cea594d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:06:31 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-43835095-b04c-48fc-8d5d-72284807aa8f tempest-VolumesActionsTest-355688864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f05e534-1396-48eb-a2e5-18bf5d09202b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:31 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-43835095-b04c-48fc-8d5d-72284807aa8f tempest-VolumesActionsTest-355688864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f05e534-1396-48eb-a2e5-18bf5d09202b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:06:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2076514318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f71b0424-9de4-4dce-9c1e-64eafe2cee2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fee095d18d9419b960140531043b06b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:06:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:06:32Z,use_quota=True,user_id='80fda34e687840e191563730e0c26dfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:31 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-43835095-b04c-48fc-8d5d-72284807aa8f tempest-VolumesActionsTest-355688864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a52f931-34b3-4381-ba8f-a658d668723b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:31 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-43835095-b04c-48fc-8d5d-72284807aa8f tempest-VolumesActionsTest-355688864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a52f931-34b3-4381-ba8f-a658d668723b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:31 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-43835095-b04c-48fc-8d5d-72284807aa8f tempest-VolumesActionsTest-355688864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (243bc08f-6c95-4d1e-b70c-3e9ac7018bd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:31 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-43835095-b04c-48fc-8d5d-72284807aa8f tempest-VolumesActionsTest-355688864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (243bc08f-6c95-4d1e-b70c-3e9ac7018bd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f71b0424-9de4-4dce-9c1e-64eafe2cee2a', 'volume_name': 'volume-f71b0424-9de4-4dce-9c1e-64eafe2cee2a', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:31 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-43835095-b04c-48fc-8d5d-72284807aa8f tempest-VolumesActionsTest-355688864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ca3dbce-9b6d-45e9-a278-1dd8d3a3ddbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:31 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-43835095-b04c-48fc-8d5d-72284807aa8f tempest-VolumesActionsTest-355688864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ca3dbce-9b6d-45e9-a278-1dd8d3a3ddbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:31 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-43835095-b04c-48fc-8d5d-72284807aa8f tempest-VolumesActionsTest-355688864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (252060e1-cbbb-41f8-ba68-33cb65caae86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:31 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-43835095-b04c-48fc-8d5d-72284807aa8f tempest-VolumesActionsTest-355688864 None] Volume f71b0424-9de4-4dce-9c1e-64eafe2cee2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f71b0424-9de4-4dce-9c1e-64eafe2cee2a', 'volume_size': 1} Nov 02 10:06:31 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-43835095-b04c-48fc-8d5d-72284807aa8f tempest-VolumesActionsTest-355688864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:06:31 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-43835095-b04c-48fc-8d5d-72284807aa8f tempest-VolumesActionsTest-355688864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:06:31 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-43835095-b04c-48fc-8d5d-72284807aa8f tempest-VolumesActionsTest-355688864 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:06:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2076514318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f71b0424-9de4-4dce-9c1e-64eafe2cee2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fee095d18d9419b960140531043b06b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:06:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:06:32Z,use_quota=True,user_id='80fda34e687840e191563730e0c26dfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:06:31 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-43835095-b04c-48fc-8d5d-72284807aa8f tempest-VolumesActionsTest-355688864 None] Creating volume f71b0424-9de4-4dce-9c1e-64eafe2cee2a {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:06:31 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-43835095-b04c-48fc-8d5d-72284807aa8f tempest-VolumesActionsTest-355688864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:06:31 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-43835095-b04c-48fc-8d5d-72284807aa8f tempest-VolumesActionsTest-355688864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:06:31 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-43835095-b04c-48fc-8d5d-72284807aa8f tempest-VolumesActionsTest-355688864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:06:31 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-43835095-b04c-48fc-8d5d-72284807aa8f tempest-VolumesActionsTest-355688864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:06:31 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-43835095-b04c-48fc-8d5d-72284807aa8f tempest-VolumesActionsTest-355688864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:06:31 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-43835095-b04c-48fc-8d5d-72284807aa8f tempest-VolumesActionsTest-355688864 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:06:31 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-43835095-b04c-48fc-8d5d-72284807aa8f tempest-VolumesActionsTest-355688864 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:06:31 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-43835095-b04c-48fc-8d5d-72284807aa8f tempest-VolumesActionsTest-355688864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-f71b0424-9de4-4dce-9c1e-64eafe2cee2a 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:32 devstack sudo[91879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-f71b0424-9de4-4dce-9c1e-64eafe2cee2a 1073741824 Nov 02 10:06:32 devstack sudo[91879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:32 devstack sudo[91879]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:32 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-43835095-b04c-48fc-8d5d-72284807aa8f tempest-VolumesActionsTest-355688864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-f71b0424-9de4-4dce-9c1e-64eafe2cee2a 1073741824" returned: 0 in 0.678s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:32 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-43835095-b04c-48fc-8d5d-72284807aa8f tempest-VolumesActionsTest-355688864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-f71b0424-9de4-4dce-9c1e-64eafe2cee2a {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:32 devstack sudo[91887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-f71b0424-9de4-4dce-9c1e-64eafe2cee2a Nov 02 10:06:32 devstack sudo[91887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:33 devstack sudo[91887]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:33 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-43835095-b04c-48fc-8d5d-72284807aa8f tempest-VolumesActionsTest-355688864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-f71b0424-9de4-4dce-9c1e-64eafe2cee2a" returned: 0 in 0.363s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:33 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-43835095-b04c-48fc-8d5d-72284807aa8f tempest-VolumesActionsTest-355688864 None] <== create_volume: return (1151ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:06:33 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-43835095-b04c-48fc-8d5d-72284807aa8f tempest-VolumesActionsTest-355688864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.155s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:06:33 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-43835095-b04c-48fc-8d5d-72284807aa8f tempest-VolumesActionsTest-355688864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (252060e1-cbbb-41f8-ba68-33cb65caae86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f71b0424-9de4-4dce-9c1e-64eafe2cee2a', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:33 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-43835095-b04c-48fc-8d5d-72284807aa8f tempest-VolumesActionsTest-355688864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fced3d1-c6ca-461b-a602-f43d5fc8e43a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:33 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-43835095-b04c-48fc-8d5d-72284807aa8f tempest-VolumesActionsTest-355688864 None] Volume volume-f71b0424-9de4-4dce-9c1e-64eafe2cee2a (f71b0424-9de4-4dce-9c1e-64eafe2cee2a): created successfully Nov 02 10:06:33 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-43835095-b04c-48fc-8d5d-72284807aa8f tempest-VolumesActionsTest-355688864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fced3d1-c6ca-461b-a602-f43d5fc8e43a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:33 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-43835095-b04c-48fc-8d5d-72284807aa8f tempest-VolumesActionsTest-355688864 None] Flow 'volume_create_manager' (471c143f-487b-46bf-9f0d-366c9cea594d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:06:33 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-43835095-b04c-48fc-8d5d-72284807aa8f tempest-VolumesActionsTest-355688864 None] Created volume successfully. Nov 02 10:06:34 devstack cinder-volume[86890]: DEBUG oslo_service.periodic_task [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86890) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:06:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:06:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:06:34 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:06:34 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:06:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:06:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:34 devstack sudo[91892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:06:34 devstack sudo[91892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:35 devstack sudo[91892]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:35 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.242s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:35 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:06:35 devstack cinder-volume[86890]: DEBUG oslo_service.periodic_task [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Running periodic task VolumeManager._thread_info {{(pid=86890) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:06:35 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] thread count: 8 {{(pid=86890) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:06:35 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] thread info: [<_MainThread(MainThread, started 133913319395456)>, , , , , , , ] {{(pid=86890) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:06:38 devstack cinder-volume[86890]: INFO cinder.volume.manager [req-8d92a101-c506-4d05-8563-88407e9e2070 req-7dfba47e-7536-4126-bd4f-da54215bfced tempest-ServerActionsTestOtherA-634183357 None] Terminate volume connection completed successfully. Nov 02 10:06:38 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [req-8d92a101-c506-4d05-8563-88407e9e2070 req-7dfba47e-7536-4126-bd4f-da54215bfced tempest-ServerActionsTestOtherA-634183357 None] Deleting attachment eeef60d2-4988-4306-bc25-32dce079cb3d. {{(pid=86890) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:06:39 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-d7d0fe16-57da-430d-982d-5a53f4b7cf61 tempest-VolumesActionsTest-355688864 None] Acquiring lock "cinder-f71b0424-9de4-4dce-9c1e-64eafe2cee2a-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:06:39 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-d7d0fe16-57da-430d-982d-5a53f4b7cf61 tempest-VolumesActionsTest-355688864 None] Lock "cinder-f71b0424-9de4-4dce-9c1e-64eafe2cee2a-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:06:39 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-d7d0fe16-57da-430d-982d-5a53f4b7cf61 tempest-VolumesActionsTest-355688864 None] Acquiring lock "cinder-quobyte-f71b0424-9de4-4dce-9c1e-64eafe2cee2a" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:06:39 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-d7d0fe16-57da-430d-982d-5a53f4b7cf61 tempest-VolumesActionsTest-355688864 None] Lock "cinder-quobyte-f71b0424-9de4-4dce-9c1e-64eafe2cee2a" acquired by "delete_volume" :: waited 0.025s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:06:39 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[1de06580-ab1e-4e82-91f0-37dc2e381f71]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:06:39 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-d7d0fe16-57da-430d-982d-5a53f4b7cf61 tempest-VolumesActionsTest-355688864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-f71b0424-9de4-4dce-9c1e-64eafe2cee2a {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:39 devstack sudo[91899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-f71b0424-9de4-4dce-9c1e-64eafe2cee2a Nov 02 10:06:39 devstack sudo[91899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:40 devstack sudo[91899]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:40 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-d7d0fe16-57da-430d-982d-5a53f4b7cf61 tempest-VolumesActionsTest-355688864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-f71b0424-9de4-4dce-9c1e-64eafe2cee2a" returned: 0 in 0.761s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:40 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-d7d0fe16-57da-430d-982d-5a53f4b7cf61 tempest-VolumesActionsTest-355688864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-f71b0424-9de4-4dce-9c1e-64eafe2cee2a {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:40 devstack sudo[91924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-f71b0424-9de4-4dce-9c1e-64eafe2cee2a Nov 02 10:06:40 devstack sudo[91924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:40 devstack sudo[91924]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:40 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-d7d0fe16-57da-430d-982d-5a53f4b7cf61 tempest-VolumesActionsTest-355688864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-f71b0424-9de4-4dce-9c1e-64eafe2cee2a" returned: 0 in 0.503s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:40 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-d7d0fe16-57da-430d-982d-5a53f4b7cf61 tempest-VolumesActionsTest-355688864 None] Lock "cinder-quobyte-f71b0424-9de4-4dce-9c1e-64eafe2cee2a" released by "delete_volume" :: held 1.349s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:06:40 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-d7d0fe16-57da-430d-982d-5a53f4b7cf61 tempest-VolumesActionsTest-355688864 None] Created reservations ['7d5e830a-793b-4936-8bd3-55e5b22890cf', '26bbdad6-d704-42cc-8b85-ad77d612cfd8', 'd9f3396f-5fd1-4ea8-bf70-79ff2a9a61e5', 'c2d36929-c7dc-4097-8fdb-fcd05a6698f8'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:06:40 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-d7d0fe16-57da-430d-982d-5a53f4b7cf61 tempest-VolumesActionsTest-355688864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:06:40 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-d7d0fe16-57da-430d-982d-5a53f4b7cf61 tempest-VolumesActionsTest-355688864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:06:40 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-d7d0fe16-57da-430d-982d-5a53f4b7cf61 tempest-VolumesActionsTest-355688864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:06:40 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-d7d0fe16-57da-430d-982d-5a53f4b7cf61 tempest-VolumesActionsTest-355688864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:06:40 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-d7d0fe16-57da-430d-982d-5a53f4b7cf61 tempest-VolumesActionsTest-355688864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:06:40 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-d7d0fe16-57da-430d-982d-5a53f4b7cf61 tempest-VolumesActionsTest-355688864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:40 devstack sudo[91930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:06:40 devstack sudo[91930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:41 devstack sudo[91930]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:41 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-d7d0fe16-57da-430d-982d-5a53f4b7cf61 tempest-VolumesActionsTest-355688864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.375s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:41 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-d7d0fe16-57da-430d-982d-5a53f4b7cf61 tempest-VolumesActionsTest-355688864 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:06:41 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-d7d0fe16-57da-430d-982d-5a53f4b7cf61 tempest-VolumesActionsTest-355688864 None] Deleted volume successfully. Nov 02 10:06:41 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-d7d0fe16-57da-430d-982d-5a53f4b7cf61 tempest-VolumesActionsTest-355688864 None] Lock "cinder-f71b0424-9de4-4dce-9c1e-64eafe2cee2a-delete_volume" released by "delete_volume" :: held 2.214s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:06:45 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-b670c0b0-b1b0-411b-a54b-d19cbbf57931 tempest-GroupsTest-179266637 None] Group tempest-Group1-788881796: creating Nov 02 10:06:45 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-b670c0b0-b1b0-411b-a54b-d19cbbf57931 tempest-GroupsTest-179266637 None] Group tempest-Group1-788881796: created successfully Nov 02 10:06:45 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-b670c0b0-b1b0-411b-a54b-d19cbbf57931 tempest-GroupsTest-179266637 None] Create group completed successfully. Nov 02 10:06:46 devstack cinder-volume[86890]: DEBUG dbcounter [-] [86890] Writing DB stats cinder:SELECT=82,cinder:UPDATE=92,cinder:INSERT=20,cinder:DELETE=9 {{(pid=86890) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:06:46 devstack cinder-volume[86890]: DEBUG dbcounter [-] [86890] Writing DB stats cinder:SELECT=81,cinder:UPDATE=100,cinder:INSERT=22,cinder:DELETE=7 {{(pid=86890) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:06:46 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-6195c092-d8b4-4669-9931-8e42d8d87406 tempest-ServerActionsTestOtherA-634183357 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:06:46 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-6195c092-d8b4-4669-9931-8e42d8d87406 tempest-ServerActionsTestOtherA-634183357 None] Flow 'volume_create_manager' (a132226a-635c-40bb-8ac5-2d80cd187b5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:06:46 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-6195c092-d8b4-4669-9931-8e42d8d87406 tempest-ServerActionsTestOtherA-634183357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97117185-4432-45f5-9959-2c1f265cbec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:46 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-6195c092-d8b4-4669-9931-8e42d8d87406 tempest-ServerActionsTestOtherA-634183357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97117185-4432-45f5-9959-2c1f265cbec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:06:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1812835969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b09d6b7-2f7c-479f-8124-3b45da495257,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af61e3c9113b42269134b4a5c4b58a6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:06:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:06:46Z,use_quota=True,user_id='8ed51f11f81c48ab98f8d76dbe2b26e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:46 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-6195c092-d8b4-4669-9931-8e42d8d87406 tempest-ServerActionsTestOtherA-634183357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16246fe3-ecab-453c-80ba-2051cce4eb5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:46 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-6195c092-d8b4-4669-9931-8e42d8d87406 tempest-ServerActionsTestOtherA-634183357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16246fe3-ecab-453c-80ba-2051cce4eb5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:46 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-6195c092-d8b4-4669-9931-8e42d8d87406 tempest-ServerActionsTestOtherA-634183357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35e9485b-7f38-4d5a-8721-bab00be6210f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:46 devstack cinder-volume[86890]: DEBUG cinder.image.glance [None req-6195c092-d8b4-4669-9931-8e42d8d87406 tempest-ServerActionsTestOtherA-634183357 None] Creating Keystone auth plugin from conf {{(pid=86890) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 10:06:46 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-adaf02da-8ad6-473c-8359-520c7af27a0c tempest-GroupsTest-179266637 None] Group tempest-Group2-1903064199: creating Nov 02 10:06:46 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-adaf02da-8ad6-473c-8359-520c7af27a0c tempest-GroupsTest-179266637 None] Group tempest-Group2-1903064199: created successfully Nov 02 10:06:46 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-adaf02da-8ad6-473c-8359-520c7af27a0c tempest-GroupsTest-179266637 None] Create group completed successfully. Nov 02 10:06:47 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-6195c092-d8b4-4669-9931-8e42d8d87406 tempest-ServerActionsTestOtherA-634183357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35e9485b-7f38-4d5a-8721-bab00be6210f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6b09d6b7-2f7c-479f-8124-3b45da495257', 'volume_name': 'volume-6b09d6b7-2f7c-479f-8124-3b45da495257', 'volume_size': 1, 'image_id': '7a393fa7-4879-486c-8216-4d35448485cf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7a393fa7-4879-486c-8216-4d35448485cf', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '606cf27a36794aa3805ebe6d987aa1a4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7a393fa7-4879-486c-8216-4d35448485cf', 'created_at': datetime.datetime(2026, 11, 2, 8, 55, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 8, 55, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7a393fa7-4879-486c-8216-4d35448485cf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:47 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-6195c092-d8b4-4669-9931-8e42d8d87406 tempest-ServerActionsTestOtherA-634183357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fea1599-1bbe-43c6-92be-39fc52496c51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:47 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-6195c092-d8b4-4669-9931-8e42d8d87406 tempest-ServerActionsTestOtherA-634183357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fea1599-1bbe-43c6-92be-39fc52496c51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:47 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-6195c092-d8b4-4669-9931-8e42d8d87406 tempest-ServerActionsTestOtherA-634183357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f3d0c72-6b40-45d9-aefd-668ae92f8219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:47 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-6195c092-d8b4-4669-9931-8e42d8d87406 tempest-ServerActionsTestOtherA-634183357 None] Volume 6b09d6b7-2f7c-479f-8124-3b45da495257: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6b09d6b7-2f7c-479f-8124-3b45da495257', 'volume_size': 1, 'image_id': '7a393fa7-4879-486c-8216-4d35448485cf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7a393fa7-4879-486c-8216-4d35448485cf', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '606cf27a36794aa3805ebe6d987aa1a4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7a393fa7-4879-486c-8216-4d35448485cf', 'created_at': datetime.datetime(2026, 11, 2, 8, 55, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 8, 55, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7a393fa7-4879-486c-8216-4d35448485cf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 02 10:06:47 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-6195c092-d8b4-4669-9931-8e42d8d87406 tempest-ServerActionsTestOtherA-634183357 None] Trying to clone 6b09d6b7-2f7c-479f-8124-3b45da495257 from image 7a393fa7-4879-486c-8216-4d35448485cf at location (None, [{'url': 'file:///opt/stack/data/glance/images/7a393fa7-4879-486c-8216-4d35448485cf', 'metadata': {}}]). {{(pid=86890) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 02 10:06:47 devstack cinder-volume[86890]: DEBUG cinder.image.image_utils [None req-6195c092-d8b4-4669-9931-8e42d8d87406 tempest-ServerActionsTestOtherA-634183357 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7a393fa7-4879-486c-8216-4d35448485cf_wwhiu4wydevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86890) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 02 10:06:47 devstack cinder-volume[86890]: INFO cinder.image.image_utils [None req-6195c092-d8b4-4669-9931-8e42d8d87406 tempest-ServerActionsTestOtherA-634183357 None] Image download 20.69 MB at 20.69 MB/s Nov 02 10:06:47 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[32636f3f-b5f3-430e-bd99-8da64039636e]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:06:47 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6195c092-d8b4-4669-9931-8e42d8d87406 tempest-ServerActionsTestOtherA-634183357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7a393fa7-4879-486c-8216-4d35448485cf_wwhiu4wydevstack@QuobyteHD {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:47 devstack sudo[91962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7a393fa7-4879-486c-8216-4d35448485cf_wwhiu4wydevstack@QuobyteHD Nov 02 10:06:47 devstack sudo[91962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:48 devstack sudo[91962]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:48 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6195c092-d8b4-4669-9931-8e42d8d87406 tempest-ServerActionsTestOtherA-634183357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7a393fa7-4879-486c-8216-4d35448485cf_wwhiu4wydevstack@QuobyteHD" returned: 0 in 0.452s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:48 devstack cinder-volume[86890]: DEBUG cinder.image.image_utils [None req-6195c092-d8b4-4669-9931-8e42d8d87406 tempest-ServerActionsTestOtherA-634183357 None] Temporary image 7a393fa7-4879-486c-8216-4d35448485cf is fetched for user 8ed51f11f81c48ab98f8d76dbe2b26e5. {{(pid=86890) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 02 10:06:48 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[20dfe610-1285-4683-a3db-0a14174eedff]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:06:48 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6195c092-d8b4-4669-9931-8e42d8d87406 tempest-ServerActionsTestOtherA-634183357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7a393fa7-4879-486c-8216-4d35448485cf_wwhiu4wydevstack@QuobyteHD {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:48 devstack sudo[91968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7a393fa7-4879-486c-8216-4d35448485cf_wwhiu4wydevstack@QuobyteHD Nov 02 10:06:48 devstack sudo[91968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:48 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-4512f34d-8a7e-4bb5-87a3-6586ee29e4fc tempest-GroupsTest-179266637 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:06:48 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-4512f34d-8a7e-4bb5-87a3-6586ee29e4fc tempest-GroupsTest-179266637 None] Flow 'volume_create_manager' (07091004-305d-4261-bddc-41cfbb04f0c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:06:48 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-4512f34d-8a7e-4bb5-87a3-6586ee29e4fc tempest-GroupsTest-179266637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2df74b6b-d1f1-4c7b-9951-20d61363ee90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:48 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-4512f34d-8a7e-4bb5-87a3-6586ee29e4fc tempest-GroupsTest-179266637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2df74b6b-d1f1-4c7b-9951-20d61363ee90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:06:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1866025173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fda8aea7-879e-48e4-b293-b7db570d4cc4,host='devstack@QuobyteHD#QuobyteHD',id=4b5568a9-a8e3-4449-af0c-9a6351cd95cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbd6917979944bb68f67a750037422b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:06:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:06:48Z,use_quota=True,user_id='47da102855ad45cb859b30644e38fa1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a90f4f85-f008-4345-ae18-e8844e0fe48a),volume_type_id=a90f4f85-f008-4345-ae18-e8844e0fe48a)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:48 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-4512f34d-8a7e-4bb5-87a3-6586ee29e4fc tempest-GroupsTest-179266637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a54da90-0f11-4cbc-bbd3-44a8a1b9b21d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:48 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-4512f34d-8a7e-4bb5-87a3-6586ee29e4fc tempest-GroupsTest-179266637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a54da90-0f11-4cbc-bbd3-44a8a1b9b21d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:48 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-4512f34d-8a7e-4bb5-87a3-6586ee29e4fc tempest-GroupsTest-179266637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f8df501-4663-46ec-a931-19ddf5c2fd50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:48 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-4512f34d-8a7e-4bb5-87a3-6586ee29e4fc tempest-GroupsTest-179266637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f8df501-4663-46ec-a931-19ddf5c2fd50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b5568a9-a8e3-4449-af0c-9a6351cd95cd', 'volume_name': 'volume-4b5568a9-a8e3-4449-af0c-9a6351cd95cd', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:48 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-4512f34d-8a7e-4bb5-87a3-6586ee29e4fc tempest-GroupsTest-179266637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbee76a4-1cde-40d5-8def-bd6e9d142372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:48 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-4512f34d-8a7e-4bb5-87a3-6586ee29e4fc tempest-GroupsTest-179266637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbee76a4-1cde-40d5-8def-bd6e9d142372) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:48 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-4512f34d-8a7e-4bb5-87a3-6586ee29e4fc tempest-GroupsTest-179266637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb52b782-883b-4134-a1bc-79ee71f20456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:48 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-4512f34d-8a7e-4bb5-87a3-6586ee29e4fc tempest-GroupsTest-179266637 None] Volume 4b5568a9-a8e3-4449-af0c-9a6351cd95cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b5568a9-a8e3-4449-af0c-9a6351cd95cd', 'volume_size': 1} Nov 02 10:06:48 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-4512f34d-8a7e-4bb5-87a3-6586ee29e4fc tempest-GroupsTest-179266637 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:06:48 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-4512f34d-8a7e-4bb5-87a3-6586ee29e4fc tempest-GroupsTest-179266637 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:06:48 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-4512f34d-8a7e-4bb5-87a3-6586ee29e4fc tempest-GroupsTest-179266637 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=fda8aea7-879e-48e4-b293-b7db570d4cc4,created_at=2026-11-02T09:06:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1866025173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fda8aea7-879e-48e4-b293-b7db570d4cc4,host='devstack@QuobyteHD#QuobyteHD',id=4b5568a9-a8e3-4449-af0c-9a6351cd95cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbd6917979944bb68f67a750037422b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:06:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:06:48Z,use_quota=True,user_id='47da102855ad45cb859b30644e38fa1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a90f4f85-f008-4345-ae18-e8844e0fe48a),volume_type_id=a90f4f85-f008-4345-ae18-e8844e0fe48a)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:06:48 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-4512f34d-8a7e-4bb5-87a3-6586ee29e4fc tempest-GroupsTest-179266637 None] Creating volume 4b5568a9-a8e3-4449-af0c-9a6351cd95cd {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:06:48 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-4512f34d-8a7e-4bb5-87a3-6586ee29e4fc tempest-GroupsTest-179266637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:06:48 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-4512f34d-8a7e-4bb5-87a3-6586ee29e4fc tempest-GroupsTest-179266637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:06:48 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-4512f34d-8a7e-4bb5-87a3-6586ee29e4fc tempest-GroupsTest-179266637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:06:48 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-4512f34d-8a7e-4bb5-87a3-6586ee29e4fc tempest-GroupsTest-179266637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:06:48 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-4512f34d-8a7e-4bb5-87a3-6586ee29e4fc tempest-GroupsTest-179266637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:06:48 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-4512f34d-8a7e-4bb5-87a3-6586ee29e4fc tempest-GroupsTest-179266637 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:06:48 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-4512f34d-8a7e-4bb5-87a3-6586ee29e4fc tempest-GroupsTest-179266637 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:06:48 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-4512f34d-8a7e-4bb5-87a3-6586ee29e4fc tempest-GroupsTest-179266637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-4b5568a9-a8e3-4449-af0c-9a6351cd95cd 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:48 devstack sudo[91970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-4b5568a9-a8e3-4449-af0c-9a6351cd95cd 1073741824 Nov 02 10:06:48 devstack sudo[91970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:48 devstack sudo[91968]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:48 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6195c092-d8b4-4669-9931-8e42d8d87406 tempest-ServerActionsTestOtherA-634183357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7a393fa7-4879-486c-8216-4d35448485cf_wwhiu4wydevstack@QuobyteHD" returned: 0 in 0.441s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:48 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-6195c092-d8b4-4669-9931-8e42d8d87406 tempest-ServerActionsTestOtherA-634183357 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:06:49 devstack sudo[91970]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:49 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-4512f34d-8a7e-4bb5-87a3-6586ee29e4fc tempest-GroupsTest-179266637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-4b5568a9-a8e3-4449-af0c-9a6351cd95cd 1073741824" returned: 0 in 0.634s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:49 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-4512f34d-8a7e-4bb5-87a3-6586ee29e4fc tempest-GroupsTest-179266637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-4b5568a9-a8e3-4449-af0c-9a6351cd95cd {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:49 devstack sudo[91980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-4b5568a9-a8e3-4449-af0c-9a6351cd95cd Nov 02 10:06:49 devstack sudo[91980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:49 devstack sudo[91980]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:49 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-4512f34d-8a7e-4bb5-87a3-6586ee29e4fc tempest-GroupsTest-179266637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-4b5568a9-a8e3-4449-af0c-9a6351cd95cd" returned: 0 in 0.295s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:49 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-4512f34d-8a7e-4bb5-87a3-6586ee29e4fc tempest-GroupsTest-179266637 None] <== create_volume: return (985ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:06:49 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-4512f34d-8a7e-4bb5-87a3-6586ee29e4fc tempest-GroupsTest-179266637 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.988s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:06:49 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-6195c092-d8b4-4669-9931-8e42d8d87406 tempest-ServerActionsTestOtherA-634183357 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.827s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:06:49 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-6195c092-d8b4-4669-9931-8e42d8d87406 tempest-ServerActionsTestOtherA-634183357 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:06:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1812835969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b09d6b7-2f7c-479f-8124-3b45da495257,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af61e3c9113b42269134b4a5c4b58a6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:06:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:06:46Z,use_quota=True,user_id='8ed51f11f81c48ab98f8d76dbe2b26e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:06:49 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-6195c092-d8b4-4669-9931-8e42d8d87406 tempest-ServerActionsTestOtherA-634183357 None] Creating volume 6b09d6b7-2f7c-479f-8124-3b45da495257 {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:06:49 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-6195c092-d8b4-4669-9931-8e42d8d87406 tempest-ServerActionsTestOtherA-634183357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:06:49 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-6195c092-d8b4-4669-9931-8e42d8d87406 tempest-ServerActionsTestOtherA-634183357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:06:49 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-6195c092-d8b4-4669-9931-8e42d8d87406 tempest-ServerActionsTestOtherA-634183357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:06:49 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-6195c092-d8b4-4669-9931-8e42d8d87406 tempest-ServerActionsTestOtherA-634183357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:06:49 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-6195c092-d8b4-4669-9931-8e42d8d87406 tempest-ServerActionsTestOtherA-634183357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:06:49 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-6195c092-d8b4-4669-9931-8e42d8d87406 tempest-ServerActionsTestOtherA-634183357 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:06:49 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-6195c092-d8b4-4669-9931-8e42d8d87406 tempest-ServerActionsTestOtherA-634183357 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:06:49 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6195c092-d8b4-4669-9931-8e42d8d87406 tempest-ServerActionsTestOtherA-634183357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-6b09d6b7-2f7c-479f-8124-3b45da495257 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:49 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-4512f34d-8a7e-4bb5-87a3-6586ee29e4fc tempest-GroupsTest-179266637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb52b782-883b-4134-a1bc-79ee71f20456) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b5568a9-a8e3-4449-af0c-9a6351cd95cd', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:49 devstack sudo[91983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-6b09d6b7-2f7c-479f-8124-3b45da495257 1073741824 Nov 02 10:06:49 devstack sudo[91983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:49 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-4512f34d-8a7e-4bb5-87a3-6586ee29e4fc tempest-GroupsTest-179266637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (390aa0d6-670e-4292-90e2-bcd258151dc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:49 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-4512f34d-8a7e-4bb5-87a3-6586ee29e4fc tempest-GroupsTest-179266637 None] Volume volume-4b5568a9-a8e3-4449-af0c-9a6351cd95cd (4b5568a9-a8e3-4449-af0c-9a6351cd95cd): created successfully Nov 02 10:06:49 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-4512f34d-8a7e-4bb5-87a3-6586ee29e4fc tempest-GroupsTest-179266637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (390aa0d6-670e-4292-90e2-bcd258151dc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:49 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-4512f34d-8a7e-4bb5-87a3-6586ee29e4fc tempest-GroupsTest-179266637 None] Flow 'volume_create_manager' (07091004-305d-4261-bddc-41cfbb04f0c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:06:49 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-4512f34d-8a7e-4bb5-87a3-6586ee29e4fc tempest-GroupsTest-179266637 None] Created volume successfully. Nov 02 10:06:50 devstack sudo[91983]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:50 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6195c092-d8b4-4669-9931-8e42d8d87406 tempest-ServerActionsTestOtherA-634183357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-6b09d6b7-2f7c-479f-8124-3b45da495257 1073741824" returned: 0 in 0.537s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:50 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6195c092-d8b4-4669-9931-8e42d8d87406 tempest-ServerActionsTestOtherA-634183357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-6b09d6b7-2f7c-479f-8124-3b45da495257 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:50 devstack sudo[91989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-6b09d6b7-2f7c-479f-8124-3b45da495257 Nov 02 10:06:50 devstack sudo[91989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:50 devstack sudo[91989]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:50 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6195c092-d8b4-4669-9931-8e42d8d87406 tempest-ServerActionsTestOtherA-634183357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-6b09d6b7-2f7c-479f-8124-3b45da495257" returned: 0 in 0.249s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:50 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-6195c092-d8b4-4669-9931-8e42d8d87406 tempest-ServerActionsTestOtherA-634183357 None] <== create_volume: return (839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:06:50 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-6195c092-d8b4-4669-9931-8e42d8d87406 tempest-ServerActionsTestOtherA-634183357 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.844s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:06:50 devstack cinder-volume[86890]: DEBUG cinder.volume.volume_utils [None req-6195c092-d8b4-4669-9931-8e42d8d87406 tempest-ServerActionsTestOtherA-634183357 None] Attempting download of 7a393fa7-4879-486c-8216-4d35448485cf ((None, [{'url': 'file:///opt/stack/data/glance/images/7a393fa7-4879-486c-8216-4d35448485cf', 'metadata': {}}])) to volume 6b09d6b7-2f7c-479f-8124-3b45da495257. {{(pid=86890) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 02 10:06:50 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[60809adf-f86b-468c-bf15-013e4da7984c]: (4, 'raw') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:06:50 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6195c092-d8b4-4669-9931-8e42d8d87406 tempest-ServerActionsTestOtherA-634183357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7a393fa7-4879-486c-8216-4d35448485cf_bbt9352u {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:50 devstack sudo[91992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7a393fa7-4879-486c-8216-4d35448485cf_bbt9352u Nov 02 10:06:50 devstack sudo[91992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:50 devstack sudo[91992]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:50 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6195c092-d8b4-4669-9931-8e42d8d87406 tempest-ServerActionsTestOtherA-634183357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7a393fa7-4879-486c-8216-4d35448485cf_bbt9352u" returned: 0 in 0.410s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:50 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6195c092-d8b4-4669-9931-8e42d8d87406 tempest-ServerActionsTestOtherA-634183357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7a393fa7-4879-486c-8216-4d35448485cf_bbt9352u {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:51 devstack sudo[91997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7a393fa7-4879-486c-8216-4d35448485cf_bbt9352u Nov 02 10:06:51 devstack sudo[91997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:51 devstack sudo[91997]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:51 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6195c092-d8b4-4669-9931-8e42d8d87406 tempest-ServerActionsTestOtherA-634183357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7a393fa7-4879-486c-8216-4d35448485cf_bbt9352u" returned: 1 in 0.494s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:51 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6195c092-d8b4-4669-9931-8e42d8d87406 tempest-ServerActionsTestOtherA-634183357 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7a393fa7-4879-486c-8216-4d35448485cf_bbt9352u' failed. Not Retrying. {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 10:06:51 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a1c57fa-93bb-422c-af2e-5b9fc4d20a65]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:06:51 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6195c092-d8b4-4669-9931-8e42d8d87406 tempest-ServerActionsTestOtherA-634183357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7a393fa7-4879-486c-8216-4d35448485cf_wwhiu4wydevstack@QuobyteHD {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:51 devstack sudo[92003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7a393fa7-4879-486c-8216-4d35448485cf_wwhiu4wydevstack@QuobyteHD Nov 02 10:06:51 devstack sudo[92003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:51 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-f1de7cb4-fec4-4fd1-82f6-1fa0f2f1df6e tempest-GroupsTest-179266637 None] Acquiring lock "cinder-quobyte-4b5568a9-a8e3-4449-af0c-9a6351cd95cd" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:06:51 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-f1de7cb4-fec4-4fd1-82f6-1fa0f2f1df6e tempest-GroupsTest-179266637 None] Lock "cinder-quobyte-4b5568a9-a8e3-4449-af0c-9a6351cd95cd" acquired by "delete_volume" :: waited 0.021s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:06:51 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[b06d5455-e1f7-46a9-aadc-f231aea2a116]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:06:51 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-f1de7cb4-fec4-4fd1-82f6-1fa0f2f1df6e tempest-GroupsTest-179266637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-4b5568a9-a8e3-4449-af0c-9a6351cd95cd {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:51 devstack sudo[92003]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:51 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6195c092-d8b4-4669-9931-8e42d8d87406 tempest-ServerActionsTestOtherA-634183357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7a393fa7-4879-486c-8216-4d35448485cf_wwhiu4wydevstack@QuobyteHD" returned: 0 in 0.529s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:51 devstack cinder-volume[86890]: DEBUG cinder.image.image_utils [None req-6195c092-d8b4-4669-9931-8e42d8d87406 tempest-ServerActionsTestOtherA-634183357 None] 7a393fa7-4879-486c-8216-4d35448485cf was qcow2, converting to qcow2 {{(pid=86890) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 02 10:06:51 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6195c092-d8b4-4669-9931-8e42d8d87406 tempest-ServerActionsTestOtherA-634183357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7a393fa7-4879-486c-8216-4d35448485cf_wwhiu4wydevstack@QuobyteHD /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-6b09d6b7-2f7c-479f-8124-3b45da495257 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:52 devstack sudo[92013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7a393fa7-4879-486c-8216-4d35448485cf_wwhiu4wydevstack@QuobyteHD /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-6b09d6b7-2f7c-479f-8124-3b45da495257 Nov 02 10:06:52 devstack sudo[92013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:52 devstack sudo[92011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-4b5568a9-a8e3-4449-af0c-9a6351cd95cd Nov 02 10:06:52 devstack sudo[92011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:52 devstack sudo[92011]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:52 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-f1de7cb4-fec4-4fd1-82f6-1fa0f2f1df6e tempest-GroupsTest-179266637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-4b5568a9-a8e3-4449-af0c-9a6351cd95cd" returned: 0 in 0.695s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:52 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-f1de7cb4-fec4-4fd1-82f6-1fa0f2f1df6e tempest-GroupsTest-179266637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-4b5568a9-a8e3-4449-af0c-9a6351cd95cd {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:52 devstack sudo[92041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-4b5568a9-a8e3-4449-af0c-9a6351cd95cd Nov 02 10:06:52 devstack sudo[92041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:53 devstack sudo[92041]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:53 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-f1de7cb4-fec4-4fd1-82f6-1fa0f2f1df6e tempest-GroupsTest-179266637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-4b5568a9-a8e3-4449-af0c-9a6351cd95cd" returned: 0 in 0.429s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:53 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-f1de7cb4-fec4-4fd1-82f6-1fa0f2f1df6e tempest-GroupsTest-179266637 None] Lock "cinder-quobyte-4b5568a9-a8e3-4449-af0c-9a6351cd95cd" released by "delete_volume" :: held 1.197s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:06:53 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-f1de7cb4-fec4-4fd1-82f6-1fa0f2f1df6e tempest-GroupsTest-179266637 None] Created reservations ['6778717c-2efa-41dc-8c59-d900c2841855'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:06:53 devstack cinder-volume[86890]: WARNING cinder.quota [None req-f1de7cb4-fec4-4fd1-82f6-1fa0f2f1df6e tempest-GroupsTest-179266637 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1614705446 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1614705446, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:06:53 devstack cinder-volume[86890]: WARNING cinder.quota [None req-f1de7cb4-fec4-4fd1-82f6-1fa0f2f1df6e tempest-GroupsTest-179266637 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1614705446 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1614705446, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:06:53 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-f1de7cb4-fec4-4fd1-82f6-1fa0f2f1df6e tempest-GroupsTest-179266637 None] Created reservations ['4f3b1793-7bb5-420a-9b93-4b7e981926da', '12c22ba9-1352-4035-8517-221d8cced952', '20b77a72-7738-4221-acf8-8465edb6172b', '340dfdd7-221f-4a79-bc2d-fe3ed5ec80e5'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:06:53 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-f1de7cb4-fec4-4fd1-82f6-1fa0f2f1df6e tempest-GroupsTest-179266637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:06:53 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-f1de7cb4-fec4-4fd1-82f6-1fa0f2f1df6e tempest-GroupsTest-179266637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:06:53 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-f1de7cb4-fec4-4fd1-82f6-1fa0f2f1df6e tempest-GroupsTest-179266637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:06:53 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-f1de7cb4-fec4-4fd1-82f6-1fa0f2f1df6e tempest-GroupsTest-179266637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:06:53 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-f1de7cb4-fec4-4fd1-82f6-1fa0f2f1df6e tempest-GroupsTest-179266637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:06:53 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-f1de7cb4-fec4-4fd1-82f6-1fa0f2f1df6e tempest-GroupsTest-179266637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:53 devstack sudo[92049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:06:53 devstack sudo[92049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:53 devstack sudo[92049]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:53 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-f1de7cb4-fec4-4fd1-82f6-1fa0f2f1df6e tempest-GroupsTest-179266637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.413s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:53 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-f1de7cb4-fec4-4fd1-82f6-1fa0f2f1df6e tempest-GroupsTest-179266637 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:06:54 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-f1de7cb4-fec4-4fd1-82f6-1fa0f2f1df6e tempest-GroupsTest-179266637 None] Delete group completed successfully. Nov 02 10:06:54 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-aae47bb5-7891-4774-9786-247c4822c089 tempest-GroupsTest-179266637 None] Created reservations ['811a183b-4572-4251-8af9-730a8c673c7b'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:06:54 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-aae47bb5-7891-4774-9786-247c4822c089 tempest-GroupsTest-179266637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:06:54 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-aae47bb5-7891-4774-9786-247c4822c089 tempest-GroupsTest-179266637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:06:54 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-aae47bb5-7891-4774-9786-247c4822c089 tempest-GroupsTest-179266637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:06:54 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-aae47bb5-7891-4774-9786-247c4822c089 tempest-GroupsTest-179266637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:06:54 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-aae47bb5-7891-4774-9786-247c4822c089 tempest-GroupsTest-179266637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:06:54 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-aae47bb5-7891-4774-9786-247c4822c089 tempest-GroupsTest-179266637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:54 devstack sudo[92054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:06:54 devstack sudo[92054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:55 devstack sudo[92013]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:55 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6195c092-d8b4-4669-9931-8e42d8d87406 tempest-ServerActionsTestOtherA-634183357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7a393fa7-4879-486c-8216-4d35448485cf_wwhiu4wydevstack@QuobyteHD /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-6b09d6b7-2f7c-479f-8124-3b45da495257" returned: 0 in 3.102s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:55 devstack cinder-volume[86890]: DEBUG cinder.image.image_utils [None req-6195c092-d8b4-4669-9931-8e42d8d87406 tempest-ServerActionsTestOtherA-634183357 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7a393fa7-4879-486c-8216-4d35448485cf_wwhiu4wydevstack@QuobyteHD, size 112.00 MB, duration 3.10 sec, destination /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-6b09d6b7-2f7c-479f-8124-3b45da495257 {{(pid=86890) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 10:06:55 devstack cinder-volume[86890]: INFO cinder.image.image_utils [None req-6195c092-d8b4-4669-9931-8e42d8d87406 tempest-ServerActionsTestOtherA-634183357 None] Converted 112.00 MB image at 36.09 MB/s Nov 02 10:06:55 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6195c092-d8b4-4669-9931-8e42d8d87406 tempest-ServerActionsTestOtherA-634183357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-6b09d6b7-2f7c-479f-8124-3b45da495257 1G {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:55 devstack sudo[92056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-6b09d6b7-2f7c-479f-8124-3b45da495257 1G Nov 02 10:06:55 devstack sudo[92056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:55 devstack sudo[92054]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:55 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-aae47bb5-7891-4774-9786-247c4822c089 tempest-GroupsTest-179266637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.363s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:55 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-aae47bb5-7891-4774-9786-247c4822c089 tempest-GroupsTest-179266637 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:06:55 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-aae47bb5-7891-4774-9786-247c4822c089 tempest-GroupsTest-179266637 None] Delete group completed successfully. Nov 02 10:06:55 devstack sudo[92056]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:55 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6195c092-d8b4-4669-9931-8e42d8d87406 tempest-ServerActionsTestOtherA-634183357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-6b09d6b7-2f7c-479f-8124-3b45da495257 1G" returned: 0 in 0.432s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:55 devstack cinder-volume[86890]: DEBUG cinder.volume.volume_utils [None req-6195c092-d8b4-4669-9931-8e42d8d87406 tempest-ServerActionsTestOtherA-634183357 None] Downloaded image 7a393fa7-4879-486c-8216-4d35448485cf ((None, [{'url': 'file:///opt/stack/data/glance/images/7a393fa7-4879-486c-8216-4d35448485cf', 'metadata': {}}])) to volume 6b09d6b7-2f7c-479f-8124-3b45da495257 successfully. {{(pid=86890) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 02 10:06:55 devstack cinder-volume[86890]: DEBUG cinder.image.image_utils [None req-6195c092-d8b4-4669-9931-8e42d8d87406 tempest-ServerActionsTestOtherA-634183357 None] Temporary image 7a393fa7-4879-486c-8216-4d35448485cf for user 8ed51f11f81c48ab98f8d76dbe2b26e5 is deleted. {{(pid=86890) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 02 10:06:55 devstack cinder-volume[86890]: DEBUG cinder.volume.volume_utils [None req-6195c092-d8b4-4669-9931-8e42d8d87406 tempest-ServerActionsTestOtherA-634183357 None] Marking volume 6b09d6b7-2f7c-479f-8124-3b45da495257 as bootable. {{(pid=86890) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 02 10:06:55 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-6195c092-d8b4-4669-9931-8e42d8d87406 tempest-ServerActionsTestOtherA-634183357 None] Copying metadata from image 7a393fa7-4879-486c-8216-4d35448485cf to 6b09d6b7-2f7c-479f-8124-3b45da495257. {{(pid=86890) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 10:06:55 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-6195c092-d8b4-4669-9931-8e42d8d87406 tempest-ServerActionsTestOtherA-634183357 None] Creating volume glance metadata for volume 6b09d6b7-2f7c-479f-8124-3b45da495257 backed by image 7a393fa7-4879-486c-8216-4d35448485cf with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '7a393fa7-4879-486c-8216-4d35448485cf', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86890) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 10:06:55 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-6195c092-d8b4-4669-9931-8e42d8d87406 tempest-ServerActionsTestOtherA-634183357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f3d0c72-6b40-45d9-aefd-668ae92f8219) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b09d6b7-2f7c-479f-8124-3b45da495257', 'volume_size': 1, 'image_id': '7a393fa7-4879-486c-8216-4d35448485cf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7a393fa7-4879-486c-8216-4d35448485cf', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '606cf27a36794aa3805ebe6d987aa1a4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7a393fa7-4879-486c-8216-4d35448485cf', 'created_at': datetime.datetime(2026, 11, 2, 8, 55, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 8, 55, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7a393fa7-4879-486c-8216-4d35448485cf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:55 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-6195c092-d8b4-4669-9931-8e42d8d87406 tempest-ServerActionsTestOtherA-634183357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3442f0b-90d1-4ec4-9318-7a41e88b86e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:55 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-6195c092-d8b4-4669-9931-8e42d8d87406 tempest-ServerActionsTestOtherA-634183357 None] Volume volume-6b09d6b7-2f7c-479f-8124-3b45da495257 (6b09d6b7-2f7c-479f-8124-3b45da495257): created successfully Nov 02 10:06:55 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-6195c092-d8b4-4669-9931-8e42d8d87406 tempest-ServerActionsTestOtherA-634183357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3442f0b-90d1-4ec4-9318-7a41e88b86e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:55 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-6195c092-d8b4-4669-9931-8e42d8d87406 tempest-ServerActionsTestOtherA-634183357 None] Flow 'volume_create_manager' (a132226a-635c-40bb-8ac5-2d80cd187b5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:06:55 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-6195c092-d8b4-4669-9931-8e42d8d87406 tempest-ServerActionsTestOtherA-634183357 None] Created volume successfully. Nov 02 10:06:56 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-c56d6ad3-e4e8-43e7-bc72-9c52c05401c7 tempest-GroupsTest-179266637 None] Group tempest-GroupsTest-Group-1991867498: creating Nov 02 10:06:56 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-c56d6ad3-e4e8-43e7-bc72-9c52c05401c7 tempest-GroupsTest-179266637 None] Group tempest-GroupsTest-Group-1991867498: created successfully Nov 02 10:06:56 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-c56d6ad3-e4e8-43e7-bc72-9c52c05401c7 tempest-GroupsTest-179266637 None] Create group completed successfully. Nov 02 10:06:58 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-19b62185-b4f3-4db7-9c09-73f7fd2c7159 tempest-GroupsTest-179266637 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:06:58 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-19b62185-b4f3-4db7-9c09-73f7fd2c7159 tempest-GroupsTest-179266637 None] Flow 'volume_create_manager' (91ec7556-477e-442d-9f88-649fab28533e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:06:58 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-19b62185-b4f3-4db7-9c09-73f7fd2c7159 tempest-GroupsTest-179266637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1799169f-82b7-4e0a-8299-e95ff9afd00d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:58 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-19b62185-b4f3-4db7-9c09-73f7fd2c7159 tempest-GroupsTest-179266637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1799169f-82b7-4e0a-8299-e95ff9afd00d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:06:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1029941837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e1f2587e-df84-4e3c-bfd4-31c65ff7c4fd,host='devstack@QuobyteHD#QuobyteHD',id=59f70687-a080-476c-8acd-23d00d59a821,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbd6917979944bb68f67a750037422b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:06:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:06:58Z,use_quota=True,user_id='47da102855ad45cb859b30644e38fa1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a4ef0ea-52c3-4294-89f1-8302d97029a7),volume_type_id=2a4ef0ea-52c3-4294-89f1-8302d97029a7)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:58 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-19b62185-b4f3-4db7-9c09-73f7fd2c7159 tempest-GroupsTest-179266637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (098d3967-d7b2-4c14-b106-b7ea83241a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:58 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-19b62185-b4f3-4db7-9c09-73f7fd2c7159 tempest-GroupsTest-179266637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (098d3967-d7b2-4c14-b106-b7ea83241a73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:58 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-19b62185-b4f3-4db7-9c09-73f7fd2c7159 tempest-GroupsTest-179266637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05fe3831-b1de-42e8-a0f8-2b6077cd1e24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:58 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-19b62185-b4f3-4db7-9c09-73f7fd2c7159 tempest-GroupsTest-179266637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05fe3831-b1de-42e8-a0f8-2b6077cd1e24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59f70687-a080-476c-8acd-23d00d59a821', 'volume_name': 'volume-59f70687-a080-476c-8acd-23d00d59a821', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:58 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-19b62185-b4f3-4db7-9c09-73f7fd2c7159 tempest-GroupsTest-179266637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4ace429-4be5-4380-a474-31750d6622d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:58 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-19b62185-b4f3-4db7-9c09-73f7fd2c7159 tempest-GroupsTest-179266637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4ace429-4be5-4380-a474-31750d6622d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:58 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-19b62185-b4f3-4db7-9c09-73f7fd2c7159 tempest-GroupsTest-179266637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2482e6ec-ede5-4c21-8a94-253fef7eaff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:58 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-19b62185-b4f3-4db7-9c09-73f7fd2c7159 tempest-GroupsTest-179266637 None] Volume 59f70687-a080-476c-8acd-23d00d59a821: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59f70687-a080-476c-8acd-23d00d59a821', 'volume_size': 1} Nov 02 10:06:58 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-19b62185-b4f3-4db7-9c09-73f7fd2c7159 tempest-GroupsTest-179266637 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:06:58 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-19b62185-b4f3-4db7-9c09-73f7fd2c7159 tempest-GroupsTest-179266637 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:06:58 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-19b62185-b4f3-4db7-9c09-73f7fd2c7159 tempest-GroupsTest-179266637 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e1f2587e-df84-4e3c-bfd4-31c65ff7c4fd,created_at=2026-11-02T09:06:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1029941837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e1f2587e-df84-4e3c-bfd4-31c65ff7c4fd,host='devstack@QuobyteHD#QuobyteHD',id=59f70687-a080-476c-8acd-23d00d59a821,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbd6917979944bb68f67a750037422b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:06:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:06:58Z,use_quota=True,user_id='47da102855ad45cb859b30644e38fa1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a4ef0ea-52c3-4294-89f1-8302d97029a7),volume_type_id=2a4ef0ea-52c3-4294-89f1-8302d97029a7)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:06:58 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-19b62185-b4f3-4db7-9c09-73f7fd2c7159 tempest-GroupsTest-179266637 None] Creating volume 59f70687-a080-476c-8acd-23d00d59a821 {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:06:58 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-19b62185-b4f3-4db7-9c09-73f7fd2c7159 tempest-GroupsTest-179266637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:06:58 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-19b62185-b4f3-4db7-9c09-73f7fd2c7159 tempest-GroupsTest-179266637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:06:58 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-19b62185-b4f3-4db7-9c09-73f7fd2c7159 tempest-GroupsTest-179266637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:06:58 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-19b62185-b4f3-4db7-9c09-73f7fd2c7159 tempest-GroupsTest-179266637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:06:58 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-19b62185-b4f3-4db7-9c09-73f7fd2c7159 tempest-GroupsTest-179266637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:06:58 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-19b62185-b4f3-4db7-9c09-73f7fd2c7159 tempest-GroupsTest-179266637 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:06:58 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-19b62185-b4f3-4db7-9c09-73f7fd2c7159 tempest-GroupsTest-179266637 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:06:58 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-19b62185-b4f3-4db7-9c09-73f7fd2c7159 tempest-GroupsTest-179266637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-59f70687-a080-476c-8acd-23d00d59a821 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:58 devstack sudo[92065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-59f70687-a080-476c-8acd-23d00d59a821 1073741824 Nov 02 10:06:58 devstack sudo[92065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:59 devstack sudo[92065]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:59 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-19b62185-b4f3-4db7-9c09-73f7fd2c7159 tempest-GroupsTest-179266637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-59f70687-a080-476c-8acd-23d00d59a821 1073741824" returned: 0 in 0.617s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:59 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-19b62185-b4f3-4db7-9c09-73f7fd2c7159 tempest-GroupsTest-179266637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-59f70687-a080-476c-8acd-23d00d59a821 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:59 devstack sudo[92071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-59f70687-a080-476c-8acd-23d00d59a821 Nov 02 10:06:59 devstack sudo[92071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:59 devstack sudo[92071]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:59 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-19b62185-b4f3-4db7-9c09-73f7fd2c7159 tempest-GroupsTest-179266637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-59f70687-a080-476c-8acd-23d00d59a821" returned: 0 in 0.314s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:59 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-19b62185-b4f3-4db7-9c09-73f7fd2c7159 tempest-GroupsTest-179266637 None] <== create_volume: return (977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:06:59 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-19b62185-b4f3-4db7-9c09-73f7fd2c7159 tempest-GroupsTest-179266637 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.979s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:06:59 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-19b62185-b4f3-4db7-9c09-73f7fd2c7159 tempest-GroupsTest-179266637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2482e6ec-ede5-4c21-8a94-253fef7eaff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59f70687-a080-476c-8acd-23d00d59a821', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:59 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-19b62185-b4f3-4db7-9c09-73f7fd2c7159 tempest-GroupsTest-179266637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (256afc59-7e88-464f-b3a2-c8f5b7c7afe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:59 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-19b62185-b4f3-4db7-9c09-73f7fd2c7159 tempest-GroupsTest-179266637 None] Volume volume-59f70687-a080-476c-8acd-23d00d59a821 (59f70687-a080-476c-8acd-23d00d59a821): created successfully Nov 02 10:06:59 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-19b62185-b4f3-4db7-9c09-73f7fd2c7159 tempest-GroupsTest-179266637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (256afc59-7e88-464f-b3a2-c8f5b7c7afe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:59 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-19b62185-b4f3-4db7-9c09-73f7fd2c7159 tempest-GroupsTest-179266637 None] Flow 'volume_create_manager' (91ec7556-477e-442d-9f88-649fab28533e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:06:59 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-19b62185-b4f3-4db7-9c09-73f7fd2c7159 tempest-GroupsTest-179266637 None] Created volume successfully. Nov 02 10:07:00 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [req-ee0546b6-30f7-4a23-8900-613e4996ae0b req-8735971f-e0fa-4dc0-b903-d0c3bd05afb9 tempest-ServerActionsTestOtherA-634183357 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:07:00 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [req-ee0546b6-30f7-4a23-8900-613e4996ae0b req-8735971f-e0fa-4dc0-b903-d0c3bd05afb9 tempest-ServerActionsTestOtherA-634183357 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:07:00 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [req-ee0546b6-30f7-4a23-8900-613e4996ae0b req-8735971f-e0fa-4dc0-b903-d0c3bd05afb9 tempest-ServerActionsTestOtherA-634183357 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:07:00 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [req-ee0546b6-30f7-4a23-8900-613e4996ae0b req-8735971f-e0fa-4dc0-b903-d0c3bd05afb9 tempest-ServerActionsTestOtherA-634183357 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67', 'name': 'volume-6b09d6b7-2f7c-479f-8124-3b45da495257', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd0f69cf0-c239-45de-b7cd-eb8ec3e9d251', 'enforce_multipath': True} {{(pid=86890) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:07:00 devstack cinder-volume[86890]: INFO cinder.volume.manager [req-ee0546b6-30f7-4a23-8900-613e4996ae0b req-8735971f-e0fa-4dc0-b903-d0c3bd05afb9 tempest-ServerActionsTestOtherA-634183357 None] attachment_update completed successfully. Nov 02 10:07:01 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8e400c9-a8a2-4554-b922-9a9284903142 tempest-GroupsTest-179266637 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:07:01 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c8e400c9-a8a2-4554-b922-9a9284903142 tempest-GroupsTest-179266637 None] Flow 'volume_create_manager' (d900603d-e67b-470e-933b-fff909b06b27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:07:01 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c8e400c9-a8a2-4554-b922-9a9284903142 tempest-GroupsTest-179266637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccd1cdc7-3629-4c51-901e-fe8391c46b82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:07:01 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c8e400c9-a8a2-4554-b922-9a9284903142 tempest-GroupsTest-179266637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccd1cdc7-3629-4c51-901e-fe8391c46b82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:07:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2146404368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e1f2587e-df84-4e3c-bfd4-31c65ff7c4fd,host='devstack@QuobyteHD#QuobyteHD',id=b38a1adc-d1f5-4fa1-b807-ded39422e495,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbd6917979944bb68f67a750037422b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:07:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:07:02Z,use_quota=True,user_id='47da102855ad45cb859b30644e38fa1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a4ef0ea-52c3-4294-89f1-8302d97029a7),volume_type_id=2a4ef0ea-52c3-4294-89f1-8302d97029a7)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:07:02 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c8e400c9-a8a2-4554-b922-9a9284903142 tempest-GroupsTest-179266637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49e857a9-45ca-45e1-a1db-826e518a57b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:07:02 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c8e400c9-a8a2-4554-b922-9a9284903142 tempest-GroupsTest-179266637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49e857a9-45ca-45e1-a1db-826e518a57b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:07:02 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c8e400c9-a8a2-4554-b922-9a9284903142 tempest-GroupsTest-179266637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0817cefa-b0cb-4895-86e4-37d2f9e2a936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:07:02 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c8e400c9-a8a2-4554-b922-9a9284903142 tempest-GroupsTest-179266637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0817cefa-b0cb-4895-86e4-37d2f9e2a936) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b38a1adc-d1f5-4fa1-b807-ded39422e495', 'volume_name': 'volume-b38a1adc-d1f5-4fa1-b807-ded39422e495', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:07:02 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c8e400c9-a8a2-4554-b922-9a9284903142 tempest-GroupsTest-179266637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa669d09-9961-4fcc-8245-b5443362c215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:07:02 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c8e400c9-a8a2-4554-b922-9a9284903142 tempest-GroupsTest-179266637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa669d09-9961-4fcc-8245-b5443362c215) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:07:02 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c8e400c9-a8a2-4554-b922-9a9284903142 tempest-GroupsTest-179266637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41e0479a-7ae0-4a17-9ff7-710c20fd7892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:07:02 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-c8e400c9-a8a2-4554-b922-9a9284903142 tempest-GroupsTest-179266637 None] Volume b38a1adc-d1f5-4fa1-b807-ded39422e495: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b38a1adc-d1f5-4fa1-b807-ded39422e495', 'volume_size': 1} Nov 02 10:07:02 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c8e400c9-a8a2-4554-b922-9a9284903142 tempest-GroupsTest-179266637 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:07:02 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c8e400c9-a8a2-4554-b922-9a9284903142 tempest-GroupsTest-179266637 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:07:02 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c8e400c9-a8a2-4554-b922-9a9284903142 tempest-GroupsTest-179266637 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e1f2587e-df84-4e3c-bfd4-31c65ff7c4fd,created_at=2026-11-02T09:07:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2146404368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e1f2587e-df84-4e3c-bfd4-31c65ff7c4fd,host='devstack@QuobyteHD#QuobyteHD',id=b38a1adc-d1f5-4fa1-b807-ded39422e495,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbd6917979944bb68f67a750037422b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:07:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:07:02Z,use_quota=True,user_id='47da102855ad45cb859b30644e38fa1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a4ef0ea-52c3-4294-89f1-8302d97029a7),volume_type_id=2a4ef0ea-52c3-4294-89f1-8302d97029a7)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:07:02 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-c8e400c9-a8a2-4554-b922-9a9284903142 tempest-GroupsTest-179266637 None] Creating volume b38a1adc-d1f5-4fa1-b807-ded39422e495 {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:07:02 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c8e400c9-a8a2-4554-b922-9a9284903142 tempest-GroupsTest-179266637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:07:02 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c8e400c9-a8a2-4554-b922-9a9284903142 tempest-GroupsTest-179266637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:07:02 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c8e400c9-a8a2-4554-b922-9a9284903142 tempest-GroupsTest-179266637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:07:02 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c8e400c9-a8a2-4554-b922-9a9284903142 tempest-GroupsTest-179266637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:07:02 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c8e400c9-a8a2-4554-b922-9a9284903142 tempest-GroupsTest-179266637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:07:02 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c8e400c9-a8a2-4554-b922-9a9284903142 tempest-GroupsTest-179266637 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:07:02 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-c8e400c9-a8a2-4554-b922-9a9284903142 tempest-GroupsTest-179266637 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:07:02 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c8e400c9-a8a2-4554-b922-9a9284903142 tempest-GroupsTest-179266637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b38a1adc-d1f5-4fa1-b807-ded39422e495 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:07:02 devstack sudo[92088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b38a1adc-d1f5-4fa1-b807-ded39422e495 1073741824 Nov 02 10:07:02 devstack sudo[92088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:07:02 devstack sudo[92088]: pam_unix(sudo:session): session closed for user root Nov 02 10:07:02 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c8e400c9-a8a2-4554-b922-9a9284903142 tempest-GroupsTest-179266637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b38a1adc-d1f5-4fa1-b807-ded39422e495 1073741824" returned: 0 in 0.686s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:07:02 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c8e400c9-a8a2-4554-b922-9a9284903142 tempest-GroupsTest-179266637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b38a1adc-d1f5-4fa1-b807-ded39422e495 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:07:02 devstack sudo[92102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b38a1adc-d1f5-4fa1-b807-ded39422e495 Nov 02 10:07:02 devstack sudo[92102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:07:03 devstack sudo[92102]: pam_unix(sudo:session): session closed for user root Nov 02 10:07:03 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c8e400c9-a8a2-4554-b922-9a9284903142 tempest-GroupsTest-179266637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b38a1adc-d1f5-4fa1-b807-ded39422e495" returned: 0 in 0.407s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:07:03 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c8e400c9-a8a2-4554-b922-9a9284903142 tempest-GroupsTest-179266637 None] <== create_volume: return (1195ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:07:03 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c8e400c9-a8a2-4554-b922-9a9284903142 tempest-GroupsTest-179266637 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.200s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:07:03 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c8e400c9-a8a2-4554-b922-9a9284903142 tempest-GroupsTest-179266637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41e0479a-7ae0-4a17-9ff7-710c20fd7892) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b38a1adc-d1f5-4fa1-b807-ded39422e495', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:07:03 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c8e400c9-a8a2-4554-b922-9a9284903142 tempest-GroupsTest-179266637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8242a995-27f3-4569-8746-b42c8d1840f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:07:03 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-c8e400c9-a8a2-4554-b922-9a9284903142 tempest-GroupsTest-179266637 None] Volume volume-b38a1adc-d1f5-4fa1-b807-ded39422e495 (b38a1adc-d1f5-4fa1-b807-ded39422e495): created successfully Nov 02 10:07:03 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c8e400c9-a8a2-4554-b922-9a9284903142 tempest-GroupsTest-179266637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8242a995-27f3-4569-8746-b42c8d1840f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:07:03 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c8e400c9-a8a2-4554-b922-9a9284903142 tempest-GroupsTest-179266637 None] Flow 'volume_create_manager' (d900603d-e67b-470e-933b-fff909b06b27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:07:03 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-c8e400c9-a8a2-4554-b922-9a9284903142 tempest-GroupsTest-179266637 None] Created volume successfully. Nov 02 10:07:05 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-ba3318ee-4185-4e36-90c0-b94d275211ce tempest-GroupsTest-179266637 None] Update group completed successfully. Nov 02 10:07:07 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-50fa18b1-f196-4eed-a185-ddf82ae75373 tempest-SnapshotMetadataTestJSON-1334361190 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:07:07 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-50fa18b1-f196-4eed-a185-ddf82ae75373 tempest-SnapshotMetadataTestJSON-1334361190 None] Flow 'volume_create_manager' (53f97515-266b-44b9-a094-3031bcc2e457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:07:07 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-50fa18b1-f196-4eed-a185-ddf82ae75373 tempest-SnapshotMetadataTestJSON-1334361190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d73dcc95-69ef-43a5-8026-506bb567880c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:07:07 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-50fa18b1-f196-4eed-a185-ddf82ae75373 tempest-SnapshotMetadataTestJSON-1334361190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d73dcc95-69ef-43a5-8026-506bb567880c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:07:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-507763940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=496755c6-432d-4e3c-a736-0737c060e4a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52292e02e585420aae065c56143cda90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:07:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:07:07Z,use_quota=True,user_id='6e4d1f52881c493980a6d8dae16e3f98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:07:07 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-50fa18b1-f196-4eed-a185-ddf82ae75373 tempest-SnapshotMetadataTestJSON-1334361190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abfacaf1-fa0a-4e96-bacb-91505870ea36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:07:07 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-50fa18b1-f196-4eed-a185-ddf82ae75373 tempest-SnapshotMetadataTestJSON-1334361190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abfacaf1-fa0a-4e96-bacb-91505870ea36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:07:07 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-50fa18b1-f196-4eed-a185-ddf82ae75373 tempest-SnapshotMetadataTestJSON-1334361190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3022688e-f9b8-419e-8ab6-8f9f5201fff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:07:07 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-50fa18b1-f196-4eed-a185-ddf82ae75373 tempest-SnapshotMetadataTestJSON-1334361190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3022688e-f9b8-419e-8ab6-8f9f5201fff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '496755c6-432d-4e3c-a736-0737c060e4a4', 'volume_name': 'volume-496755c6-432d-4e3c-a736-0737c060e4a4', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:07:07 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-50fa18b1-f196-4eed-a185-ddf82ae75373 tempest-SnapshotMetadataTestJSON-1334361190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ef89fe0-2cbc-4b4c-a65b-047605842375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:07:07 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-50fa18b1-f196-4eed-a185-ddf82ae75373 tempest-SnapshotMetadataTestJSON-1334361190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ef89fe0-2cbc-4b4c-a65b-047605842375) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:07:07 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-50fa18b1-f196-4eed-a185-ddf82ae75373 tempest-SnapshotMetadataTestJSON-1334361190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b3e7870-64d4-410c-a605-ed5b1b4a6483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:07:07 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-50fa18b1-f196-4eed-a185-ddf82ae75373 tempest-SnapshotMetadataTestJSON-1334361190 None] Volume 496755c6-432d-4e3c-a736-0737c060e4a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-496755c6-432d-4e3c-a736-0737c060e4a4', 'volume_size': 1} Nov 02 10:07:07 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-50fa18b1-f196-4eed-a185-ddf82ae75373 tempest-SnapshotMetadataTestJSON-1334361190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:07:07 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-50fa18b1-f196-4eed-a185-ddf82ae75373 tempest-SnapshotMetadataTestJSON-1334361190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:07:07 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-50fa18b1-f196-4eed-a185-ddf82ae75373 tempest-SnapshotMetadataTestJSON-1334361190 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:07:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-507763940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=496755c6-432d-4e3c-a736-0737c060e4a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52292e02e585420aae065c56143cda90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:07:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:07:07Z,use_quota=True,user_id='6e4d1f52881c493980a6d8dae16e3f98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:07:07 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-50fa18b1-f196-4eed-a185-ddf82ae75373 tempest-SnapshotMetadataTestJSON-1334361190 None] Creating volume 496755c6-432d-4e3c-a736-0737c060e4a4 {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:07:07 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-50fa18b1-f196-4eed-a185-ddf82ae75373 tempest-SnapshotMetadataTestJSON-1334361190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:07:07 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-50fa18b1-f196-4eed-a185-ddf82ae75373 tempest-SnapshotMetadataTestJSON-1334361190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:07:07 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-50fa18b1-f196-4eed-a185-ddf82ae75373 tempest-SnapshotMetadataTestJSON-1334361190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:07:07 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-50fa18b1-f196-4eed-a185-ddf82ae75373 tempest-SnapshotMetadataTestJSON-1334361190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:07:07 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-50fa18b1-f196-4eed-a185-ddf82ae75373 tempest-SnapshotMetadataTestJSON-1334361190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:07:07 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-50fa18b1-f196-4eed-a185-ddf82ae75373 tempest-SnapshotMetadataTestJSON-1334361190 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:07:07 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-50fa18b1-f196-4eed-a185-ddf82ae75373 tempest-SnapshotMetadataTestJSON-1334361190 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:07:07 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-50fa18b1-f196-4eed-a185-ddf82ae75373 tempest-SnapshotMetadataTestJSON-1334361190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-496755c6-432d-4e3c-a736-0737c060e4a4 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:07:07 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-7e967b87-3ffd-4996-bfff-4e504ae3c946 tempest-GroupsTest-179266637 None] Update group completed successfully. Nov 02 10:07:07 devstack sudo[92610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-496755c6-432d-4e3c-a736-0737c060e4a4 1073741824 Nov 02 10:07:07 devstack sudo[92610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:07:08 devstack sudo[92610]: pam_unix(sudo:session): session closed for user root Nov 02 10:07:08 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-50fa18b1-f196-4eed-a185-ddf82ae75373 tempest-SnapshotMetadataTestJSON-1334361190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-496755c6-432d-4e3c-a736-0737c060e4a4 1073741824" returned: 0 in 1.120s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:07:08 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-50fa18b1-f196-4eed-a185-ddf82ae75373 tempest-SnapshotMetadataTestJSON-1334361190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-496755c6-432d-4e3c-a736-0737c060e4a4 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:07:08 devstack sudo[92633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-496755c6-432d-4e3c-a736-0737c060e4a4 Nov 02 10:07:08 devstack sudo[92633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:07:09 devstack sudo[92633]: pam_unix(sudo:session): session closed for user root Nov 02 10:07:09 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-50fa18b1-f196-4eed-a185-ddf82ae75373 tempest-SnapshotMetadataTestJSON-1334361190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-496755c6-432d-4e3c-a736-0737c060e4a4" returned: 0 in 0.697s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:07:09 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-50fa18b1-f196-4eed-a185-ddf82ae75373 tempest-SnapshotMetadataTestJSON-1334361190 None] <== create_volume: return (1962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:07:09 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-50fa18b1-f196-4eed-a185-ddf82ae75373 tempest-SnapshotMetadataTestJSON-1334361190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.969s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:07:09 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-50fa18b1-f196-4eed-a185-ddf82ae75373 tempest-SnapshotMetadataTestJSON-1334361190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b3e7870-64d4-410c-a605-ed5b1b4a6483) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-496755c6-432d-4e3c-a736-0737c060e4a4', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:07:09 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-50fa18b1-f196-4eed-a185-ddf82ae75373 tempest-SnapshotMetadataTestJSON-1334361190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17cf3c2c-3e9a-4e89-8174-5ed5592af12a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:07:09 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-50fa18b1-f196-4eed-a185-ddf82ae75373 tempest-SnapshotMetadataTestJSON-1334361190 None] Volume volume-496755c6-432d-4e3c-a736-0737c060e4a4 (496755c6-432d-4e3c-a736-0737c060e4a4): created successfully Nov 02 10:07:09 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-50fa18b1-f196-4eed-a185-ddf82ae75373 tempest-SnapshotMetadataTestJSON-1334361190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17cf3c2c-3e9a-4e89-8174-5ed5592af12a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:07:09 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-50fa18b1-f196-4eed-a185-ddf82ae75373 tempest-SnapshotMetadataTestJSON-1334361190 None] Flow 'volume_create_manager' (53f97515-266b-44b9-a094-3031bcc2e457) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:07:09 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-50fa18b1-f196-4eed-a185-ddf82ae75373 tempest-SnapshotMetadataTestJSON-1334361190 None] Created volume successfully. Nov 02 10:07:10 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-41017a3a-35bc-40e1-ad76-47de7d56f262 tempest-GroupsTest-179266637 None] Acquiring lock "cinder-quobyte-59f70687-a080-476c-8acd-23d00d59a821" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:07:10 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-41017a3a-35bc-40e1-ad76-47de7d56f262 tempest-GroupsTest-179266637 None] Lock "cinder-quobyte-59f70687-a080-476c-8acd-23d00d59a821" acquired by "delete_volume" :: waited 0.019s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:07:10 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ca32d1a-5a64-4047-81e1-e383f3c19ade]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:07:10 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-41017a3a-35bc-40e1-ad76-47de7d56f262 tempest-GroupsTest-179266637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-59f70687-a080-476c-8acd-23d00d59a821 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:07:10 devstack sudo[92688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-59f70687-a080-476c-8acd-23d00d59a821 Nov 02 10:07:10 devstack sudo[92688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:07:11 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-5214274e-4a16-4f29-80f4-781eb295d5af tempest-SnapshotMetadataTestJSON-1334361190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:07:11 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-5214274e-4a16-4f29-80f4-781eb295d5af tempest-SnapshotMetadataTestJSON-1334361190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:07:11 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-5214274e-4a16-4f29-80f4-781eb295d5af tempest-SnapshotMetadataTestJSON-1334361190 None] Creating offline snapshot 8e72c865-8d19-400c-8ba3-c84effc07872 of volume 496755c6-432d-4e3c-a736-0737c060e4a4 {{(pid=86890) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:07:11 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1502ec8-3b62-4ab7-9711-bcbe0a18d001]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:07:11 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-5214274e-4a16-4f29-80f4-781eb295d5af tempest-SnapshotMetadataTestJSON-1334361190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-496755c6-432d-4e3c-a736-0737c060e4a4 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:07:11 devstack sudo[92688]: pam_unix(sudo:session): session closed for user root Nov 02 10:07:11 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-41017a3a-35bc-40e1-ad76-47de7d56f262 tempest-GroupsTest-179266637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-59f70687-a080-476c-8acd-23d00d59a821" returned: 0 in 1.078s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:07:11 devstack sudo[92692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-496755c6-432d-4e3c-a736-0737c060e4a4 Nov 02 10:07:11 devstack sudo[92692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:07:11 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-41017a3a-35bc-40e1-ad76-47de7d56f262 tempest-GroupsTest-179266637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-59f70687-a080-476c-8acd-23d00d59a821 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:07:11 devstack sudo[92699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-59f70687-a080-476c-8acd-23d00d59a821 Nov 02 10:07:11 devstack sudo[92699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:07:12 devstack sudo[92699]: pam_unix(sudo:session): session closed for user root Nov 02 10:07:12 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-41017a3a-35bc-40e1-ad76-47de7d56f262 tempest-GroupsTest-179266637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-59f70687-a080-476c-8acd-23d00d59a821" returned: 0 in 0.508s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:07:12 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-41017a3a-35bc-40e1-ad76-47de7d56f262 tempest-GroupsTest-179266637 None] Lock "cinder-quobyte-59f70687-a080-476c-8acd-23d00d59a821" released by "delete_volume" :: held 1.711s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:07:12 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-41017a3a-35bc-40e1-ad76-47de7d56f262 tempest-GroupsTest-179266637 None] Acquiring lock "cinder-quobyte-b38a1adc-d1f5-4fa1-b807-ded39422e495" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:07:12 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-41017a3a-35bc-40e1-ad76-47de7d56f262 tempest-GroupsTest-179266637 None] Lock "cinder-quobyte-b38a1adc-d1f5-4fa1-b807-ded39422e495" acquired by "delete_volume" :: waited 0.023s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:07:12 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[00f6671f-11aa-4e85-b359-2fff7d477d8f]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:07:12 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-41017a3a-35bc-40e1-ad76-47de7d56f262 tempest-GroupsTest-179266637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b38a1adc-d1f5-4fa1-b807-ded39422e495 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:07:12 devstack sudo[92692]: pam_unix(sudo:session): session closed for user root Nov 02 10:07:12 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-5214274e-4a16-4f29-80f4-781eb295d5af tempest-SnapshotMetadataTestJSON-1334361190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-496755c6-432d-4e3c-a736-0737c060e4a4" returned: 0 in 1.077s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:07:12 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-5214274e-4a16-4f29-80f4-781eb295d5af tempest-SnapshotMetadataTestJSON-1334361190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-496755c6-432d-4e3c-a736-0737c060e4a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-496755c6-432d-4e3c-a736-0737c060e4a4.8e72c865-8d19-400c-8ba3-c84effc07872 1G {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:07:12 devstack sudo[92706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-496755c6-432d-4e3c-a736-0737c060e4a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-496755c6-432d-4e3c-a736-0737c060e4a4.8e72c865-8d19-400c-8ba3-c84effc07872 1G Nov 02 10:07:12 devstack sudo[92706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:07:12 devstack sudo[92705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b38a1adc-d1f5-4fa1-b807-ded39422e495 Nov 02 10:07:12 devstack sudo[92705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:07:12 devstack sudo[92705]: pam_unix(sudo:session): session closed for user root Nov 02 10:07:12 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-41017a3a-35bc-40e1-ad76-47de7d56f262 tempest-GroupsTest-179266637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b38a1adc-d1f5-4fa1-b807-ded39422e495" returned: 0 in 0.736s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:07:12 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-41017a3a-35bc-40e1-ad76-47de7d56f262 tempest-GroupsTest-179266637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b38a1adc-d1f5-4fa1-b807-ded39422e495 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:07:13 devstack sudo[92719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b38a1adc-d1f5-4fa1-b807-ded39422e495 Nov 02 10:07:13 devstack sudo[92719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:07:13 devstack sudo[92706]: pam_unix(sudo:session): session closed for user root Nov 02 10:07:13 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-5214274e-4a16-4f29-80f4-781eb295d5af tempest-SnapshotMetadataTestJSON-1334361190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-496755c6-432d-4e3c-a736-0737c060e4a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-496755c6-432d-4e3c-a736-0737c060e4a4.8e72c865-8d19-400c-8ba3-c84effc07872 1G" returned: 0 in 0.798s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:07:13 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-5214274e-4a16-4f29-80f4-781eb295d5af tempest-SnapshotMetadataTestJSON-1334361190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-496755c6-432d-4e3c-a736-0737c060e4a4 -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-496755c6-432d-4e3c-a736-0737c060e4a4.8e72c865-8d19-400c-8ba3-c84effc07872 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:07:13 devstack sudo[92722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-496755c6-432d-4e3c-a736-0737c060e4a4 -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-496755c6-432d-4e3c-a736-0737c060e4a4.8e72c865-8d19-400c-8ba3-c84effc07872 Nov 02 10:07:13 devstack sudo[92722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:07:13 devstack sudo[92719]: pam_unix(sudo:session): session closed for user root Nov 02 10:07:13 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-41017a3a-35bc-40e1-ad76-47de7d56f262 tempest-GroupsTest-179266637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b38a1adc-d1f5-4fa1-b807-ded39422e495" returned: 0 in 0.523s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:07:13 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-41017a3a-35bc-40e1-ad76-47de7d56f262 tempest-GroupsTest-179266637 None] Lock "cinder-quobyte-b38a1adc-d1f5-4fa1-b807-ded39422e495" released by "delete_volume" :: held 1.398s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:07:13 devstack sudo[92722]: pam_unix(sudo:session): session closed for user root Nov 02 10:07:13 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-5214274e-4a16-4f29-80f4-781eb295d5af tempest-SnapshotMetadataTestJSON-1334361190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-496755c6-432d-4e3c-a736-0737c060e4a4 -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-496755c6-432d-4e3c-a736-0737c060e4a4.8e72c865-8d19-400c-8ba3-c84effc07872" returned: 0 in 0.659s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:07:13 devstack cinder-volume[86890]: WARNING cinder.volume.drivers.remotefs [None req-5214274e-4a16-4f29-80f4-781eb295d5af tempest-SnapshotMetadataTestJSON-1334361190 None] /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-496755c6-432d-4e3c-a736-0737c060e4a4.8e72c865-8d19-400c-8ba3-c84effc07872 is being set with open permissions: ugo+rw Nov 02 10:07:13 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-5214274e-4a16-4f29-80f4-781eb295d5af tempest-SnapshotMetadataTestJSON-1334361190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-496755c6-432d-4e3c-a736-0737c060e4a4.8e72c865-8d19-400c-8ba3-c84effc07872 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:07:13 devstack sudo[92729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-496755c6-432d-4e3c-a736-0737c060e4a4.8e72c865-8d19-400c-8ba3-c84effc07872 Nov 02 10:07:13 devstack sudo[92729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:07:13 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-41017a3a-35bc-40e1-ad76-47de7d56f262 tempest-GroupsTest-179266637 None] Created reservations ['b25f3a7c-878a-45e0-914c-d2c068522c85'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:07:14 devstack cinder-volume[86890]: WARNING cinder.quota [None req-41017a3a-35bc-40e1-ad76-47de7d56f262 tempest-GroupsTest-179266637 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1512148145 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1512148145, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:07:14 devstack cinder-volume[86890]: WARNING cinder.quota [None req-41017a3a-35bc-40e1-ad76-47de7d56f262 tempest-GroupsTest-179266637 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1512148145 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1512148145, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:07:14 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-41017a3a-35bc-40e1-ad76-47de7d56f262 tempest-GroupsTest-179266637 None] Created reservations ['86e664ce-aed8-4d9a-8199-40ce7179b819', '34c5720a-6b06-4631-bab9-64b6333d5505', 'f08ed1eb-17a1-4405-85b3-cf2783512a19', 'eb60c038-de08-4f57-962c-0acc39ff99b7'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:07:14 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-41017a3a-35bc-40e1-ad76-47de7d56f262 tempest-GroupsTest-179266637 None] Created reservations ['b34d5fe6-0427-4e6f-b003-a89f936b6329', 'a3a79a4d-2acd-4a92-b334-c87f1aa45d4f', '4bcf5d46-c0f0-436d-8119-73b8c93808a5', 'f50ef6cb-ce32-45f3-ae6b-eb6639c1d3c5'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:07:14 devstack sudo[92729]: pam_unix(sudo:session): session closed for user root Nov 02 10:07:14 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-5214274e-4a16-4f29-80f4-781eb295d5af tempest-SnapshotMetadataTestJSON-1334361190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-496755c6-432d-4e3c-a736-0737c060e4a4.8e72c865-8d19-400c-8ba3-c84effc07872" returned: 0 in 0.900s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:07:14 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-5214274e-4a16-4f29-80f4-781eb295d5af tempest-SnapshotMetadataTestJSON-1334361190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-496755c6-432d-4e3c-a736-0737c060e4a4.info {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:07:14 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-41017a3a-35bc-40e1-ad76-47de7d56f262 tempest-GroupsTest-179266637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:07:14 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-41017a3a-35bc-40e1-ad76-47de7d56f262 tempest-GroupsTest-179266637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:07:14 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-41017a3a-35bc-40e1-ad76-47de7d56f262 tempest-GroupsTest-179266637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:07:15 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-41017a3a-35bc-40e1-ad76-47de7d56f262 tempest-GroupsTest-179266637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:07:15 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-41017a3a-35bc-40e1-ad76-47de7d56f262 tempest-GroupsTest-179266637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:07:15 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-41017a3a-35bc-40e1-ad76-47de7d56f262 tempest-GroupsTest-179266637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:07:15 devstack sudo[92733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-496755c6-432d-4e3c-a736-0737c060e4a4.info Nov 02 10:07:15 devstack sudo[92733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:07:15 devstack sudo[92738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:07:15 devstack sudo[92738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:07:15 devstack sudo[92733]: pam_unix(sudo:session): session closed for user root Nov 02 10:07:15 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-5214274e-4a16-4f29-80f4-781eb295d5af tempest-SnapshotMetadataTestJSON-1334361190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-496755c6-432d-4e3c-a736-0737c060e4a4.info" returned: 0 in 0.823s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:07:15 devstack cinder-volume[86890]: WARNING cinder.volume.drivers.remotefs [None req-5214274e-4a16-4f29-80f4-781eb295d5af tempest-SnapshotMetadataTestJSON-1334361190 None] /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-496755c6-432d-4e3c-a736-0737c060e4a4.info is being set with open permissions: ugo+rw Nov 02 10:07:15 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-5214274e-4a16-4f29-80f4-781eb295d5af tempest-SnapshotMetadataTestJSON-1334361190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-496755c6-432d-4e3c-a736-0737c060e4a4.info {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:07:15 devstack sudo[92746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-496755c6-432d-4e3c-a736-0737c060e4a4.info Nov 02 10:07:15 devstack sudo[92746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:07:16 devstack sudo[92738]: pam_unix(sudo:session): session closed for user root Nov 02 10:07:16 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-41017a3a-35bc-40e1-ad76-47de7d56f262 tempest-GroupsTest-179266637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.999s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:07:16 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-41017a3a-35bc-40e1-ad76-47de7d56f262 tempest-GroupsTest-179266637 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:07:16 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-41017a3a-35bc-40e1-ad76-47de7d56f262 tempest-GroupsTest-179266637 None] Delete group completed successfully. Nov 02 10:07:16 devstack sudo[92746]: pam_unix(sudo:session): session closed for user root Nov 02 10:07:16 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-5214274e-4a16-4f29-80f4-781eb295d5af tempest-SnapshotMetadataTestJSON-1334361190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-496755c6-432d-4e3c-a736-0737c060e4a4.info" returned: 0 in 0.560s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:07:16 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-5214274e-4a16-4f29-80f4-781eb295d5af tempest-SnapshotMetadataTestJSON-1334361190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.183s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:07:16 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-5214274e-4a16-4f29-80f4-781eb295d5af tempest-SnapshotMetadataTestJSON-1334361190 None] Create snapshot completed successfully Nov 02 10:07:19 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-d4da6d2f-5b4c-4acb-90a3-0f9c9e60c7d2 tempest-SnapshotMetadataTestJSON-1334361190 None] Acquiring lock "cinder-8e72c865-8d19-400c-8ba3-c84effc07872-delete_snapshot" by "delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:07:19 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-d4da6d2f-5b4c-4acb-90a3-0f9c9e60c7d2 tempest-SnapshotMetadataTestJSON-1334361190 None] Lock "cinder-8e72c865-8d19-400c-8ba3-c84effc07872-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:07:19 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-d4da6d2f-5b4c-4acb-90a3-0f9c9e60c7d2 tempest-SnapshotMetadataTestJSON-1334361190 None] Acquiring lock "cinder-quobyte-496755c6-432d-4e3c-a736-0737c060e4a4" by "delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:07:19 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-d4da6d2f-5b4c-4acb-90a3-0f9c9e60c7d2 tempest-SnapshotMetadataTestJSON-1334361190 None] Lock "cinder-quobyte-496755c6-432d-4e3c-a736-0737c060e4a4" acquired by "delete_snapshot" :: waited 0.059s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:07:19 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-d4da6d2f-5b4c-4acb-90a3-0f9c9e60c7d2 tempest-SnapshotMetadataTestJSON-1334361190 None] Acquiring lock "cinder-quobyte-8e72c865-8d19-400c-8ba3-c84effc07872" by "_delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:07:19 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-d4da6d2f-5b4c-4acb-90a3-0f9c9e60c7d2 tempest-SnapshotMetadataTestJSON-1334361190 None] Lock "cinder-quobyte-8e72c865-8d19-400c-8ba3-c84effc07872" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:07:19 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-d4da6d2f-5b4c-4acb-90a3-0f9c9e60c7d2 tempest-SnapshotMetadataTestJSON-1334361190 None] Deleting offline snapshot 8e72c865-8d19-400c-8ba3-c84effc07872 of volume 496755c6-432d-4e3c-a736-0737c060e4a4 {{(pid=86890) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:07:19 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-d4da6d2f-5b4c-4acb-90a3-0f9c9e60c7d2 tempest-SnapshotMetadataTestJSON-1334361190 None] snapshot_file for this snap is: volume-496755c6-432d-4e3c-a736-0737c060e4a4.8e72c865-8d19-400c-8ba3-c84effc07872 {{(pid=86890) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:07:19 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d23c7cd-91d9-4fcd-92e2-ce317285793b]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:07:19 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-d4da6d2f-5b4c-4acb-90a3-0f9c9e60c7d2 tempest-SnapshotMetadataTestJSON-1334361190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-496755c6-432d-4e3c-a736-0737c060e4a4.8e72c865-8d19-400c-8ba3-c84effc07872 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:07:19 devstack sudo[92755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-496755c6-432d-4e3c-a736-0737c060e4a4.8e72c865-8d19-400c-8ba3-c84effc07872 Nov 02 10:07:19 devstack sudo[92755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:07:20 devstack sudo[92755]: pam_unix(sudo:session): session closed for user root Nov 02 10:07:20 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-d4da6d2f-5b4c-4acb-90a3-0f9c9e60c7d2 tempest-SnapshotMetadataTestJSON-1334361190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-496755c6-432d-4e3c-a736-0737c060e4a4.8e72c865-8d19-400c-8ba3-c84effc07872" returned: 0 in 1.072s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:07:20 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-d4da6d2f-5b4c-4acb-90a3-0f9c9e60c7d2 tempest-SnapshotMetadataTestJSON-1334361190 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-496755c6-432d-4e3c-a736-0737c060e4a4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86890) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:07:20 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[b011b84b-e579-4ef8-bd5c-c29ba707d204]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:07:20 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-d4da6d2f-5b4c-4acb-90a3-0f9c9e60c7d2 tempest-SnapshotMetadataTestJSON-1334361190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-496755c6-432d-4e3c-a736-0737c060e4a4 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:07:20 devstack sudo[92762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-496755c6-432d-4e3c-a736-0737c060e4a4 Nov 02 10:07:20 devstack sudo[92762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:07:21 devstack sudo[92762]: pam_unix(sudo:session): session closed for user root Nov 02 10:07:21 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-d4da6d2f-5b4c-4acb-90a3-0f9c9e60c7d2 tempest-SnapshotMetadataTestJSON-1334361190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-496755c6-432d-4e3c-a736-0737c060e4a4" returned: 0 in 0.833s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:07:21 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-d4da6d2f-5b4c-4acb-90a3-0f9c9e60c7d2 tempest-SnapshotMetadataTestJSON-1334361190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-496755c6-432d-4e3c-a736-0737c060e4a4.8e72c865-8d19-400c-8ba3-c84effc07872 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:07:21 devstack sudo[92767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-496755c6-432d-4e3c-a736-0737c060e4a4.8e72c865-8d19-400c-8ba3-c84effc07872 Nov 02 10:07:21 devstack sudo[92767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:07:21 devstack sudo[92767]: pam_unix(sudo:session): session closed for user root Nov 02 10:07:21 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-d4da6d2f-5b4c-4acb-90a3-0f9c9e60c7d2 tempest-SnapshotMetadataTestJSON-1334361190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-496755c6-432d-4e3c-a736-0737c060e4a4.8e72c865-8d19-400c-8ba3-c84effc07872" returned: 0 in 0.632s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:07:22 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-d4da6d2f-5b4c-4acb-90a3-0f9c9e60c7d2 tempest-SnapshotMetadataTestJSON-1334361190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-496755c6-432d-4e3c-a736-0737c060e4a4.8e72c865-8d19-400c-8ba3-c84effc07872 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:07:22 devstack sudo[92772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-496755c6-432d-4e3c-a736-0737c060e4a4.8e72c865-8d19-400c-8ba3-c84effc07872 Nov 02 10:07:22 devstack sudo[92772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:07:22 devstack sudo[92772]: pam_unix(sudo:session): session closed for user root Nov 02 10:07:22 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-d4da6d2f-5b4c-4acb-90a3-0f9c9e60c7d2 tempest-SnapshotMetadataTestJSON-1334361190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-496755c6-432d-4e3c-a736-0737c060e4a4.8e72c865-8d19-400c-8ba3-c84effc07872" returned: 0 in 0.505s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:07:22 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-d4da6d2f-5b4c-4acb-90a3-0f9c9e60c7d2 tempest-SnapshotMetadataTestJSON-1334361190 None] Lock "cinder-quobyte-8e72c865-8d19-400c-8ba3-c84effc07872" released by "_delete_snapshot" :: held 3.389s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:07:22 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-d4da6d2f-5b4c-4acb-90a3-0f9c9e60c7d2 tempest-SnapshotMetadataTestJSON-1334361190 None] Lock "cinder-quobyte-496755c6-432d-4e3c-a736-0737c060e4a4" released by "delete_snapshot" :: held 3.461s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:07:22 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-d4da6d2f-5b4c-4acb-90a3-0f9c9e60c7d2 tempest-SnapshotMetadataTestJSON-1334361190 None] Created reservations ['72204fe3-f40b-44ec-8e4e-9d8352c30dd7', '2bd12243-b2f6-4d5d-abd9-d3055db32d79', '586a0c12-9338-4c19-b8c8-8a5415eb36d0', '1274f2e9-1707-4ede-96c7-665f4ece2c2e'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:07:22 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-d4da6d2f-5b4c-4acb-90a3-0f9c9e60c7d2 tempest-SnapshotMetadataTestJSON-1334361190 None] Delete snapshot completed successfully. Nov 02 10:07:22 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-d4da6d2f-5b4c-4acb-90a3-0f9c9e60c7d2 tempest-SnapshotMetadataTestJSON-1334361190 None] Lock "cinder-8e72c865-8d19-400c-8ba3-c84effc07872-delete_snapshot" released by "delete_snapshot" :: held 3.756s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:07:23 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-7fb20295-eec2-49dc-9d0e-618223bdfa03 tempest-SnapshotMetadataTestJSON-1334361190 None] Acquiring lock "cinder-496755c6-432d-4e3c-a736-0737c060e4a4-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:07:23 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-7fb20295-eec2-49dc-9d0e-618223bdfa03 tempest-SnapshotMetadataTestJSON-1334361190 None] Lock "cinder-496755c6-432d-4e3c-a736-0737c060e4a4-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:07:23 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-7fb20295-eec2-49dc-9d0e-618223bdfa03 tempest-SnapshotMetadataTestJSON-1334361190 None] Acquiring lock "cinder-quobyte-496755c6-432d-4e3c-a736-0737c060e4a4" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:07:23 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-7fb20295-eec2-49dc-9d0e-618223bdfa03 tempest-SnapshotMetadataTestJSON-1334361190 None] Lock "cinder-quobyte-496755c6-432d-4e3c-a736-0737c060e4a4" acquired by "delete_volume" :: waited 0.035s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:07:23 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba33de8b-171d-4f6e-a5bb-ef9ec916b0ce]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:07:23 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-7fb20295-eec2-49dc-9d0e-618223bdfa03 tempest-SnapshotMetadataTestJSON-1334361190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-496755c6-432d-4e3c-a736-0737c060e4a4 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:07:24 devstack sudo[92780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-496755c6-432d-4e3c-a736-0737c060e4a4 Nov 02 10:07:24 devstack sudo[92780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:07:24 devstack cinder-volume[86890]: INFO cinder.volume.manager [req-957aa360-79e4-4a23-9866-728a7b9f1c0e req-b20d3687-486c-407b-8154-3faf0f0f0d6d tempest-ServerActionsTestOtherA-634183357 None] Terminate volume connection completed successfully. Nov 02 10:07:24 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [req-957aa360-79e4-4a23-9866-728a7b9f1c0e req-b20d3687-486c-407b-8154-3faf0f0f0d6d tempest-ServerActionsTestOtherA-634183357 None] Deleting attachment d0f69cf0-c239-45de-b7cd-eb8ec3e9d251. {{(pid=86890) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:07:24 devstack sudo[92780]: pam_unix(sudo:session): session closed for user root Nov 02 10:07:24 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-7fb20295-eec2-49dc-9d0e-618223bdfa03 tempest-SnapshotMetadataTestJSON-1334361190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-496755c6-432d-4e3c-a736-0737c060e4a4" returned: 0 in 0.945s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:07:24 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-7fb20295-eec2-49dc-9d0e-618223bdfa03 tempest-SnapshotMetadataTestJSON-1334361190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-496755c6-432d-4e3c-a736-0737c060e4a4 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:07:24 devstack sudo[92828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-496755c6-432d-4e3c-a736-0737c060e4a4 Nov 02 10:07:24 devstack sudo[92828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:07:25 devstack sudo[92828]: pam_unix(sudo:session): session closed for user root Nov 02 10:07:25 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-7fb20295-eec2-49dc-9d0e-618223bdfa03 tempest-SnapshotMetadataTestJSON-1334361190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-496755c6-432d-4e3c-a736-0737c060e4a4" returned: 0 in 0.513s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:07:25 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-7fb20295-eec2-49dc-9d0e-618223bdfa03 tempest-SnapshotMetadataTestJSON-1334361190 None] Lock "cinder-quobyte-496755c6-432d-4e3c-a736-0737c060e4a4" released by "delete_volume" :: held 1.574s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:07:25 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-7fb20295-eec2-49dc-9d0e-618223bdfa03 tempest-SnapshotMetadataTestJSON-1334361190 None] Created reservations ['ad00c03a-7f86-4193-8734-85c87e73ab74', '5e531b34-8f7e-49dc-b7ae-8d2c3c9027f4', '91e8b109-2261-436c-a65e-e298d2773535', 'b730e355-c2c4-4c60-b583-d2e07be4d29c'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:07:25 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-7fb20295-eec2-49dc-9d0e-618223bdfa03 tempest-SnapshotMetadataTestJSON-1334361190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:07:25 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-7fb20295-eec2-49dc-9d0e-618223bdfa03 tempest-SnapshotMetadataTestJSON-1334361190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:07:25 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-7fb20295-eec2-49dc-9d0e-618223bdfa03 tempest-SnapshotMetadataTestJSON-1334361190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:07:25 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-7fb20295-eec2-49dc-9d0e-618223bdfa03 tempest-SnapshotMetadataTestJSON-1334361190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:07:25 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-7fb20295-eec2-49dc-9d0e-618223bdfa03 tempest-SnapshotMetadataTestJSON-1334361190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:07:25 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-7fb20295-eec2-49dc-9d0e-618223bdfa03 tempest-SnapshotMetadataTestJSON-1334361190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:07:25 devstack sudo[92865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:07:25 devstack sudo[92865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:07:25 devstack sudo[92865]: pam_unix(sudo:session): session closed for user root Nov 02 10:07:25 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-7fb20295-eec2-49dc-9d0e-618223bdfa03 tempest-SnapshotMetadataTestJSON-1334361190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.322s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:07:25 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-7fb20295-eec2-49dc-9d0e-618223bdfa03 tempest-SnapshotMetadataTestJSON-1334361190 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:07:25 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-7fb20295-eec2-49dc-9d0e-618223bdfa03 tempest-SnapshotMetadataTestJSON-1334361190 None] Deleted volume successfully. Nov 02 10:07:25 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-7fb20295-eec2-49dc-9d0e-618223bdfa03 tempest-SnapshotMetadataTestJSON-1334361190 None] Lock "cinder-496755c6-432d-4e3c-a736-0737c060e4a4-delete_volume" released by "delete_volume" :: held 2.278s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:07:27 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [req-957aa360-79e4-4a23-9866-728a7b9f1c0e req-f1693c4b-bcdf-4ccb-b99e-5782789df62e tempest-ServerActionsTestOtherA-634183357 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:07:27 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [req-957aa360-79e4-4a23-9866-728a7b9f1c0e req-f1693c4b-bcdf-4ccb-b99e-5782789df62e tempest-ServerActionsTestOtherA-634183357 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:07:27 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [req-957aa360-79e4-4a23-9866-728a7b9f1c0e req-f1693c4b-bcdf-4ccb-b99e-5782789df62e tempest-ServerActionsTestOtherA-634183357 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:07:27 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [req-957aa360-79e4-4a23-9866-728a7b9f1c0e req-f1693c4b-bcdf-4ccb-b99e-5782789df62e tempest-ServerActionsTestOtherA-634183357 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67', 'name': 'volume-6b09d6b7-2f7c-479f-8124-3b45da495257', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0dfef2cd-821d-40e7-ac5b-b017b78f172b', 'enforce_multipath': True} {{(pid=86890) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:07:27 devstack cinder-volume[86890]: INFO cinder.volume.manager [req-957aa360-79e4-4a23-9866-728a7b9f1c0e req-f1693c4b-bcdf-4ccb-b99e-5782789df62e tempest-ServerActionsTestOtherA-634183357 None] attachment_update completed successfully. Nov 02 10:07:28 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-840f364b-0e10-4089-8f4b-99eebf60eb45 tempest-GroupsV314Test-1415887311 None] Group tempest-GroupsV314Test-Group-2132199425: creating Nov 02 10:07:28 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-840f364b-0e10-4089-8f4b-99eebf60eb45 tempest-GroupsV314Test-1415887311 None] Group tempest-GroupsV314Test-Group-2132199425: created successfully Nov 02 10:07:28 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-840f364b-0e10-4089-8f4b-99eebf60eb45 tempest-GroupsV314Test-1415887311 None] Create group completed successfully. Nov 02 10:07:30 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-78abda71-98fa-42ca-a9a7-eb8741067e50 tempest-GroupsV314Test-1415887311 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:07:30 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-78abda71-98fa-42ca-a9a7-eb8741067e50 tempest-GroupsV314Test-1415887311 None] Flow 'volume_create_manager' (dcf05b9c-4bfd-4f72-9581-cf9d87b99ea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:07:30 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-78abda71-98fa-42ca-a9a7-eb8741067e50 tempest-GroupsV314Test-1415887311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (094ec349-dccc-4d93-b0d1-d791b3f4008b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:07:30 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-78abda71-98fa-42ca-a9a7-eb8741067e50 tempest-GroupsV314Test-1415887311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (094ec349-dccc-4d93-b0d1-d791b3f4008b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:07:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1428968615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9a87b367-c9e7-4f93-bc72-9d3cbaac658f,host='devstack@QuobyteHD#QuobyteHD',id=547964b8-1612-475f-9a3c-426d8d447068,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cd2dd6c7e864434b5a7a37dad1c8f51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:07:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:07:30Z,use_quota=True,user_id='3552858b555e40609a3f420a7c1150d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(630c482f-a415-4ec5-845c-0291d259df98),volume_type_id=630c482f-a415-4ec5-845c-0291d259df98)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:07:30 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-78abda71-98fa-42ca-a9a7-eb8741067e50 tempest-GroupsV314Test-1415887311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (030cc270-52c0-413a-a600-2682e373e86b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:07:30 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-78abda71-98fa-42ca-a9a7-eb8741067e50 tempest-GroupsV314Test-1415887311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (030cc270-52c0-413a-a600-2682e373e86b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:07:30 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-78abda71-98fa-42ca-a9a7-eb8741067e50 tempest-GroupsV314Test-1415887311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2f62d9a-5781-4e42-a031-91688c5d7d8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:07:30 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-78abda71-98fa-42ca-a9a7-eb8741067e50 tempest-GroupsV314Test-1415887311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2f62d9a-5781-4e42-a031-91688c5d7d8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '547964b8-1612-475f-9a3c-426d8d447068', 'volume_name': 'volume-547964b8-1612-475f-9a3c-426d8d447068', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:07:30 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-78abda71-98fa-42ca-a9a7-eb8741067e50 tempest-GroupsV314Test-1415887311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da3d35c7-9ae8-45a5-be29-af4f36c4a8c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:07:30 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-78abda71-98fa-42ca-a9a7-eb8741067e50 tempest-GroupsV314Test-1415887311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da3d35c7-9ae8-45a5-be29-af4f36c4a8c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:07:30 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-78abda71-98fa-42ca-a9a7-eb8741067e50 tempest-GroupsV314Test-1415887311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc35402f-ea4f-4369-a9cb-3a45b87a341c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:07:30 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-78abda71-98fa-42ca-a9a7-eb8741067e50 tempest-GroupsV314Test-1415887311 None] Volume 547964b8-1612-475f-9a3c-426d8d447068: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-547964b8-1612-475f-9a3c-426d8d447068', 'volume_size': 1} Nov 02 10:07:30 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-78abda71-98fa-42ca-a9a7-eb8741067e50 tempest-GroupsV314Test-1415887311 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:07:30 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-78abda71-98fa-42ca-a9a7-eb8741067e50 tempest-GroupsV314Test-1415887311 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:07:30 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-78abda71-98fa-42ca-a9a7-eb8741067e50 tempest-GroupsV314Test-1415887311 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=9a87b367-c9e7-4f93-bc72-9d3cbaac658f,created_at=2026-11-02T09:07:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1428968615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9a87b367-c9e7-4f93-bc72-9d3cbaac658f,host='devstack@QuobyteHD#QuobyteHD',id=547964b8-1612-475f-9a3c-426d8d447068,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cd2dd6c7e864434b5a7a37dad1c8f51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:07:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:07:30Z,use_quota=True,user_id='3552858b555e40609a3f420a7c1150d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(630c482f-a415-4ec5-845c-0291d259df98),volume_type_id=630c482f-a415-4ec5-845c-0291d259df98)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:07:30 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-78abda71-98fa-42ca-a9a7-eb8741067e50 tempest-GroupsV314Test-1415887311 None] Creating volume 547964b8-1612-475f-9a3c-426d8d447068 {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:07:30 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-78abda71-98fa-42ca-a9a7-eb8741067e50 tempest-GroupsV314Test-1415887311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:07:30 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-78abda71-98fa-42ca-a9a7-eb8741067e50 tempest-GroupsV314Test-1415887311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:07:30 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-78abda71-98fa-42ca-a9a7-eb8741067e50 tempest-GroupsV314Test-1415887311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:07:30 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-78abda71-98fa-42ca-a9a7-eb8741067e50 tempest-GroupsV314Test-1415887311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:07:30 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-78abda71-98fa-42ca-a9a7-eb8741067e50 tempest-GroupsV314Test-1415887311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:07:30 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-78abda71-98fa-42ca-a9a7-eb8741067e50 tempest-GroupsV314Test-1415887311 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:07:30 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-78abda71-98fa-42ca-a9a7-eb8741067e50 tempest-GroupsV314Test-1415887311 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:07:30 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-78abda71-98fa-42ca-a9a7-eb8741067e50 tempest-GroupsV314Test-1415887311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-547964b8-1612-475f-9a3c-426d8d447068 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:07:30 devstack sudo[93330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-547964b8-1612-475f-9a3c-426d8d447068 1073741824 Nov 02 10:07:30 devstack sudo[93330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:07:31 devstack sudo[93330]: pam_unix(sudo:session): session closed for user root Nov 02 10:07:31 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-78abda71-98fa-42ca-a9a7-eb8741067e50 tempest-GroupsV314Test-1415887311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-547964b8-1612-475f-9a3c-426d8d447068 1073741824" returned: 0 in 0.662s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:07:31 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-78abda71-98fa-42ca-a9a7-eb8741067e50 tempest-GroupsV314Test-1415887311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-547964b8-1612-475f-9a3c-426d8d447068 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:07:31 devstack sudo[93338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-547964b8-1612-475f-9a3c-426d8d447068 Nov 02 10:07:31 devstack sudo[93338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:07:31 devstack sudo[93338]: pam_unix(sudo:session): session closed for user root Nov 02 10:07:31 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-78abda71-98fa-42ca-a9a7-eb8741067e50 tempest-GroupsV314Test-1415887311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-547964b8-1612-475f-9a3c-426d8d447068" returned: 0 in 0.486s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:07:31 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-78abda71-98fa-42ca-a9a7-eb8741067e50 tempest-GroupsV314Test-1415887311 None] <== create_volume: return (1251ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:07:31 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-78abda71-98fa-42ca-a9a7-eb8741067e50 tempest-GroupsV314Test-1415887311 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.257s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:07:31 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-78abda71-98fa-42ca-a9a7-eb8741067e50 tempest-GroupsV314Test-1415887311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc35402f-ea4f-4369-a9cb-3a45b87a341c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-547964b8-1612-475f-9a3c-426d8d447068', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:07:31 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-78abda71-98fa-42ca-a9a7-eb8741067e50 tempest-GroupsV314Test-1415887311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4490237f-c53e-4824-8fc1-7b44099bed08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:07:31 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-78abda71-98fa-42ca-a9a7-eb8741067e50 tempest-GroupsV314Test-1415887311 None] Volume volume-547964b8-1612-475f-9a3c-426d8d447068 (547964b8-1612-475f-9a3c-426d8d447068): created successfully Nov 02 10:07:31 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-78abda71-98fa-42ca-a9a7-eb8741067e50 tempest-GroupsV314Test-1415887311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4490237f-c53e-4824-8fc1-7b44099bed08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:07:31 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-78abda71-98fa-42ca-a9a7-eb8741067e50 tempest-GroupsV314Test-1415887311 None] Flow 'volume_create_manager' (dcf05b9c-4bfd-4f72-9581-cf9d87b99ea2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:07:32 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-78abda71-98fa-42ca-a9a7-eb8741067e50 tempest-GroupsV314Test-1415887311 None] Created volume successfully. Nov 02 10:07:32 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-d95e8616-cb03-4fec-ae03-bb96d6345490 tempest-VolumesCloneNegativeTest-1648832085 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:07:32 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-d95e8616-cb03-4fec-ae03-bb96d6345490 tempest-VolumesCloneNegativeTest-1648832085 None] Flow 'volume_create_manager' (789eaa72-6d81-4b12-8ccb-dcf4612349c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:07:32 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-d95e8616-cb03-4fec-ae03-bb96d6345490 tempest-VolumesCloneNegativeTest-1648832085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e577b3ab-6660-47c0-ab7f-da558f620760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:07:32 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-d95e8616-cb03-4fec-ae03-bb96d6345490 tempest-VolumesCloneNegativeTest-1648832085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e577b3ab-6660-47c0-ab7f-da558f620760) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:07:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1047636380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb5d5423-33d7-42c5-ab22-e02bd225cf6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db345dce20ef43c990506792aded55af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:07:32Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:07:32Z,use_quota=True,user_id='6ae3b06f4eab4755bf051af0af501cee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:07:32 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-d95e8616-cb03-4fec-ae03-bb96d6345490 tempest-VolumesCloneNegativeTest-1648832085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (881b967d-4400-43b3-a5a2-6308caf13eb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:07:32 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-d95e8616-cb03-4fec-ae03-bb96d6345490 tempest-VolumesCloneNegativeTest-1648832085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (881b967d-4400-43b3-a5a2-6308caf13eb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:07:32 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-d95e8616-cb03-4fec-ae03-bb96d6345490 tempest-VolumesCloneNegativeTest-1648832085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d184e77a-8749-4e8e-bea1-d7966961c286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:07:32 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-d95e8616-cb03-4fec-ae03-bb96d6345490 tempest-VolumesCloneNegativeTest-1648832085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d184e77a-8749-4e8e-bea1-d7966961c286) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb5d5423-33d7-42c5-ab22-e02bd225cf6d', 'volume_name': 'volume-eb5d5423-33d7-42c5-ab22-e02bd225cf6d', 'volume_size': 2}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:07:32 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-d95e8616-cb03-4fec-ae03-bb96d6345490 tempest-VolumesCloneNegativeTest-1648832085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (964c50ad-8698-45a7-974e-2b4d97496fda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:07:32 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-d95e8616-cb03-4fec-ae03-bb96d6345490 tempest-VolumesCloneNegativeTest-1648832085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (964c50ad-8698-45a7-974e-2b4d97496fda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:07:32 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-d95e8616-cb03-4fec-ae03-bb96d6345490 tempest-VolumesCloneNegativeTest-1648832085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab550e72-e9d0-415e-b90b-3d445713d77f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:07:32 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-d95e8616-cb03-4fec-ae03-bb96d6345490 tempest-VolumesCloneNegativeTest-1648832085 None] Volume eb5d5423-33d7-42c5-ab22-e02bd225cf6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb5d5423-33d7-42c5-ab22-e02bd225cf6d', 'volume_size': 2} Nov 02 10:07:32 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-d95e8616-cb03-4fec-ae03-bb96d6345490 tempest-VolumesCloneNegativeTest-1648832085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:07:32 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-d95e8616-cb03-4fec-ae03-bb96d6345490 tempest-VolumesCloneNegativeTest-1648832085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:07:32 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-d95e8616-cb03-4fec-ae03-bb96d6345490 tempest-VolumesCloneNegativeTest-1648832085 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:07:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1047636380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb5d5423-33d7-42c5-ab22-e02bd225cf6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db345dce20ef43c990506792aded55af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:07:32Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:07:32Z,use_quota=True,user_id='6ae3b06f4eab4755bf051af0af501cee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:07:32 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-d95e8616-cb03-4fec-ae03-bb96d6345490 tempest-VolumesCloneNegativeTest-1648832085 None] Creating volume eb5d5423-33d7-42c5-ab22-e02bd225cf6d {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:07:32 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-d95e8616-cb03-4fec-ae03-bb96d6345490 tempest-VolumesCloneNegativeTest-1648832085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:07:32 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-d95e8616-cb03-4fec-ae03-bb96d6345490 tempest-VolumesCloneNegativeTest-1648832085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:07:32 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-d95e8616-cb03-4fec-ae03-bb96d6345490 tempest-VolumesCloneNegativeTest-1648832085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:07:32 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-d95e8616-cb03-4fec-ae03-bb96d6345490 tempest-VolumesCloneNegativeTest-1648832085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:07:32 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-d95e8616-cb03-4fec-ae03-bb96d6345490 tempest-VolumesCloneNegativeTest-1648832085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:07:32 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-d95e8616-cb03-4fec-ae03-bb96d6345490 tempest-VolumesCloneNegativeTest-1648832085 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:07:32 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-d95e8616-cb03-4fec-ae03-bb96d6345490 tempest-VolumesCloneNegativeTest-1648832085 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:07:32 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-d95e8616-cb03-4fec-ae03-bb96d6345490 tempest-VolumesCloneNegativeTest-1648832085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-eb5d5423-33d7-42c5-ab22-e02bd225cf6d 2147483648 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:07:32 devstack sudo[93341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-eb5d5423-33d7-42c5-ab22-e02bd225cf6d 2147483648 Nov 02 10:07:32 devstack sudo[93341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:07:33 devstack sudo[93341]: pam_unix(sudo:session): session closed for user root Nov 02 10:07:33 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-d95e8616-cb03-4fec-ae03-bb96d6345490 tempest-VolumesCloneNegativeTest-1648832085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-eb5d5423-33d7-42c5-ab22-e02bd225cf6d 2147483648" returned: 0 in 0.927s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:07:33 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-d95e8616-cb03-4fec-ae03-bb96d6345490 tempest-VolumesCloneNegativeTest-1648832085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-eb5d5423-33d7-42c5-ab22-e02bd225cf6d {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:07:33 devstack sudo[93348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-eb5d5423-33d7-42c5-ab22-e02bd225cf6d Nov 02 10:07:33 devstack sudo[93348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:07:33 devstack sudo[93348]: pam_unix(sudo:session): session closed for user root Nov 02 10:07:33 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-d95e8616-cb03-4fec-ae03-bb96d6345490 tempest-VolumesCloneNegativeTest-1648832085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-eb5d5423-33d7-42c5-ab22-e02bd225cf6d" returned: 0 in 0.381s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:07:33 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-d95e8616-cb03-4fec-ae03-bb96d6345490 tempest-VolumesCloneNegativeTest-1648832085 None] <== create_volume: return (1382ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:07:33 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-d95e8616-cb03-4fec-ae03-bb96d6345490 tempest-VolumesCloneNegativeTest-1648832085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.387s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:07:33 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-d95e8616-cb03-4fec-ae03-bb96d6345490 tempest-VolumesCloneNegativeTest-1648832085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab550e72-e9d0-415e-b90b-3d445713d77f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb5d5423-33d7-42c5-ab22-e02bd225cf6d', 'volume_size': 2}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:07:33 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-d95e8616-cb03-4fec-ae03-bb96d6345490 tempest-VolumesCloneNegativeTest-1648832085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d97d4f29-8197-454a-a963-12ad25bdfacb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:07:33 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-d95e8616-cb03-4fec-ae03-bb96d6345490 tempest-VolumesCloneNegativeTest-1648832085 None] Volume volume-eb5d5423-33d7-42c5-ab22-e02bd225cf6d (eb5d5423-33d7-42c5-ab22-e02bd225cf6d): created successfully Nov 02 10:07:33 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-d95e8616-cb03-4fec-ae03-bb96d6345490 tempest-VolumesCloneNegativeTest-1648832085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d97d4f29-8197-454a-a963-12ad25bdfacb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:07:33 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-d95e8616-cb03-4fec-ae03-bb96d6345490 tempest-VolumesCloneNegativeTest-1648832085 None] Flow 'volume_create_manager' (789eaa72-6d81-4b12-8ccb-dcf4612349c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:07:33 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-d95e8616-cb03-4fec-ae03-bb96d6345490 tempest-VolumesCloneNegativeTest-1648832085 None] Created volume successfully. Nov 02 10:07:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-622952bb-8e46-47bc-91d5-b1ff356b6187 tempest-GroupsV314Test-1415887311 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:07:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-622952bb-8e46-47bc-91d5-b1ff356b6187 tempest-GroupsV314Test-1415887311 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.004s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:07:34 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-622952bb-8e46-47bc-91d5-b1ff356b6187 tempest-GroupsV314Test-1415887311 None] Cloning volume 547964b8-1612-475f-9a3c-426d8d447068 to volume 7f014f60-b98d-46b6-b50a-16abc2549371 Nov 02 10:07:34 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-622952bb-8e46-47bc-91d5-b1ff356b6187 tempest-GroupsV314Test-1415887311 None] Creating offline snapshot a4cbb5b5-b17c-40d4-b731-2b11f49f793a of volume 547964b8-1612-475f-9a3c-426d8d447068 {{(pid=86890) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:07:34 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[7566be30-25ef-46c1-98fd-201e27adff8d]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:07:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-622952bb-8e46-47bc-91d5-b1ff356b6187 tempest-GroupsV314Test-1415887311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-547964b8-1612-475f-9a3c-426d8d447068 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:07:34 devstack sudo[93351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-547964b8-1612-475f-9a3c-426d8d447068 Nov 02 10:07:34 devstack sudo[93351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:07:34 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-01b7e6bf-915e-4350-9820-ea97bf560662 tempest-VolumesCloneNegativeTest-1648832085 None] Acquiring lock "cinder-eb5d5423-33d7-42c5-ab22-e02bd225cf6d-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:07:34 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-01b7e6bf-915e-4350-9820-ea97bf560662 tempest-VolumesCloneNegativeTest-1648832085 None] Lock "cinder-eb5d5423-33d7-42c5-ab22-e02bd225cf6d-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:07:34 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-01b7e6bf-915e-4350-9820-ea97bf560662 tempest-VolumesCloneNegativeTest-1648832085 None] Acquiring lock "cinder-quobyte-eb5d5423-33d7-42c5-ab22-e02bd225cf6d" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:07:34 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-01b7e6bf-915e-4350-9820-ea97bf560662 tempest-VolumesCloneNegativeTest-1648832085 None] Lock "cinder-quobyte-eb5d5423-33d7-42c5-ab22-e02bd225cf6d" acquired by "delete_volume" :: waited 0.050s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:07:34 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[42043c6c-3dd1-4c8a-869c-d2af62d1c2fe]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:07:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-01b7e6bf-915e-4350-9820-ea97bf560662 tempest-VolumesCloneNegativeTest-1648832085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-eb5d5423-33d7-42c5-ab22-e02bd225cf6d {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:07:34 devstack cinder-volume[86890]: DEBUG oslo_service.periodic_task [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86890) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:07:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:07:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:07:34 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:07:34 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:07:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:07:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:07:34 devstack sudo[93354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:07:34 devstack sudo[93354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:07:35 devstack sudo[93353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-eb5d5423-33d7-42c5-ab22-e02bd225cf6d Nov 02 10:07:35 devstack sudo[93353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:07:35 devstack sudo[93351]: pam_unix(sudo:session): session closed for user root Nov 02 10:07:35 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-622952bb-8e46-47bc-91d5-b1ff356b6187 tempest-GroupsV314Test-1415887311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-547964b8-1612-475f-9a3c-426d8d447068" returned: 0 in 0.919s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:07:35 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-622952bb-8e46-47bc-91d5-b1ff356b6187 tempest-GroupsV314Test-1415887311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-547964b8-1612-475f-9a3c-426d8d447068,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-547964b8-1612-475f-9a3c-426d8d447068.a4cbb5b5-b17c-40d4-b731-2b11f49f793a 1G {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:07:35 devstack sudo[93361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-547964b8-1612-475f-9a3c-426d8d447068,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-547964b8-1612-475f-9a3c-426d8d447068.a4cbb5b5-b17c-40d4-b731-2b11f49f793a 1G Nov 02 10:07:35 devstack sudo[93361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:07:35 devstack sudo[93354]: pam_unix(sudo:session): session closed for user root Nov 02 10:07:35 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.483s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:07:35 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:07:35 devstack cinder-volume[86890]: DEBUG oslo_service.periodic_task [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Running periodic task VolumeManager._thread_info {{(pid=86890) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:07:35 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] thread count: 28 {{(pid=86890) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:07:35 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] thread info: [<_MainThread(MainThread, started 133913319395456)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86890) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:07:35 devstack sudo[93353]: pam_unix(sudo:session): session closed for user root Nov 02 10:07:35 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-01b7e6bf-915e-4350-9820-ea97bf560662 tempest-VolumesCloneNegativeTest-1648832085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-eb5d5423-33d7-42c5-ab22-e02bd225cf6d" returned: 0 in 0.648s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:07:35 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-01b7e6bf-915e-4350-9820-ea97bf560662 tempest-VolumesCloneNegativeTest-1648832085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-eb5d5423-33d7-42c5-ab22-e02bd225cf6d {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:07:35 devstack sudo[93369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-eb5d5423-33d7-42c5-ab22-e02bd225cf6d Nov 02 10:07:35 devstack sudo[93369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:07:35 devstack sudo[93361]: pam_unix(sudo:session): session closed for user root Nov 02 10:07:35 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-622952bb-8e46-47bc-91d5-b1ff356b6187 tempest-GroupsV314Test-1415887311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-547964b8-1612-475f-9a3c-426d8d447068,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-547964b8-1612-475f-9a3c-426d8d447068.a4cbb5b5-b17c-40d4-b731-2b11f49f793a 1G" returned: 0 in 0.634s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:07:35 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-622952bb-8e46-47bc-91d5-b1ff356b6187 tempest-GroupsV314Test-1415887311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-547964b8-1612-475f-9a3c-426d8d447068 -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-547964b8-1612-475f-9a3c-426d8d447068.a4cbb5b5-b17c-40d4-b731-2b11f49f793a {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:07:35 devstack sudo[93369]: pam_unix(sudo:session): session closed for user root Nov 02 10:07:35 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-01b7e6bf-915e-4350-9820-ea97bf560662 tempest-VolumesCloneNegativeTest-1648832085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-eb5d5423-33d7-42c5-ab22-e02bd225cf6d" returned: 0 in 0.348s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:07:35 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-01b7e6bf-915e-4350-9820-ea97bf560662 tempest-VolumesCloneNegativeTest-1648832085 None] Lock "cinder-quobyte-eb5d5423-33d7-42c5-ab22-e02bd225cf6d" released by "delete_volume" :: held 1.119s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:07:35 devstack sudo[93375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-547964b8-1612-475f-9a3c-426d8d447068 -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-547964b8-1612-475f-9a3c-426d8d447068.a4cbb5b5-b17c-40d4-b731-2b11f49f793a Nov 02 10:07:35 devstack sudo[93375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:07:35 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-01b7e6bf-915e-4350-9820-ea97bf560662 tempest-VolumesCloneNegativeTest-1648832085 None] Created reservations ['4630c4d1-573c-4036-87bf-eba54183021f', '858239a8-090c-4d0c-b542-9afefa59b54a', 'bf12dc9f-bed0-4157-8a42-5579b2616c9a', 'f07e7f37-de83-456e-bf41-d6a60d6bbe90'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:07:36 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-01b7e6bf-915e-4350-9820-ea97bf560662 tempest-VolumesCloneNegativeTest-1648832085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:07:36 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-01b7e6bf-915e-4350-9820-ea97bf560662 tempest-VolumesCloneNegativeTest-1648832085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:07:36 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-01b7e6bf-915e-4350-9820-ea97bf560662 tempest-VolumesCloneNegativeTest-1648832085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:07:36 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-01b7e6bf-915e-4350-9820-ea97bf560662 tempest-VolumesCloneNegativeTest-1648832085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:07:36 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-01b7e6bf-915e-4350-9820-ea97bf560662 tempest-VolumesCloneNegativeTest-1648832085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:07:36 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-01b7e6bf-915e-4350-9820-ea97bf560662 tempest-VolumesCloneNegativeTest-1648832085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:07:36 devstack sudo[93377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:07:36 devstack sudo[93377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:07:36 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-d77e63b8-0c9f-4005-9619-3752100c7020 tempest-AttachVolumeTestJSON-1128520514 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:07:36 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-d77e63b8-0c9f-4005-9619-3752100c7020 tempest-AttachVolumeTestJSON-1128520514 None] Flow 'volume_create_manager' (f9ac6bcf-e294-420c-8e9c-d8418c53ee38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:07:36 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-d77e63b8-0c9f-4005-9619-3752100c7020 tempest-AttachVolumeTestJSON-1128520514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cb77ca7-a0a4-40fd-ab39-2c3eb9bb50c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:07:36 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-d77e63b8-0c9f-4005-9619-3752100c7020 tempest-AttachVolumeTestJSON-1128520514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cb77ca7-a0a4-40fd-ab39-2c3eb9bb50c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:07:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-887150869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a96beed-1a85-4a11-9bbd-5fbb61ce4af6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f315bd8f9434f8496c9c5a883a8e212',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:07:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:07:36Z,use_quota=True,user_id='9b183a2bae364d0f87f382fea89e3ada',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:07:36 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-d77e63b8-0c9f-4005-9619-3752100c7020 tempest-AttachVolumeTestJSON-1128520514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0a3d860-e9e9-4508-9a84-f7f7791f70bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:07:36 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-d77e63b8-0c9f-4005-9619-3752100c7020 tempest-AttachVolumeTestJSON-1128520514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0a3d860-e9e9-4508-9a84-f7f7791f70bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:07:36 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-d77e63b8-0c9f-4005-9619-3752100c7020 tempest-AttachVolumeTestJSON-1128520514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da433e82-c769-407b-90d1-b3446fa5048f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:07:36 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-d77e63b8-0c9f-4005-9619-3752100c7020 tempest-AttachVolumeTestJSON-1128520514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da433e82-c769-407b-90d1-b3446fa5048f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a96beed-1a85-4a11-9bbd-5fbb61ce4af6', 'volume_name': 'volume-2a96beed-1a85-4a11-9bbd-5fbb61ce4af6', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:07:36 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-d77e63b8-0c9f-4005-9619-3752100c7020 tempest-AttachVolumeTestJSON-1128520514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91017049-c160-46d2-9524-bfbbc17d4600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:07:36 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-d77e63b8-0c9f-4005-9619-3752100c7020 tempest-AttachVolumeTestJSON-1128520514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91017049-c160-46d2-9524-bfbbc17d4600) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:07:36 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-d77e63b8-0c9f-4005-9619-3752100c7020 tempest-AttachVolumeTestJSON-1128520514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b738d2a-3dbb-4a3a-83bf-07fc0dc522bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:07:36 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-d77e63b8-0c9f-4005-9619-3752100c7020 tempest-AttachVolumeTestJSON-1128520514 None] Volume 2a96beed-1a85-4a11-9bbd-5fbb61ce4af6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a96beed-1a85-4a11-9bbd-5fbb61ce4af6', 'volume_size': 1} Nov 02 10:07:36 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-d77e63b8-0c9f-4005-9619-3752100c7020 tempest-AttachVolumeTestJSON-1128520514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:07:36 devstack sudo[93375]: pam_unix(sudo:session): session closed for user root Nov 02 10:07:36 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-622952bb-8e46-47bc-91d5-b1ff356b6187 tempest-GroupsV314Test-1415887311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-547964b8-1612-475f-9a3c-426d8d447068 -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-547964b8-1612-475f-9a3c-426d8d447068.a4cbb5b5-b17c-40d4-b731-2b11f49f793a" returned: 0 in 0.539s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:07:36 devstack cinder-volume[86890]: WARNING cinder.volume.drivers.remotefs [None req-622952bb-8e46-47bc-91d5-b1ff356b6187 tempest-GroupsV314Test-1415887311 None] /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-547964b8-1612-475f-9a3c-426d8d447068.a4cbb5b5-b17c-40d4-b731-2b11f49f793a is being set with open permissions: ugo+rw: NotImplementedError Nov 02 10:07:36 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-622952bb-8e46-47bc-91d5-b1ff356b6187 tempest-GroupsV314Test-1415887311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-547964b8-1612-475f-9a3c-426d8d447068.a4cbb5b5-b17c-40d4-b731-2b11f49f793a {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:07:36 devstack sudo[93382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-547964b8-1612-475f-9a3c-426d8d447068.a4cbb5b5-b17c-40d4-b731-2b11f49f793a Nov 02 10:07:36 devstack sudo[93382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:07:36 devstack sudo[93377]: pam_unix(sudo:session): session closed for user root Nov 02 10:07:36 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-01b7e6bf-915e-4350-9820-ea97bf560662 tempest-VolumesCloneNegativeTest-1648832085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.396s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:07:36 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-01b7e6bf-915e-4350-9820-ea97bf560662 tempest-VolumesCloneNegativeTest-1648832085 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:07:36 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-01b7e6bf-915e-4350-9820-ea97bf560662 tempest-VolumesCloneNegativeTest-1648832085 None] Deleted volume successfully. Nov 02 10:07:36 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-01b7e6bf-915e-4350-9820-ea97bf560662 tempest-VolumesCloneNegativeTest-1648832085 None] Lock "cinder-eb5d5423-33d7-42c5-ab22-e02bd225cf6d-delete_volume" released by "delete_volume" :: held 1.929s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:07:36 devstack sudo[93382]: pam_unix(sudo:session): session closed for user root Nov 02 10:07:36 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-622952bb-8e46-47bc-91d5-b1ff356b6187 tempest-GroupsV314Test-1415887311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-547964b8-1612-475f-9a3c-426d8d447068.a4cbb5b5-b17c-40d4-b731-2b11f49f793a" returned: 0 in 0.280s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:07:36 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-622952bb-8e46-47bc-91d5-b1ff356b6187 tempest-GroupsV314Test-1415887311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-547964b8-1612-475f-9a3c-426d8d447068.info {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:07:36 devstack sudo[93386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-547964b8-1612-475f-9a3c-426d8d447068.info Nov 02 10:07:36 devstack sudo[93386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:07:36 devstack sudo[93386]: pam_unix(sudo:session): session closed for user root Nov 02 10:07:36 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-622952bb-8e46-47bc-91d5-b1ff356b6187 tempest-GroupsV314Test-1415887311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-547964b8-1612-475f-9a3c-426d8d447068.info" returned: 0 in 0.281s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:07:36 devstack cinder-volume[86890]: WARNING cinder.volume.drivers.remotefs [None req-622952bb-8e46-47bc-91d5-b1ff356b6187 tempest-GroupsV314Test-1415887311 None] /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-547964b8-1612-475f-9a3c-426d8d447068.info is being set with open permissions: ugo+rw: NotImplementedError Nov 02 10:07:36 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-622952bb-8e46-47bc-91d5-b1ff356b6187 tempest-GroupsV314Test-1415887311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-547964b8-1612-475f-9a3c-426d8d447068.info {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:07:36 devstack sudo[93389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-547964b8-1612-475f-9a3c-426d8d447068.info Nov 02 10:07:36 devstack sudo[93389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:07:37 devstack sudo[93389]: pam_unix(sudo:session): session closed for user root Nov 02 10:07:37 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-622952bb-8e46-47bc-91d5-b1ff356b6187 tempest-GroupsV314Test-1415887311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-547964b8-1612-475f-9a3c-426d8d447068.info" returned: 0 in 0.256s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:07:37 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-622952bb-8e46-47bc-91d5-b1ff356b6187 tempest-GroupsV314Test-1415887311 None] Acquiring lock "cinder-quobyte-7f014f60-b98d-46b6-b50a-16abc2549371" by "_copy_volume_from_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:07:37 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-622952bb-8e46-47bc-91d5-b1ff356b6187 tempest-GroupsV314Test-1415887311 None] Lock "cinder-quobyte-7f014f60-b98d-46b6-b50a-16abc2549371" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:07:37 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-622952bb-8e46-47bc-91d5-b1ff356b6187 tempest-GroupsV314Test-1415887311 None] snapshot: a4cbb5b5-b17c-40d4-b731-2b11f49f793a, volume: 7f014f60-b98d-46b6-b50a-16abc2549371, {{(pid=86890) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 10:07:37 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-622952bb-8e46-47bc-91d5-b1ff356b6187 tempest-GroupsV314Test-1415887311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:07:37 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-622952bb-8e46-47bc-91d5-b1ff356b6187 tempest-GroupsV314Test-1415887311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:07:37 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-622952bb-8e46-47bc-91d5-b1ff356b6187 tempest-GroupsV314Test-1415887311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:07:37 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-622952bb-8e46-47bc-91d5-b1ff356b6187 tempest-GroupsV314Test-1415887311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:07:37 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-622952bb-8e46-47bc-91d5-b1ff356b6187 tempest-GroupsV314Test-1415887311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:07:37 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d1e86d0-966c-4a30-9954-66980bb742e3]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:07:37 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-622952bb-8e46-47bc-91d5-b1ff356b6187 tempest-GroupsV314Test-1415887311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-547964b8-1612-475f-9a3c-426d8d447068.a4cbb5b5-b17c-40d4-b731-2b11f49f793a {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:07:37 devstack sudo[93392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-547964b8-1612-475f-9a3c-426d8d447068.a4cbb5b5-b17c-40d4-b731-2b11f49f793a Nov 02 10:07:37 devstack sudo[93392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:07:37 devstack sudo[93392]: pam_unix(sudo:session): session closed for user root Nov 02 10:07:37 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-622952bb-8e46-47bc-91d5-b1ff356b6187 tempest-GroupsV314Test-1415887311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-547964b8-1612-475f-9a3c-426d8d447068.a4cbb5b5-b17c-40d4-b731-2b11f49f793a" returned: 0 in 0.452s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:07:37 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-622952bb-8e46-47bc-91d5-b1ff356b6187 tempest-GroupsV314Test-1415887311 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-547964b8-1612-475f-9a3c-426d8d447068(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86890) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:07:37 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[190d3ce7-6c82-46e8-8cc7-05c0c1ad7060]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:07:37 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-622952bb-8e46-47bc-91d5-b1ff356b6187 tempest-GroupsV314Test-1415887311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-547964b8-1612-475f-9a3c-426d8d447068 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:07:37 devstack sudo[93398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-547964b8-1612-475f-9a3c-426d8d447068 Nov 02 10:07:37 devstack sudo[93398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:07:38 devstack sudo[93398]: pam_unix(sudo:session): session closed for user root Nov 02 10:07:38 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-622952bb-8e46-47bc-91d5-b1ff356b6187 tempest-GroupsV314Test-1415887311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-547964b8-1612-475f-9a3c-426d8d447068" returned: 0 in 0.413s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:07:38 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-622952bb-8e46-47bc-91d5-b1ff356b6187 tempest-GroupsV314Test-1415887311 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-547964b8-1612-475f-9a3c-426d8d447068 {{(pid=86890) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 10:07:38 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-622952bb-8e46-47bc-91d5-b1ff356b6187 tempest-GroupsV314Test-1415887311 None] Creating direct copy from snapshot {{(pid=86890) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 10:07:38 devstack cinder-volume[86890]: DEBUG cinder.utils [None req-622952bb-8e46-47bc-91d5-b1ff356b6187 tempest-GroupsV314Test-1415887311 None] Path /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-7f014f60-b98d-46b6-b50a-16abc2549371 not found in is_blk_device check {{(pid=86890) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 10:07:38 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-622952bb-8e46-47bc-91d5-b1ff356b6187 tempest-GroupsV314Test-1415887311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-547964b8-1612-475f-9a3c-426d8d447068 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-7f014f60-b98d-46b6-b50a-16abc2549371 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:07:38 devstack sudo[93403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-547964b8-1612-475f-9a3c-426d8d447068 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-7f014f60-b98d-46b6-b50a-16abc2549371 Nov 02 10:07:38 devstack sudo[93403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:07:43 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-096bec8a-608b-43b0-8c4c-94071ab226d8 tempest-VolumesGetTest-2039441195 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:07:43 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-096bec8a-608b-43b0-8c4c-94071ab226d8 tempest-VolumesGetTest-2039441195 None] Flow 'volume_create_manager' (d528bcf8-5864-4881-b64c-020491c2b2f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:07:43 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-096bec8a-608b-43b0-8c4c-94071ab226d8 tempest-VolumesGetTest-2039441195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad0d5df0-216a-4ad9-b22c-82f67903316f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:07:43 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-096bec8a-608b-43b0-8c4c-94071ab226d8 tempest-VolumesGetTest-2039441195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad0d5df0-216a-4ad9-b22c-82f67903316f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:07:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-986307144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb6c9f35-4ba1-4110-a0d6-27a18a6c8bd3,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e9434cdefc464db38da17b8304add28b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:07:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:07:43Z,use_quota=True,user_id='48ed03cccb05426d978c6648244b5e52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:07:43 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-096bec8a-608b-43b0-8c4c-94071ab226d8 tempest-VolumesGetTest-2039441195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (298279c3-0ad5-4204-9b2f-e040524a51d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:07:43 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-096bec8a-608b-43b0-8c4c-94071ab226d8 tempest-VolumesGetTest-2039441195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (298279c3-0ad5-4204-9b2f-e040524a51d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:07:43 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-096bec8a-608b-43b0-8c4c-94071ab226d8 tempest-VolumesGetTest-2039441195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c45e5aec-2c33-44e1-b286-d1d6a247bc6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:07:43 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-096bec8a-608b-43b0-8c4c-94071ab226d8 tempest-VolumesGetTest-2039441195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c45e5aec-2c33-44e1-b286-d1d6a247bc6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb6c9f35-4ba1-4110-a0d6-27a18a6c8bd3', 'volume_name': 'volume-bb6c9f35-4ba1-4110-a0d6-27a18a6c8bd3', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:07:43 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-096bec8a-608b-43b0-8c4c-94071ab226d8 tempest-VolumesGetTest-2039441195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b919520e-7bc2-4f65-8a90-af6db628c9a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:07:43 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-096bec8a-608b-43b0-8c4c-94071ab226d8 tempest-VolumesGetTest-2039441195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b919520e-7bc2-4f65-8a90-af6db628c9a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:07:43 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-096bec8a-608b-43b0-8c4c-94071ab226d8 tempest-VolumesGetTest-2039441195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (118601fb-588e-45da-874a-ad9eb98b80b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:07:43 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-096bec8a-608b-43b0-8c4c-94071ab226d8 tempest-VolumesGetTest-2039441195 None] Volume bb6c9f35-4ba1-4110-a0d6-27a18a6c8bd3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb6c9f35-4ba1-4110-a0d6-27a18a6c8bd3', 'volume_size': 1} Nov 02 10:07:43 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-096bec8a-608b-43b0-8c4c-94071ab226d8 tempest-VolumesGetTest-2039441195 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:07:45 devstack sudo[93403]: pam_unix(sudo:session): session closed for user root Nov 02 10:07:45 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-622952bb-8e46-47bc-91d5-b1ff356b6187 tempest-GroupsV314Test-1415887311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-547964b8-1612-475f-9a3c-426d8d447068 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-7f014f60-b98d-46b6-b50a-16abc2549371" returned: 0 in 7.697s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:07:45 devstack cinder-volume[86890]: DEBUG cinder.image.image_utils [None req-622952bb-8e46-47bc-91d5-b1ff356b6187 tempest-GroupsV314Test-1415887311 None] Image conversion details: src /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-547964b8-1612-475f-9a3c-426d8d447068, size 1024.00 MB, duration 7.70 sec, destination /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-7f014f60-b98d-46b6-b50a-16abc2549371 {{(pid=86890) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 10:07:45 devstack cinder-volume[86890]: INFO cinder.image.image_utils [None req-622952bb-8e46-47bc-91d5-b1ff356b6187 tempest-GroupsV314Test-1415887311 None] Converted 1024.00 MB image at 133.03 MB/s Nov 02 10:07:45 devstack cinder-volume[86890]: WARNING cinder.volume.drivers.remotefs [None req-622952bb-8e46-47bc-91d5-b1ff356b6187 tempest-GroupsV314Test-1415887311 None] /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-7f014f60-b98d-46b6-b50a-16abc2549371 is being set with open permissions: ugo+rw: NotImplementedError Nov 02 10:07:45 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-622952bb-8e46-47bc-91d5-b1ff356b6187 tempest-GroupsV314Test-1415887311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-7f014f60-b98d-46b6-b50a-16abc2549371 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:07:45 devstack sudo[93430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-7f014f60-b98d-46b6-b50a-16abc2549371 Nov 02 10:07:45 devstack sudo[93430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:07:46 devstack sudo[93430]: pam_unix(sudo:session): session closed for user root Nov 02 10:07:46 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-622952bb-8e46-47bc-91d5-b1ff356b6187 tempest-GroupsV314Test-1415887311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-7f014f60-b98d-46b6-b50a-16abc2549371" returned: 0 in 0.232s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:07:46 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-622952bb-8e46-47bc-91d5-b1ff356b6187 tempest-GroupsV314Test-1415887311 None] Lock "cinder-quobyte-7f014f60-b98d-46b6-b50a-16abc2549371" released by "_copy_volume_from_snapshot" :: held 8.885s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:07:46 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-622952bb-8e46-47bc-91d5-b1ff356b6187 tempest-GroupsV314Test-1415887311 None] Acquiring lock "cinder-quobyte-a4cbb5b5-b17c-40d4-b731-2b11f49f793a" by "_delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:07:46 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-622952bb-8e46-47bc-91d5-b1ff356b6187 tempest-GroupsV314Test-1415887311 None] Lock "cinder-quobyte-a4cbb5b5-b17c-40d4-b731-2b11f49f793a" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:07:46 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-622952bb-8e46-47bc-91d5-b1ff356b6187 tempest-GroupsV314Test-1415887311 None] Deleting offline snapshot a4cbb5b5-b17c-40d4-b731-2b11f49f793a of volume 547964b8-1612-475f-9a3c-426d8d447068 {{(pid=86890) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:07:46 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-622952bb-8e46-47bc-91d5-b1ff356b6187 tempest-GroupsV314Test-1415887311 None] snapshot_file for this snap is: volume-547964b8-1612-475f-9a3c-426d8d447068.a4cbb5b5-b17c-40d4-b731-2b11f49f793a {{(pid=86890) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:07:46 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa5d2c81-8f4c-45ef-b500-6314165e18c2]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:07:46 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-622952bb-8e46-47bc-91d5-b1ff356b6187 tempest-GroupsV314Test-1415887311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-547964b8-1612-475f-9a3c-426d8d447068.a4cbb5b5-b17c-40d4-b731-2b11f49f793a {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:07:46 devstack sudo[93433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-547964b8-1612-475f-9a3c-426d8d447068.a4cbb5b5-b17c-40d4-b731-2b11f49f793a Nov 02 10:07:46 devstack sudo[93433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:07:46 devstack sudo[93433]: pam_unix(sudo:session): session closed for user root Nov 02 10:07:46 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-622952bb-8e46-47bc-91d5-b1ff356b6187 tempest-GroupsV314Test-1415887311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-547964b8-1612-475f-9a3c-426d8d447068.a4cbb5b5-b17c-40d4-b731-2b11f49f793a" returned: 0 in 0.385s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:07:46 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-622952bb-8e46-47bc-91d5-b1ff356b6187 tempest-GroupsV314Test-1415887311 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-547964b8-1612-475f-9a3c-426d8d447068(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86890) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:07:46 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[142a02d8-cbe3-44cc-82cd-02ac879115b3]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:07:46 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-622952bb-8e46-47bc-91d5-b1ff356b6187 tempest-GroupsV314Test-1415887311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-547964b8-1612-475f-9a3c-426d8d447068 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:07:46 devstack sudo[93438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-547964b8-1612-475f-9a3c-426d8d447068 Nov 02 10:07:46 devstack sudo[93438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:07:47 devstack sudo[93438]: pam_unix(sudo:session): session closed for user root Nov 02 10:07:47 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-622952bb-8e46-47bc-91d5-b1ff356b6187 tempest-GroupsV314Test-1415887311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-547964b8-1612-475f-9a3c-426d8d447068" returned: 0 in 0.500s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:07:47 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-622952bb-8e46-47bc-91d5-b1ff356b6187 tempest-GroupsV314Test-1415887311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-547964b8-1612-475f-9a3c-426d8d447068.a4cbb5b5-b17c-40d4-b731-2b11f49f793a {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:07:47 devstack sudo[93443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-547964b8-1612-475f-9a3c-426d8d447068.a4cbb5b5-b17c-40d4-b731-2b11f49f793a Nov 02 10:07:47 devstack sudo[93443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:07:47 devstack sudo[93443]: pam_unix(sudo:session): session closed for user root Nov 02 10:07:47 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-622952bb-8e46-47bc-91d5-b1ff356b6187 tempest-GroupsV314Test-1415887311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-547964b8-1612-475f-9a3c-426d8d447068.a4cbb5b5-b17c-40d4-b731-2b11f49f793a" returned: 0 in 0.320s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:07:47 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-622952bb-8e46-47bc-91d5-b1ff356b6187 tempest-GroupsV314Test-1415887311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-547964b8-1612-475f-9a3c-426d8d447068.a4cbb5b5-b17c-40d4-b731-2b11f49f793a {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:07:47 devstack sudo[93448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-547964b8-1612-475f-9a3c-426d8d447068.a4cbb5b5-b17c-40d4-b731-2b11f49f793a Nov 02 10:07:47 devstack sudo[93448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:07:47 devstack sudo[93448]: pam_unix(sudo:session): session closed for user root Nov 02 10:07:47 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-622952bb-8e46-47bc-91d5-b1ff356b6187 tempest-GroupsV314Test-1415887311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-547964b8-1612-475f-9a3c-426d8d447068.a4cbb5b5-b17c-40d4-b731-2b11f49f793a" returned: 0 in 0.284s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:07:47 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-622952bb-8e46-47bc-91d5-b1ff356b6187 tempest-GroupsV314Test-1415887311 None] Lock "cinder-quobyte-a4cbb5b5-b17c-40d4-b731-2b11f49f793a" released by "_delete_snapshot" :: held 1.604s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:07:47 devstack cinder-volume[86890]: DEBUG dbcounter [-] [86890] Writing DB stats cinder:SELECT=105,cinder:UPDATE=97,cinder:DELETE=7,cinder:INSERT=21 {{(pid=86890) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:07:47 devstack cinder-volume[86890]: DEBUG dbcounter [-] [86890] Writing DB stats cinder:SELECT=89,cinder:INSERT=29,cinder:UPDATE=79,cinder:DELETE=3 {{(pid=86890) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:07:47 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-622952bb-8e46-47bc-91d5-b1ff356b6187 tempest-GroupsV314Test-1415887311 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.674s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:07:47 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-d77e63b8-0c9f-4005-9619-3752100c7020 tempest-AttachVolumeTestJSON-1128520514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.502s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:07:47 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-d77e63b8-0c9f-4005-9619-3752100c7020 tempest-AttachVolumeTestJSON-1128520514 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:07:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-887150869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a96beed-1a85-4a11-9bbd-5fbb61ce4af6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f315bd8f9434f8496c9c5a883a8e212',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:07:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:07:36Z,use_quota=True,user_id='9b183a2bae364d0f87f382fea89e3ada',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:07:47 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-d77e63b8-0c9f-4005-9619-3752100c7020 tempest-AttachVolumeTestJSON-1128520514 None] Creating volume 2a96beed-1a85-4a11-9bbd-5fbb61ce4af6 {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:07:47 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-d77e63b8-0c9f-4005-9619-3752100c7020 tempest-AttachVolumeTestJSON-1128520514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:07:47 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-d77e63b8-0c9f-4005-9619-3752100c7020 tempest-AttachVolumeTestJSON-1128520514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:07:47 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-d77e63b8-0c9f-4005-9619-3752100c7020 tempest-AttachVolumeTestJSON-1128520514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:07:47 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-d77e63b8-0c9f-4005-9619-3752100c7020 tempest-AttachVolumeTestJSON-1128520514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:07:47 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-d77e63b8-0c9f-4005-9619-3752100c7020 tempest-AttachVolumeTestJSON-1128520514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:07:47 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-d77e63b8-0c9f-4005-9619-3752100c7020 tempest-AttachVolumeTestJSON-1128520514 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:07:47 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-d77e63b8-0c9f-4005-9619-3752100c7020 tempest-AttachVolumeTestJSON-1128520514 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:07:47 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-d77e63b8-0c9f-4005-9619-3752100c7020 tempest-AttachVolumeTestJSON-1128520514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-2a96beed-1a85-4a11-9bbd-5fbb61ce4af6 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:07:47 devstack sudo[93451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-2a96beed-1a85-4a11-9bbd-5fbb61ce4af6 1073741824 Nov 02 10:07:47 devstack sudo[93451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:07:47 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-622952bb-8e46-47bc-91d5-b1ff356b6187 tempest-GroupsV314Test-1415887311 None] Create group from source-group-9a87b367-c9e7-4f93-bc72-9d3cbaac658f completed successfully. Nov 02 10:07:48 devstack sudo[93451]: pam_unix(sudo:session): session closed for user root Nov 02 10:07:48 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-d77e63b8-0c9f-4005-9619-3752100c7020 tempest-AttachVolumeTestJSON-1128520514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-2a96beed-1a85-4a11-9bbd-5fbb61ce4af6 1073741824" returned: 0 in 0.476s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:07:48 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-d77e63b8-0c9f-4005-9619-3752100c7020 tempest-AttachVolumeTestJSON-1128520514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-2a96beed-1a85-4a11-9bbd-5fbb61ce4af6 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:07:48 devstack sudo[93484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-2a96beed-1a85-4a11-9bbd-5fbb61ce4af6 Nov 02 10:07:48 devstack sudo[93484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:07:48 devstack sudo[93484]: pam_unix(sudo:session): session closed for user root Nov 02 10:07:48 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-d77e63b8-0c9f-4005-9619-3752100c7020 tempest-AttachVolumeTestJSON-1128520514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-2a96beed-1a85-4a11-9bbd-5fbb61ce4af6" returned: 0 in 0.278s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:07:48 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-d77e63b8-0c9f-4005-9619-3752100c7020 tempest-AttachVolumeTestJSON-1128520514 None] <== create_volume: return (806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:07:48 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-d77e63b8-0c9f-4005-9619-3752100c7020 tempest-AttachVolumeTestJSON-1128520514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.810s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:07:48 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-096bec8a-608b-43b0-8c4c-94071ab226d8 tempest-VolumesGetTest-2039441195 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.963s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:07:48 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-096bec8a-608b-43b0-8c4c-94071ab226d8 tempest-VolumesGetTest-2039441195 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:07:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-986307144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb6c9f35-4ba1-4110-a0d6-27a18a6c8bd3,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e9434cdefc464db38da17b8304add28b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:07:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:07:43Z,use_quota=True,user_id='48ed03cccb05426d978c6648244b5e52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:07:48 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-096bec8a-608b-43b0-8c4c-94071ab226d8 tempest-VolumesGetTest-2039441195 None] Creating volume bb6c9f35-4ba1-4110-a0d6-27a18a6c8bd3 {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:07:48 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-096bec8a-608b-43b0-8c4c-94071ab226d8 tempest-VolumesGetTest-2039441195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:07:48 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-096bec8a-608b-43b0-8c4c-94071ab226d8 tempest-VolumesGetTest-2039441195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:07:48 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-096bec8a-608b-43b0-8c4c-94071ab226d8 tempest-VolumesGetTest-2039441195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:07:48 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-096bec8a-608b-43b0-8c4c-94071ab226d8 tempest-VolumesGetTest-2039441195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:07:48 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-096bec8a-608b-43b0-8c4c-94071ab226d8 tempest-VolumesGetTest-2039441195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:07:48 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-096bec8a-608b-43b0-8c4c-94071ab226d8 tempest-VolumesGetTest-2039441195 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:07:48 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-096bec8a-608b-43b0-8c4c-94071ab226d8 tempest-VolumesGetTest-2039441195 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:07:48 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-096bec8a-608b-43b0-8c4c-94071ab226d8 tempest-VolumesGetTest-2039441195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-bb6c9f35-4ba1-4110-a0d6-27a18a6c8bd3 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:07:48 devstack sudo[93489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-bb6c9f35-4ba1-4110-a0d6-27a18a6c8bd3 1073741824 Nov 02 10:07:48 devstack sudo[93489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:07:48 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-d77e63b8-0c9f-4005-9619-3752100c7020 tempest-AttachVolumeTestJSON-1128520514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b738d2a-3dbb-4a3a-83bf-07fc0dc522bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a96beed-1a85-4a11-9bbd-5fbb61ce4af6', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:07:48 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-d77e63b8-0c9f-4005-9619-3752100c7020 tempest-AttachVolumeTestJSON-1128520514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c311cb8-edf5-405a-9519-f271edaf21fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:07:48 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-d77e63b8-0c9f-4005-9619-3752100c7020 tempest-AttachVolumeTestJSON-1128520514 None] Volume volume-2a96beed-1a85-4a11-9bbd-5fbb61ce4af6 (2a96beed-1a85-4a11-9bbd-5fbb61ce4af6): created successfully Nov 02 10:07:48 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-d77e63b8-0c9f-4005-9619-3752100c7020 tempest-AttachVolumeTestJSON-1128520514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c311cb8-edf5-405a-9519-f271edaf21fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:07:48 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-d77e63b8-0c9f-4005-9619-3752100c7020 tempest-AttachVolumeTestJSON-1128520514 None] Flow 'volume_create_manager' (f9ac6bcf-e294-420c-8e9c-d8418c53ee38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:07:48 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-d77e63b8-0c9f-4005-9619-3752100c7020 tempest-AttachVolumeTestJSON-1128520514 None] Created volume successfully. Nov 02 10:07:49 devstack sudo[93489]: pam_unix(sudo:session): session closed for user root Nov 02 10:07:49 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-096bec8a-608b-43b0-8c4c-94071ab226d8 tempest-VolumesGetTest-2039441195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-bb6c9f35-4ba1-4110-a0d6-27a18a6c8bd3 1073741824" returned: 0 in 0.565s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:07:49 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-096bec8a-608b-43b0-8c4c-94071ab226d8 tempest-VolumesGetTest-2039441195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-bb6c9f35-4ba1-4110-a0d6-27a18a6c8bd3 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:07:49 devstack sudo[93495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-bb6c9f35-4ba1-4110-a0d6-27a18a6c8bd3 Nov 02 10:07:49 devstack sudo[93495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:07:49 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-eceb01cd-2b95-4107-bffe-cc0335d2610f tempest-GroupsV314Test-1415887311 None] Acquiring lock "cinder-quobyte-7f014f60-b98d-46b6-b50a-16abc2549371" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:07:49 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-eceb01cd-2b95-4107-bffe-cc0335d2610f tempest-GroupsV314Test-1415887311 None] Lock "cinder-quobyte-7f014f60-b98d-46b6-b50a-16abc2549371" acquired by "delete_volume" :: waited 0.023s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:07:49 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3a6c728-b748-4cf4-a162-447d0d28aba1]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:07:49 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-eceb01cd-2b95-4107-bffe-cc0335d2610f tempest-GroupsV314Test-1415887311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-7f014f60-b98d-46b6-b50a-16abc2549371 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:07:49 devstack sudo[93495]: pam_unix(sudo:session): session closed for user root Nov 02 10:07:49 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-096bec8a-608b-43b0-8c4c-94071ab226d8 tempest-VolumesGetTest-2039441195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-bb6c9f35-4ba1-4110-a0d6-27a18a6c8bd3" returned: 0 in 0.382s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:07:49 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-096bec8a-608b-43b0-8c4c-94071ab226d8 tempest-VolumesGetTest-2039441195 None] <== create_volume: return (999ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:07:49 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-096bec8a-608b-43b0-8c4c-94071ab226d8 tempest-VolumesGetTest-2039441195 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.003s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:07:49 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-096bec8a-608b-43b0-8c4c-94071ab226d8 tempest-VolumesGetTest-2039441195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (118601fb-588e-45da-874a-ad9eb98b80b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb6c9f35-4ba1-4110-a0d6-27a18a6c8bd3', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:07:49 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-096bec8a-608b-43b0-8c4c-94071ab226d8 tempest-VolumesGetTest-2039441195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6f6ea05-df18-448b-8eed-f578fa95b79c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:07:49 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-096bec8a-608b-43b0-8c4c-94071ab226d8 tempest-VolumesGetTest-2039441195 None] Volume volume-bb6c9f35-4ba1-4110-a0d6-27a18a6c8bd3 (bb6c9f35-4ba1-4110-a0d6-27a18a6c8bd3): created successfully Nov 02 10:07:49 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-096bec8a-608b-43b0-8c4c-94071ab226d8 tempest-VolumesGetTest-2039441195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6f6ea05-df18-448b-8eed-f578fa95b79c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:07:49 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-096bec8a-608b-43b0-8c4c-94071ab226d8 tempest-VolumesGetTest-2039441195 None] Flow 'volume_create_manager' (d528bcf8-5864-4881-b64c-020491c2b2f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:07:49 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-096bec8a-608b-43b0-8c4c-94071ab226d8 tempest-VolumesGetTest-2039441195 None] Created volume successfully. Nov 02 10:07:49 devstack sudo[93498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-7f014f60-b98d-46b6-b50a-16abc2549371 Nov 02 10:07:49 devstack sudo[93498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:07:50 devstack sudo[93498]: pam_unix(sudo:session): session closed for user root Nov 02 10:07:50 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-eceb01cd-2b95-4107-bffe-cc0335d2610f tempest-GroupsV314Test-1415887311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-7f014f60-b98d-46b6-b50a-16abc2549371" returned: 0 in 0.574s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:07:50 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-eceb01cd-2b95-4107-bffe-cc0335d2610f tempest-GroupsV314Test-1415887311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-7f014f60-b98d-46b6-b50a-16abc2549371 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:07:50 devstack sudo[93517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-7f014f60-b98d-46b6-b50a-16abc2549371 Nov 02 10:07:50 devstack sudo[93517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:07:50 devstack sudo[93517]: pam_unix(sudo:session): session closed for user root Nov 02 10:07:50 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-eceb01cd-2b95-4107-bffe-cc0335d2610f tempest-GroupsV314Test-1415887311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-7f014f60-b98d-46b6-b50a-16abc2549371" returned: 0 in 0.391s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:07:50 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-eceb01cd-2b95-4107-bffe-cc0335d2610f tempest-GroupsV314Test-1415887311 None] Lock "cinder-quobyte-7f014f60-b98d-46b6-b50a-16abc2549371" released by "delete_volume" :: held 1.061s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:07:50 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [req-f01a3d27-d2bf-44a4-80d6-189b1112b1ad req-0caedde9-d072-4507-8b72-7c6eabeb0623 tempest-AttachVolumeTestJSON-1128520514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:07:50 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [req-f01a3d27-d2bf-44a4-80d6-189b1112b1ad req-0caedde9-d072-4507-8b72-7c6eabeb0623 tempest-AttachVolumeTestJSON-1128520514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:07:50 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [req-f01a3d27-d2bf-44a4-80d6-189b1112b1ad req-0caedde9-d072-4507-8b72-7c6eabeb0623 tempest-AttachVolumeTestJSON-1128520514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:07:50 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [req-f01a3d27-d2bf-44a4-80d6-189b1112b1ad req-0caedde9-d072-4507-8b72-7c6eabeb0623 tempest-AttachVolumeTestJSON-1128520514 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67', 'name': 'volume-2a96beed-1a85-4a11-9bbd-5fbb61ce4af6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e0213659-fb18-4915-8eff-c58dc0dc0510', 'enforce_multipath': True} {{(pid=86890) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:07:50 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-eceb01cd-2b95-4107-bffe-cc0335d2610f tempest-GroupsV314Test-1415887311 None] Created reservations ['aa591762-271f-42ca-aac3-569a8f87a7f0'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:07:50 devstack cinder-volume[86890]: WARNING cinder.quota [None req-eceb01cd-2b95-4107-bffe-cc0335d2610f tempest-GroupsV314Test-1415887311 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-450412339 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-450412339, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:07:50 devstack cinder-volume[86890]: WARNING cinder.quota [None req-eceb01cd-2b95-4107-bffe-cc0335d2610f tempest-GroupsV314Test-1415887311 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-450412339 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-450412339, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:07:50 devstack cinder-volume[86890]: INFO cinder.volume.manager [req-f01a3d27-d2bf-44a4-80d6-189b1112b1ad req-0caedde9-d072-4507-8b72-7c6eabeb0623 tempest-AttachVolumeTestJSON-1128520514 None] attachment_update completed successfully. Nov 02 10:07:50 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-eceb01cd-2b95-4107-bffe-cc0335d2610f tempest-GroupsV314Test-1415887311 None] Created reservations ['a2a81cf4-bb5d-4657-b58e-937fae68a205', '06d2688f-d63b-45ca-b4e5-afa0cc311825', '541ae987-2a39-4fd5-b716-104c06e2c882', '24dceddf-475c-4c15-8039-9bb8e89d2cee'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:07:50 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-eceb01cd-2b95-4107-bffe-cc0335d2610f tempest-GroupsV314Test-1415887311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:07:50 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-eceb01cd-2b95-4107-bffe-cc0335d2610f tempest-GroupsV314Test-1415887311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:07:50 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-eceb01cd-2b95-4107-bffe-cc0335d2610f tempest-GroupsV314Test-1415887311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:07:50 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-eceb01cd-2b95-4107-bffe-cc0335d2610f tempest-GroupsV314Test-1415887311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:07:50 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-eceb01cd-2b95-4107-bffe-cc0335d2610f tempest-GroupsV314Test-1415887311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:07:50 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-eceb01cd-2b95-4107-bffe-cc0335d2610f tempest-GroupsV314Test-1415887311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:07:51 devstack sudo[93530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:07:51 devstack sudo[93530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:07:51 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-36d295db-51da-43cc-ad0c-51db0d5317d6 tempest-VolumesGetTest-2039441195 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:07:51 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-36d295db-51da-43cc-ad0c-51db0d5317d6 tempest-VolumesGetTest-2039441195 None] Flow 'volume_create_manager' (42e007d9-95cc-4703-bd4c-1dab25a87cae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:07:51 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-36d295db-51da-43cc-ad0c-51db0d5317d6 tempest-VolumesGetTest-2039441195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39a8b02e-b967-4285-a993-563bff1131b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:07:51 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-36d295db-51da-43cc-ad0c-51db0d5317d6 tempest-VolumesGetTest-2039441195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39a8b02e-b967-4285-a993-563bff1131b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:07:51Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-238950443',display_name='tempest-VolumesGetTest-Volume-45188174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f32fe138-ac6a-419b-a1f6-3d9ed59af621,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9434cdefc464db38da17b8304add28b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:07:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:07:51Z,use_quota=True,user_id='48ed03cccb05426d978c6648244b5e52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:07:51 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-36d295db-51da-43cc-ad0c-51db0d5317d6 tempest-VolumesGetTest-2039441195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (261d0392-01fa-4adc-bb02-762afbb3cf12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:07:51 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-36d295db-51da-43cc-ad0c-51db0d5317d6 tempest-VolumesGetTest-2039441195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (261d0392-01fa-4adc-bb02-762afbb3cf12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:07:51 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-36d295db-51da-43cc-ad0c-51db0d5317d6 tempest-VolumesGetTest-2039441195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90fb3073-a29e-4768-9ab3-c5e33c8c0d45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:07:51 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-36d295db-51da-43cc-ad0c-51db0d5317d6 tempest-VolumesGetTest-2039441195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90fb3073-a29e-4768-9ab3-c5e33c8c0d45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f32fe138-ac6a-419b-a1f6-3d9ed59af621', 'volume_name': 'volume-f32fe138-ac6a-419b-a1f6-3d9ed59af621', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:07:51 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-36d295db-51da-43cc-ad0c-51db0d5317d6 tempest-VolumesGetTest-2039441195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b292f518-9a6f-43f8-a09c-5a3803494556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:07:51 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-36d295db-51da-43cc-ad0c-51db0d5317d6 tempest-VolumesGetTest-2039441195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b292f518-9a6f-43f8-a09c-5a3803494556) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:07:51 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-36d295db-51da-43cc-ad0c-51db0d5317d6 tempest-VolumesGetTest-2039441195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d893a130-21c9-4309-937c-62d2257319dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:07:51 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-36d295db-51da-43cc-ad0c-51db0d5317d6 tempest-VolumesGetTest-2039441195 None] Volume f32fe138-ac6a-419b-a1f6-3d9ed59af621: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f32fe138-ac6a-419b-a1f6-3d9ed59af621', 'volume_size': 1} Nov 02 10:07:51 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-36d295db-51da-43cc-ad0c-51db0d5317d6 tempest-VolumesGetTest-2039441195 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:07:51 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-36d295db-51da-43cc-ad0c-51db0d5317d6 tempest-VolumesGetTest-2039441195 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:07:51 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-36d295db-51da-43cc-ad0c-51db0d5317d6 tempest-VolumesGetTest-2039441195 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:07:51Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-238950443',display_name='tempest-VolumesGetTest-Volume-45188174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f32fe138-ac6a-419b-a1f6-3d9ed59af621,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9434cdefc464db38da17b8304add28b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:07:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:07:51Z,use_quota=True,user_id='48ed03cccb05426d978c6648244b5e52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:07:51 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-36d295db-51da-43cc-ad0c-51db0d5317d6 tempest-VolumesGetTest-2039441195 None] Creating volume f32fe138-ac6a-419b-a1f6-3d9ed59af621 {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:07:51 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-36d295db-51da-43cc-ad0c-51db0d5317d6 tempest-VolumesGetTest-2039441195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:07:51 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-36d295db-51da-43cc-ad0c-51db0d5317d6 tempest-VolumesGetTest-2039441195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:07:51 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-36d295db-51da-43cc-ad0c-51db0d5317d6 tempest-VolumesGetTest-2039441195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:07:51 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-36d295db-51da-43cc-ad0c-51db0d5317d6 tempest-VolumesGetTest-2039441195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:07:51 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-36d295db-51da-43cc-ad0c-51db0d5317d6 tempest-VolumesGetTest-2039441195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:07:51 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-36d295db-51da-43cc-ad0c-51db0d5317d6 tempest-VolumesGetTest-2039441195 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:07:51 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-36d295db-51da-43cc-ad0c-51db0d5317d6 tempest-VolumesGetTest-2039441195 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:07:51 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-36d295db-51da-43cc-ad0c-51db0d5317d6 tempest-VolumesGetTest-2039441195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-f32fe138-ac6a-419b-a1f6-3d9ed59af621 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:07:51 devstack sudo[93532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-f32fe138-ac6a-419b-a1f6-3d9ed59af621 1073741824 Nov 02 10:07:51 devstack sudo[93532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:07:51 devstack sudo[93530]: pam_unix(sudo:session): session closed for user root Nov 02 10:07:51 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-eceb01cd-2b95-4107-bffe-cc0335d2610f tempest-GroupsV314Test-1415887311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.388s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:07:51 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-eceb01cd-2b95-4107-bffe-cc0335d2610f tempest-GroupsV314Test-1415887311 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:07:51 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-eceb01cd-2b95-4107-bffe-cc0335d2610f tempest-GroupsV314Test-1415887311 None] Delete group completed successfully. Nov 02 10:07:51 devstack sudo[93532]: pam_unix(sudo:session): session closed for user root Nov 02 10:07:51 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-36d295db-51da-43cc-ad0c-51db0d5317d6 tempest-VolumesGetTest-2039441195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-f32fe138-ac6a-419b-a1f6-3d9ed59af621 1073741824" returned: 0 in 0.501s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:07:51 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-36d295db-51da-43cc-ad0c-51db0d5317d6 tempest-VolumesGetTest-2039441195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-f32fe138-ac6a-419b-a1f6-3d9ed59af621 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:07:51 devstack sudo[93539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-f32fe138-ac6a-419b-a1f6-3d9ed59af621 Nov 02 10:07:51 devstack sudo[93539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:07:52 devstack sudo[93539]: pam_unix(sudo:session): session closed for user root Nov 02 10:07:52 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-36d295db-51da-43cc-ad0c-51db0d5317d6 tempest-VolumesGetTest-2039441195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-f32fe138-ac6a-419b-a1f6-3d9ed59af621" returned: 0 in 0.254s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:07:52 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-36d295db-51da-43cc-ad0c-51db0d5317d6 tempest-VolumesGetTest-2039441195 None] <== create_volume: return (816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:07:52 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-36d295db-51da-43cc-ad0c-51db0d5317d6 tempest-VolumesGetTest-2039441195 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.819s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:07:52 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-36d295db-51da-43cc-ad0c-51db0d5317d6 tempest-VolumesGetTest-2039441195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d893a130-21c9-4309-937c-62d2257319dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f32fe138-ac6a-419b-a1f6-3d9ed59af621', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:07:52 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-36d295db-51da-43cc-ad0c-51db0d5317d6 tempest-VolumesGetTest-2039441195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2244f93-acd5-42a6-b579-8fe715ee71c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:07:52 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-36d295db-51da-43cc-ad0c-51db0d5317d6 tempest-VolumesGetTest-2039441195 None] Volume volume-f32fe138-ac6a-419b-a1f6-3d9ed59af621 (f32fe138-ac6a-419b-a1f6-3d9ed59af621): created successfully Nov 02 10:07:52 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-36d295db-51da-43cc-ad0c-51db0d5317d6 tempest-VolumesGetTest-2039441195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2244f93-acd5-42a6-b579-8fe715ee71c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:07:52 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-36d295db-51da-43cc-ad0c-51db0d5317d6 tempest-VolumesGetTest-2039441195 None] Flow 'volume_create_manager' (42e007d9-95cc-4703-bd4c-1dab25a87cae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:07:52 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-36d295db-51da-43cc-ad0c-51db0d5317d6 tempest-VolumesGetTest-2039441195 None] Created volume successfully. Nov 02 10:07:52 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-d9414e16-db72-4c03-a363-2bb70cbe7ea0 tempest-GroupsV314Test-1415887311 None] Acquiring lock "cinder-quobyte-547964b8-1612-475f-9a3c-426d8d447068" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:07:52 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-d9414e16-db72-4c03-a363-2bb70cbe7ea0 tempest-GroupsV314Test-1415887311 None] Lock "cinder-quobyte-547964b8-1612-475f-9a3c-426d8d447068" acquired by "delete_volume" :: waited 0.018s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:07:52 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2cd0ff0-b510-4caf-8566-933f3fa952be]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:07:52 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-d9414e16-db72-4c03-a363-2bb70cbe7ea0 tempest-GroupsV314Test-1415887311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-547964b8-1612-475f-9a3c-426d8d447068 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:07:52 devstack sudo[93542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-547964b8-1612-475f-9a3c-426d8d447068 Nov 02 10:07:52 devstack sudo[93542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:07:52 devstack sudo[93542]: pam_unix(sudo:session): session closed for user root Nov 02 10:07:52 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-d9414e16-db72-4c03-a363-2bb70cbe7ea0 tempest-GroupsV314Test-1415887311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-547964b8-1612-475f-9a3c-426d8d447068" returned: 0 in 0.437s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:07:52 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-d9414e16-db72-4c03-a363-2bb70cbe7ea0 tempest-GroupsV314Test-1415887311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-547964b8-1612-475f-9a3c-426d8d447068 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:07:52 devstack sudo[93547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-547964b8-1612-475f-9a3c-426d8d447068 Nov 02 10:07:52 devstack sudo[93547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:07:53 devstack sudo[93547]: pam_unix(sudo:session): session closed for user root Nov 02 10:07:53 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-d9414e16-db72-4c03-a363-2bb70cbe7ea0 tempest-GroupsV314Test-1415887311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-547964b8-1612-475f-9a3c-426d8d447068" returned: 0 in 0.279s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:07:53 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-d9414e16-db72-4c03-a363-2bb70cbe7ea0 tempest-GroupsV314Test-1415887311 None] Lock "cinder-quobyte-547964b8-1612-475f-9a3c-426d8d447068" released by "delete_volume" :: held 0.807s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:07:53 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-d9414e16-db72-4c03-a363-2bb70cbe7ea0 tempest-GroupsV314Test-1415887311 None] Created reservations ['fac444cb-67b4-42a1-8f6e-b792af330f85'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:07:53 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee7cabfa-410f-40a9-b665-516981ff408e tempest-AttachVolumeTestJSON-1128520514 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:07:53 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-ee7cabfa-410f-40a9-b665-516981ff408e tempest-AttachVolumeTestJSON-1128520514 None] Flow 'volume_create_manager' (5baff516-2daa-4705-9d62-0c896179c600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:07:53 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-ee7cabfa-410f-40a9-b665-516981ff408e tempest-AttachVolumeTestJSON-1128520514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b10967f-2e00-4d00-9110-cf1b1508ddc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:07:53 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-d9414e16-db72-4c03-a363-2bb70cbe7ea0 tempest-GroupsV314Test-1415887311 None] Created reservations ['505229ad-f73f-4fec-83d5-75747db28f19', 'da5c23b8-85d9-4905-a902-7aab9a22fde5', 'f1133937-7f8b-4453-9403-6008ca3081c8', '3a0727aa-d200-4655-a859-08f79ff2aa7d'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:07:53 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-ee7cabfa-410f-40a9-b665-516981ff408e tempest-AttachVolumeTestJSON-1128520514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b10967f-2e00-4d00-9110-cf1b1508ddc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:07:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-330106901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3823828e-2446-4877-a013-d112e548aa21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f315bd8f9434f8496c9c5a883a8e212',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:07:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:07:53Z,use_quota=True,user_id='9b183a2bae364d0f87f382fea89e3ada',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:07:53 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-ee7cabfa-410f-40a9-b665-516981ff408e tempest-AttachVolumeTestJSON-1128520514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (faadc6ee-8cd6-4dec-81c2-2e674eb11ca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:07:53 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-ee7cabfa-410f-40a9-b665-516981ff408e tempest-AttachVolumeTestJSON-1128520514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (faadc6ee-8cd6-4dec-81c2-2e674eb11ca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:07:53 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-ee7cabfa-410f-40a9-b665-516981ff408e tempest-AttachVolumeTestJSON-1128520514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f9847ad-30c9-480c-89c1-8ef286ec3fa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:07:53 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-ee7cabfa-410f-40a9-b665-516981ff408e tempest-AttachVolumeTestJSON-1128520514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f9847ad-30c9-480c-89c1-8ef286ec3fa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3823828e-2446-4877-a013-d112e548aa21', 'volume_name': 'volume-3823828e-2446-4877-a013-d112e548aa21', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:07:53 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-ee7cabfa-410f-40a9-b665-516981ff408e tempest-AttachVolumeTestJSON-1128520514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1db7fc76-df1d-426a-bbcf-98c2d991d636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:07:53 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-ee7cabfa-410f-40a9-b665-516981ff408e tempest-AttachVolumeTestJSON-1128520514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1db7fc76-df1d-426a-bbcf-98c2d991d636) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:07:53 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-ee7cabfa-410f-40a9-b665-516981ff408e tempest-AttachVolumeTestJSON-1128520514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44f7ce38-fd24-4e49-8ebb-580a606b0963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:07:53 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-ee7cabfa-410f-40a9-b665-516981ff408e tempest-AttachVolumeTestJSON-1128520514 None] Volume 3823828e-2446-4877-a013-d112e548aa21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3823828e-2446-4877-a013-d112e548aa21', 'volume_size': 1} Nov 02 10:07:53 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-ee7cabfa-410f-40a9-b665-516981ff408e tempest-AttachVolumeTestJSON-1128520514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:07:53 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-ee7cabfa-410f-40a9-b665-516981ff408e tempest-AttachVolumeTestJSON-1128520514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:07:53 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-ee7cabfa-410f-40a9-b665-516981ff408e tempest-AttachVolumeTestJSON-1128520514 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:07:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-330106901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3823828e-2446-4877-a013-d112e548aa21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f315bd8f9434f8496c9c5a883a8e212',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:07:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:07:53Z,use_quota=True,user_id='9b183a2bae364d0f87f382fea89e3ada',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:07:53 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-ee7cabfa-410f-40a9-b665-516981ff408e tempest-AttachVolumeTestJSON-1128520514 None] Creating volume 3823828e-2446-4877-a013-d112e548aa21 {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:07:53 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-ee7cabfa-410f-40a9-b665-516981ff408e tempest-AttachVolumeTestJSON-1128520514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:07:53 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-ee7cabfa-410f-40a9-b665-516981ff408e tempest-AttachVolumeTestJSON-1128520514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:07:53 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-ee7cabfa-410f-40a9-b665-516981ff408e tempest-AttachVolumeTestJSON-1128520514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:07:53 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-ee7cabfa-410f-40a9-b665-516981ff408e tempest-AttachVolumeTestJSON-1128520514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:07:53 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-ee7cabfa-410f-40a9-b665-516981ff408e tempest-AttachVolumeTestJSON-1128520514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:07:53 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-ee7cabfa-410f-40a9-b665-516981ff408e tempest-AttachVolumeTestJSON-1128520514 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:07:53 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-ee7cabfa-410f-40a9-b665-516981ff408e tempest-AttachVolumeTestJSON-1128520514 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:07:53 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ee7cabfa-410f-40a9-b665-516981ff408e tempest-AttachVolumeTestJSON-1128520514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3823828e-2446-4877-a013-d112e548aa21 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:07:53 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-d623a225-649c-491e-9a2e-2ecd42546282 tempest-VolumesGetTest-2039441195 None] Acquiring lock "cinder-f32fe138-ac6a-419b-a1f6-3d9ed59af621-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:07:53 devstack sudo[93551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3823828e-2446-4877-a013-d112e548aa21 1073741824 Nov 02 10:07:53 devstack sudo[93551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:07:53 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-d623a225-649c-491e-9a2e-2ecd42546282 tempest-VolumesGetTest-2039441195 None] Lock "cinder-f32fe138-ac6a-419b-a1f6-3d9ed59af621-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:07:53 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-d623a225-649c-491e-9a2e-2ecd42546282 tempest-VolumesGetTest-2039441195 None] Acquiring lock "cinder-quobyte-f32fe138-ac6a-419b-a1f6-3d9ed59af621" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:07:53 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-d623a225-649c-491e-9a2e-2ecd42546282 tempest-VolumesGetTest-2039441195 None] Lock "cinder-quobyte-f32fe138-ac6a-419b-a1f6-3d9ed59af621" acquired by "delete_volume" :: waited 0.029s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:07:53 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[14c16b47-ce2c-4e05-89d4-b78ef944d54c]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:07:53 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-d623a225-649c-491e-9a2e-2ecd42546282 tempest-VolumesGetTest-2039441195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-f32fe138-ac6a-419b-a1f6-3d9ed59af621 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:07:53 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-d9414e16-db72-4c03-a363-2bb70cbe7ea0 tempest-GroupsV314Test-1415887311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:07:53 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-d9414e16-db72-4c03-a363-2bb70cbe7ea0 tempest-GroupsV314Test-1415887311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:07:53 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-d9414e16-db72-4c03-a363-2bb70cbe7ea0 tempest-GroupsV314Test-1415887311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:07:53 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-d9414e16-db72-4c03-a363-2bb70cbe7ea0 tempest-GroupsV314Test-1415887311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:07:53 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-d9414e16-db72-4c03-a363-2bb70cbe7ea0 tempest-GroupsV314Test-1415887311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:07:53 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-d9414e16-db72-4c03-a363-2bb70cbe7ea0 tempest-GroupsV314Test-1415887311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:07:53 devstack sudo[93554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:07:53 devstack sudo[93554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:07:53 devstack sudo[93553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-f32fe138-ac6a-419b-a1f6-3d9ed59af621 Nov 02 10:07:53 devstack sudo[93553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:07:53 devstack sudo[93554]: pam_unix(sudo:session): session closed for user root Nov 02 10:07:53 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-d9414e16-db72-4c03-a363-2bb70cbe7ea0 tempest-GroupsV314Test-1415887311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.269s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:07:53 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-d9414e16-db72-4c03-a363-2bb70cbe7ea0 tempest-GroupsV314Test-1415887311 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:07:53 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-d9414e16-db72-4c03-a363-2bb70cbe7ea0 tempest-GroupsV314Test-1415887311 None] Delete group completed successfully. Nov 02 10:07:53 devstack sudo[93551]: pam_unix(sudo:session): session closed for user root Nov 02 10:07:53 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ee7cabfa-410f-40a9-b665-516981ff408e tempest-AttachVolumeTestJSON-1128520514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3823828e-2446-4877-a013-d112e548aa21 1073741824" returned: 0 in 0.505s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:07:53 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ee7cabfa-410f-40a9-b665-516981ff408e tempest-AttachVolumeTestJSON-1128520514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3823828e-2446-4877-a013-d112e548aa21 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:07:53 devstack sudo[93564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3823828e-2446-4877-a013-d112e548aa21 Nov 02 10:07:53 devstack sudo[93564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:07:53 devstack sudo[93553]: pam_unix(sudo:session): session closed for user root Nov 02 10:07:53 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-d623a225-649c-491e-9a2e-2ecd42546282 tempest-VolumesGetTest-2039441195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-f32fe138-ac6a-419b-a1f6-3d9ed59af621" returned: 0 in 0.444s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:07:53 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-d623a225-649c-491e-9a2e-2ecd42546282 tempest-VolumesGetTest-2039441195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-f32fe138-ac6a-419b-a1f6-3d9ed59af621 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:07:53 devstack sudo[93566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-f32fe138-ac6a-419b-a1f6-3d9ed59af621 Nov 02 10:07:53 devstack sudo[93566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:07:54 devstack sudo[93564]: pam_unix(sudo:session): session closed for user root Nov 02 10:07:54 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ee7cabfa-410f-40a9-b665-516981ff408e tempest-AttachVolumeTestJSON-1128520514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3823828e-2446-4877-a013-d112e548aa21" returned: 0 in 0.248s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:07:54 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-ee7cabfa-410f-40a9-b665-516981ff408e tempest-AttachVolumeTestJSON-1128520514 None] <== create_volume: return (813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:07:54 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-ee7cabfa-410f-40a9-b665-516981ff408e tempest-AttachVolumeTestJSON-1128520514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.816s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:07:54 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-ee7cabfa-410f-40a9-b665-516981ff408e tempest-AttachVolumeTestJSON-1128520514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44f7ce38-fd24-4e49-8ebb-580a606b0963) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3823828e-2446-4877-a013-d112e548aa21', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:07:54 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-ee7cabfa-410f-40a9-b665-516981ff408e tempest-AttachVolumeTestJSON-1128520514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e635bb9-154e-4c76-a363-f9f7811e0543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:07:54 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-ee7cabfa-410f-40a9-b665-516981ff408e tempest-AttachVolumeTestJSON-1128520514 None] Volume volume-3823828e-2446-4877-a013-d112e548aa21 (3823828e-2446-4877-a013-d112e548aa21): created successfully Nov 02 10:07:54 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-ee7cabfa-410f-40a9-b665-516981ff408e tempest-AttachVolumeTestJSON-1128520514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e635bb9-154e-4c76-a363-f9f7811e0543) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:07:54 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-ee7cabfa-410f-40a9-b665-516981ff408e tempest-AttachVolumeTestJSON-1128520514 None] Flow 'volume_create_manager' (5baff516-2daa-4705-9d62-0c896179c600) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:07:54 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-ee7cabfa-410f-40a9-b665-516981ff408e tempest-AttachVolumeTestJSON-1128520514 None] Created volume successfully. Nov 02 10:07:54 devstack sudo[93566]: pam_unix(sudo:session): session closed for user root Nov 02 10:07:54 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-d623a225-649c-491e-9a2e-2ecd42546282 tempest-VolumesGetTest-2039441195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-f32fe138-ac6a-419b-a1f6-3d9ed59af621" returned: 0 in 0.287s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:07:54 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-d623a225-649c-491e-9a2e-2ecd42546282 tempest-VolumesGetTest-2039441195 None] Lock "cinder-quobyte-f32fe138-ac6a-419b-a1f6-3d9ed59af621" released by "delete_volume" :: held 0.782s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:07:54 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-d623a225-649c-491e-9a2e-2ecd42546282 tempest-VolumesGetTest-2039441195 None] Created reservations ['28f7bf04-883a-4cc8-acd7-5741b5134203', '029615ab-b538-4dea-8a2d-21af7b0a54ba', 'ad87f961-6ec1-4937-b678-429d8c1516b6', 'e443897f-1437-4507-aed2-c2b416f28a5e'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:07:54 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-d623a225-649c-491e-9a2e-2ecd42546282 tempest-VolumesGetTest-2039441195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:07:54 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-d623a225-649c-491e-9a2e-2ecd42546282 tempest-VolumesGetTest-2039441195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:07:54 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-d623a225-649c-491e-9a2e-2ecd42546282 tempest-VolumesGetTest-2039441195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:07:54 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-d623a225-649c-491e-9a2e-2ecd42546282 tempest-VolumesGetTest-2039441195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:07:54 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-d623a225-649c-491e-9a2e-2ecd42546282 tempest-VolumesGetTest-2039441195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:07:54 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-d623a225-649c-491e-9a2e-2ecd42546282 tempest-VolumesGetTest-2039441195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:07:54 devstack sudo[93570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:07:54 devstack sudo[93570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:07:54 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-790662e1-59a7-494c-94fe-91646dceb789 tempest-VolumesGetTest-2039441195 None] Acquiring lock "cinder-bb6c9f35-4ba1-4110-a0d6-27a18a6c8bd3-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:07:54 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-790662e1-59a7-494c-94fe-91646dceb789 tempest-VolumesGetTest-2039441195 None] Lock "cinder-bb6c9f35-4ba1-4110-a0d6-27a18a6c8bd3-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:07:54 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-790662e1-59a7-494c-94fe-91646dceb789 tempest-VolumesGetTest-2039441195 None] Acquiring lock "cinder-quobyte-bb6c9f35-4ba1-4110-a0d6-27a18a6c8bd3" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:07:54 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-790662e1-59a7-494c-94fe-91646dceb789 tempest-VolumesGetTest-2039441195 None] Lock "cinder-quobyte-bb6c9f35-4ba1-4110-a0d6-27a18a6c8bd3" acquired by "delete_volume" :: waited 0.031s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:07:54 devstack sudo[93570]: pam_unix(sudo:session): session closed for user root Nov 02 10:07:54 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-d623a225-649c-491e-9a2e-2ecd42546282 tempest-VolumesGetTest-2039441195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.298s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:07:54 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-d623a225-649c-491e-9a2e-2ecd42546282 tempest-VolumesGetTest-2039441195 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:07:54 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-d623a225-649c-491e-9a2e-2ecd42546282 tempest-VolumesGetTest-2039441195 None] Deleted volume successfully. Nov 02 10:07:54 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e0334b8-2711-45af-956c-833acc655efa]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:07:54 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-790662e1-59a7-494c-94fe-91646dceb789 tempest-VolumesGetTest-2039441195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-bb6c9f35-4ba1-4110-a0d6-27a18a6c8bd3 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:07:54 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-d623a225-649c-491e-9a2e-2ecd42546282 tempest-VolumesGetTest-2039441195 None] Lock "cinder-f32fe138-ac6a-419b-a1f6-3d9ed59af621-delete_volume" released by "delete_volume" :: held 1.331s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:07:54 devstack sudo[93573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-bb6c9f35-4ba1-4110-a0d6-27a18a6c8bd3 Nov 02 10:07:54 devstack sudo[93573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:07:55 devstack sudo[93573]: pam_unix(sudo:session): session closed for user root Nov 02 10:07:55 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-790662e1-59a7-494c-94fe-91646dceb789 tempest-VolumesGetTest-2039441195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-bb6c9f35-4ba1-4110-a0d6-27a18a6c8bd3" returned: 0 in 0.443s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:07:55 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-790662e1-59a7-494c-94fe-91646dceb789 tempest-VolumesGetTest-2039441195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-bb6c9f35-4ba1-4110-a0d6-27a18a6c8bd3 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:07:55 devstack sudo[93579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-bb6c9f35-4ba1-4110-a0d6-27a18a6c8bd3 Nov 02 10:07:55 devstack sudo[93579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:07:55 devstack sudo[93579]: pam_unix(sudo:session): session closed for user root Nov 02 10:07:55 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-790662e1-59a7-494c-94fe-91646dceb789 tempest-VolumesGetTest-2039441195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-bb6c9f35-4ba1-4110-a0d6-27a18a6c8bd3" returned: 0 in 0.287s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:07:55 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-790662e1-59a7-494c-94fe-91646dceb789 tempest-VolumesGetTest-2039441195 None] Lock "cinder-quobyte-bb6c9f35-4ba1-4110-a0d6-27a18a6c8bd3" released by "delete_volume" :: held 0.791s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:07:55 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-790662e1-59a7-494c-94fe-91646dceb789 tempest-VolumesGetTest-2039441195 None] Created reservations ['31d5b815-7bb7-4d8c-adac-b8f44bfac131', 'fd3cba68-fae4-42f7-a26b-45f5571cda17', '7cc4b466-dd84-4d4e-a261-18abb94b7b24', '136042bd-c7d7-459e-b3f3-e5fc1fedf7aa'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:07:55 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-790662e1-59a7-494c-94fe-91646dceb789 tempest-VolumesGetTest-2039441195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:07:55 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-790662e1-59a7-494c-94fe-91646dceb789 tempest-VolumesGetTest-2039441195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:07:55 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-790662e1-59a7-494c-94fe-91646dceb789 tempest-VolumesGetTest-2039441195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:07:55 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-790662e1-59a7-494c-94fe-91646dceb789 tempest-VolumesGetTest-2039441195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:07:55 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-790662e1-59a7-494c-94fe-91646dceb789 tempest-VolumesGetTest-2039441195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:07:55 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-790662e1-59a7-494c-94fe-91646dceb789 tempest-VolumesGetTest-2039441195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:07:55 devstack sudo[93586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:07:55 devstack sudo[93586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:07:56 devstack sudo[93586]: pam_unix(sudo:session): session closed for user root Nov 02 10:07:56 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-790662e1-59a7-494c-94fe-91646dceb789 tempest-VolumesGetTest-2039441195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.570s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:07:56 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-790662e1-59a7-494c-94fe-91646dceb789 tempest-VolumesGetTest-2039441195 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:07:56 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-790662e1-59a7-494c-94fe-91646dceb789 tempest-VolumesGetTest-2039441195 None] Deleted volume successfully. Nov 02 10:07:56 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-790662e1-59a7-494c-94fe-91646dceb789 tempest-VolumesGetTest-2039441195 None] Lock "cinder-bb6c9f35-4ba1-4110-a0d6-27a18a6c8bd3-delete_volume" released by "delete_volume" :: held 1.674s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:07:56 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [req-419dc17a-dd3c-46df-8044-0d0ce579ffbe req-7accb7ae-c0b4-4eeb-a3a5-8454b7d3a95e tempest-AttachVolumeTestJSON-1128520514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:07:56 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [req-419dc17a-dd3c-46df-8044-0d0ce579ffbe req-7accb7ae-c0b4-4eeb-a3a5-8454b7d3a95e tempest-AttachVolumeTestJSON-1128520514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:07:56 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [req-419dc17a-dd3c-46df-8044-0d0ce579ffbe req-7accb7ae-c0b4-4eeb-a3a5-8454b7d3a95e tempest-AttachVolumeTestJSON-1128520514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:07:56 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [req-419dc17a-dd3c-46df-8044-0d0ce579ffbe req-7accb7ae-c0b4-4eeb-a3a5-8454b7d3a95e tempest-AttachVolumeTestJSON-1128520514 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67', 'name': 'volume-3823828e-2446-4877-a013-d112e548aa21', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7edfd31f-c648-46fb-bd85-7aa559fb2630', 'enforce_multipath': True} {{(pid=86890) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:07:56 devstack cinder-volume[86890]: INFO cinder.volume.manager [req-419dc17a-dd3c-46df-8044-0d0ce579ffbe req-7accb7ae-c0b4-4eeb-a3a5-8454b7d3a95e tempest-AttachVolumeTestJSON-1128520514 None] attachment_update completed successfully. Nov 02 10:07:56 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d980c29-73e9-411d-89b3-19d9c97f8e6c tempest-VolumesGetTest-2039441195 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:07:56 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-0d980c29-73e9-411d-89b3-19d9c97f8e6c tempest-VolumesGetTest-2039441195 None] Flow 'volume_create_manager' (0761b796-e6ad-4447-ab34-eebd78758541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:07:56 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-0d980c29-73e9-411d-89b3-19d9c97f8e6c tempest-VolumesGetTest-2039441195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (248dadb7-4032-4ad7-8392-2e345fd5eab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:07:56 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-0d980c29-73e9-411d-89b3-19d9c97f8e6c tempest-VolumesGetTest-2039441195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (248dadb7-4032-4ad7-8392-2e345fd5eab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:07:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-928509941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=661a7605-aa11-4ddf-8421-3c96a10e55d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9434cdefc464db38da17b8304add28b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:07:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:07:57Z,use_quota=True,user_id='48ed03cccb05426d978c6648244b5e52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:07:56 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-0d980c29-73e9-411d-89b3-19d9c97f8e6c tempest-VolumesGetTest-2039441195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cd49f63-1e96-45a1-9ba8-fc75624d85ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:07:56 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-0d980c29-73e9-411d-89b3-19d9c97f8e6c tempest-VolumesGetTest-2039441195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cd49f63-1e96-45a1-9ba8-fc75624d85ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:07:56 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-0d980c29-73e9-411d-89b3-19d9c97f8e6c tempest-VolumesGetTest-2039441195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba737e42-525e-4c55-b201-1c66813947eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:07:56 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-0d980c29-73e9-411d-89b3-19d9c97f8e6c tempest-VolumesGetTest-2039441195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba737e42-525e-4c55-b201-1c66813947eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '661a7605-aa11-4ddf-8421-3c96a10e55d9', 'volume_name': 'volume-661a7605-aa11-4ddf-8421-3c96a10e55d9', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:07:56 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-0d980c29-73e9-411d-89b3-19d9c97f8e6c tempest-VolumesGetTest-2039441195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c425a00f-8277-4693-8b7b-95df37a7aad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:07:56 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-0d980c29-73e9-411d-89b3-19d9c97f8e6c tempest-VolumesGetTest-2039441195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c425a00f-8277-4693-8b7b-95df37a7aad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:07:56 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-0d980c29-73e9-411d-89b3-19d9c97f8e6c tempest-VolumesGetTest-2039441195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1fefa1b-0046-4236-9343-3c137f5d34cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:07:56 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-0d980c29-73e9-411d-89b3-19d9c97f8e6c tempest-VolumesGetTest-2039441195 None] Volume 661a7605-aa11-4ddf-8421-3c96a10e55d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-661a7605-aa11-4ddf-8421-3c96a10e55d9', 'volume_size': 1} Nov 02 10:07:56 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-0d980c29-73e9-411d-89b3-19d9c97f8e6c tempest-VolumesGetTest-2039441195 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:07:56 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-0d980c29-73e9-411d-89b3-19d9c97f8e6c tempest-VolumesGetTest-2039441195 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:07:56 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-0d980c29-73e9-411d-89b3-19d9c97f8e6c tempest-VolumesGetTest-2039441195 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:07:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-928509941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=661a7605-aa11-4ddf-8421-3c96a10e55d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9434cdefc464db38da17b8304add28b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:07:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:07:57Z,use_quota=True,user_id='48ed03cccb05426d978c6648244b5e52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:07:56 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-0d980c29-73e9-411d-89b3-19d9c97f8e6c tempest-VolumesGetTest-2039441195 None] Creating volume 661a7605-aa11-4ddf-8421-3c96a10e55d9 {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:07:56 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-0d980c29-73e9-411d-89b3-19d9c97f8e6c tempest-VolumesGetTest-2039441195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:07:56 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-0d980c29-73e9-411d-89b3-19d9c97f8e6c tempest-VolumesGetTest-2039441195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:07:56 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-0d980c29-73e9-411d-89b3-19d9c97f8e6c tempest-VolumesGetTest-2039441195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:07:56 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-0d980c29-73e9-411d-89b3-19d9c97f8e6c tempest-VolumesGetTest-2039441195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:07:56 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-0d980c29-73e9-411d-89b3-19d9c97f8e6c tempest-VolumesGetTest-2039441195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:07:56 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-0d980c29-73e9-411d-89b3-19d9c97f8e6c tempest-VolumesGetTest-2039441195 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:07:56 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-0d980c29-73e9-411d-89b3-19d9c97f8e6c tempest-VolumesGetTest-2039441195 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:07:56 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-0d980c29-73e9-411d-89b3-19d9c97f8e6c tempest-VolumesGetTest-2039441195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-661a7605-aa11-4ddf-8421-3c96a10e55d9 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:07:56 devstack sudo[93600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-661a7605-aa11-4ddf-8421-3c96a10e55d9 1073741824 Nov 02 10:07:56 devstack sudo[93600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:07:57 devstack sudo[93600]: pam_unix(sudo:session): session closed for user root Nov 02 10:07:57 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-0d980c29-73e9-411d-89b3-19d9c97f8e6c tempest-VolumesGetTest-2039441195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-661a7605-aa11-4ddf-8421-3c96a10e55d9 1073741824" returned: 0 in 0.778s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:07:57 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-0d980c29-73e9-411d-89b3-19d9c97f8e6c tempest-VolumesGetTest-2039441195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-661a7605-aa11-4ddf-8421-3c96a10e55d9 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:07:57 devstack sudo[93606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-661a7605-aa11-4ddf-8421-3c96a10e55d9 Nov 02 10:07:57 devstack sudo[93606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:07:57 devstack sudo[93606]: pam_unix(sudo:session): session closed for user root Nov 02 10:07:57 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-0d980c29-73e9-411d-89b3-19d9c97f8e6c tempest-VolumesGetTest-2039441195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-661a7605-aa11-4ddf-8421-3c96a10e55d9" returned: 0 in 0.329s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:07:57 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-0d980c29-73e9-411d-89b3-19d9c97f8e6c tempest-VolumesGetTest-2039441195 None] <== create_volume: return (1169ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:07:57 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-0d980c29-73e9-411d-89b3-19d9c97f8e6c tempest-VolumesGetTest-2039441195 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.175s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:07:58 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-0d980c29-73e9-411d-89b3-19d9c97f8e6c tempest-VolumesGetTest-2039441195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1fefa1b-0046-4236-9343-3c137f5d34cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-661a7605-aa11-4ddf-8421-3c96a10e55d9', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:07:58 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-0d980c29-73e9-411d-89b3-19d9c97f8e6c tempest-VolumesGetTest-2039441195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21639554-5a1d-47c1-bcc9-a40dbfe0e3b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:07:58 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-0d980c29-73e9-411d-89b3-19d9c97f8e6c tempest-VolumesGetTest-2039441195 None] Volume volume-661a7605-aa11-4ddf-8421-3c96a10e55d9 (661a7605-aa11-4ddf-8421-3c96a10e55d9): created successfully Nov 02 10:07:58 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-0d980c29-73e9-411d-89b3-19d9c97f8e6c tempest-VolumesGetTest-2039441195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21639554-5a1d-47c1-bcc9-a40dbfe0e3b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:07:58 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-0d980c29-73e9-411d-89b3-19d9c97f8e6c tempest-VolumesGetTest-2039441195 None] Flow 'volume_create_manager' (0761b796-e6ad-4447-ab34-eebd78758541) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:07:58 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-0d980c29-73e9-411d-89b3-19d9c97f8e6c tempest-VolumesGetTest-2039441195 None] Created volume successfully. Nov 02 10:07:59 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-13c0abc1-93cc-4038-8cad-4611367d498a tempest-VolumesGetTest-2039441195 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:07:59 devstack cinder-volume[86890]: INFO cinder.volume.manager [req-8e621a1f-7c5d-4383-991a-b1844c24a4e8 req-7cfd6fe5-8e8c-4132-ad8e-65e985739fc3 tempest-AttachVolumeTestJSON-1128520514 None] Terminate volume connection completed successfully. Nov 02 10:07:59 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [req-8e621a1f-7c5d-4383-991a-b1844c24a4e8 req-7cfd6fe5-8e8c-4132-ad8e-65e985739fc3 tempest-AttachVolumeTestJSON-1128520514 None] Deleting attachment e0213659-fb18-4915-8eff-c58dc0dc0510. {{(pid=86890) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:07:59 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-13c0abc1-93cc-4038-8cad-4611367d498a tempest-VolumesGetTest-2039441195 None] Flow 'volume_create_manager' (5a2f4741-2e86-4bb7-82f8-e1417f1cbb47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:07:59 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-13c0abc1-93cc-4038-8cad-4611367d498a tempest-VolumesGetTest-2039441195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37c4ac38-ccf0-4ac8-b08f-f77597b6f808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:07:59 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-13c0abc1-93cc-4038-8cad-4611367d498a tempest-VolumesGetTest-2039441195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37c4ac38-ccf0-4ac8-b08f-f77597b6f808) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:07:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-607607185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85e1b7b5-b708-410c-a7f7-2606b0dd0846,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e9434cdefc464db38da17b8304add28b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:07:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=661a7605-aa11-4ddf-8421-3c96a10e55d9,status='creating',terminated_at=None,updated_at=2026-11-02T09:07:59Z,use_quota=True,user_id='48ed03cccb05426d978c6648244b5e52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:07:59 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-13c0abc1-93cc-4038-8cad-4611367d498a tempest-VolumesGetTest-2039441195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc678af1-1c0a-41e5-9238-95563e9569bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:07:59 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-13c0abc1-93cc-4038-8cad-4611367d498a tempest-VolumesGetTest-2039441195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc678af1-1c0a-41e5-9238-95563e9569bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:07:59 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-13c0abc1-93cc-4038-8cad-4611367d498a tempest-VolumesGetTest-2039441195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67a7ecc2-0cb5-4371-9c8e-9e7615bcf8d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:07:59 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-13c0abc1-93cc-4038-8cad-4611367d498a tempest-VolumesGetTest-2039441195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67a7ecc2-0cb5-4371-9c8e-9e7615bcf8d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '85e1b7b5-b708-410c-a7f7-2606b0dd0846', 'volume_name': 'volume-85e1b7b5-b708-410c-a7f7-2606b0dd0846', 'volume_size': 1, 'source_volid': '661a7605-aa11-4ddf-8421-3c96a10e55d9', 'source_volstatus': 'available'}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:07:59 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-13c0abc1-93cc-4038-8cad-4611367d498a tempest-VolumesGetTest-2039441195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2be5e1f-697b-4c02-933d-02e312cd2bf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:07:59 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-13c0abc1-93cc-4038-8cad-4611367d498a tempest-VolumesGetTest-2039441195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2be5e1f-697b-4c02-933d-02e312cd2bf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:07:59 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-13c0abc1-93cc-4038-8cad-4611367d498a tempest-VolumesGetTest-2039441195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (571c311b-0e2c-4528-863c-32f6f758dc75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:07:59 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-13c0abc1-93cc-4038-8cad-4611367d498a tempest-VolumesGetTest-2039441195 None] Volume 85e1b7b5-b708-410c-a7f7-2606b0dd0846: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-85e1b7b5-b708-410c-a7f7-2606b0dd0846', 'volume_size': 1, 'source_volid': '661a7605-aa11-4ddf-8421-3c96a10e55d9', 'source_volstatus': 'available'} Nov 02 10:07:59 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-13c0abc1-93cc-4038-8cad-4611367d498a tempest-VolumesGetTest-2039441195 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:07:59 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-13c0abc1-93cc-4038-8cad-4611367d498a tempest-VolumesGetTest-2039441195 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:07:59 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-13c0abc1-93cc-4038-8cad-4611367d498a tempest-VolumesGetTest-2039441195 None] Cloning volume 661a7605-aa11-4ddf-8421-3c96a10e55d9 to volume 85e1b7b5-b708-410c-a7f7-2606b0dd0846 Nov 02 10:07:59 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-13c0abc1-93cc-4038-8cad-4611367d498a tempest-VolumesGetTest-2039441195 None] Creating offline snapshot dafa74d2-3f6e-4398-8946-7fbf5f392a89 of volume 661a7605-aa11-4ddf-8421-3c96a10e55d9 {{(pid=86890) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:07:59 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d72724d-36b7-485c-8e17-09afe158f508]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:07:59 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-13c0abc1-93cc-4038-8cad-4611367d498a tempest-VolumesGetTest-2039441195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-661a7605-aa11-4ddf-8421-3c96a10e55d9 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:07:59 devstack sudo[93624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-661a7605-aa11-4ddf-8421-3c96a10e55d9 Nov 02 10:07:59 devstack sudo[93624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:00 devstack sudo[93624]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:00 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-13c0abc1-93cc-4038-8cad-4611367d498a tempest-VolumesGetTest-2039441195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-661a7605-aa11-4ddf-8421-3c96a10e55d9" returned: 0 in 0.415s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:00 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-13c0abc1-93cc-4038-8cad-4611367d498a tempest-VolumesGetTest-2039441195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-661a7605-aa11-4ddf-8421-3c96a10e55d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-661a7605-aa11-4ddf-8421-3c96a10e55d9.dafa74d2-3f6e-4398-8946-7fbf5f392a89 1G {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:00 devstack sudo[93629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-661a7605-aa11-4ddf-8421-3c96a10e55d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-661a7605-aa11-4ddf-8421-3c96a10e55d9.dafa74d2-3f6e-4398-8946-7fbf5f392a89 1G Nov 02 10:08:00 devstack sudo[93629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:00 devstack sudo[93629]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:00 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-13c0abc1-93cc-4038-8cad-4611367d498a tempest-VolumesGetTest-2039441195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-661a7605-aa11-4ddf-8421-3c96a10e55d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-661a7605-aa11-4ddf-8421-3c96a10e55d9.dafa74d2-3f6e-4398-8946-7fbf5f392a89 1G" returned: 0 in 0.554s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:00 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-13c0abc1-93cc-4038-8cad-4611367d498a tempest-VolumesGetTest-2039441195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-661a7605-aa11-4ddf-8421-3c96a10e55d9 -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-661a7605-aa11-4ddf-8421-3c96a10e55d9.dafa74d2-3f6e-4398-8946-7fbf5f392a89 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:00 devstack sudo[93636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-661a7605-aa11-4ddf-8421-3c96a10e55d9 -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-661a7605-aa11-4ddf-8421-3c96a10e55d9.dafa74d2-3f6e-4398-8946-7fbf5f392a89 Nov 02 10:08:00 devstack sudo[93636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:00 devstack cinder-volume[86890]: INFO cinder.volume.manager [req-73399de5-cd59-48fd-bbae-9db43af8dac2 req-c8d4fe0d-e9c4-4e47-a239-b0dff93757f9 tempest-AttachVolumeTestJSON-1128520514 None] Terminate volume connection completed successfully. Nov 02 10:08:00 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [req-73399de5-cd59-48fd-bbae-9db43af8dac2 req-c8d4fe0d-e9c4-4e47-a239-b0dff93757f9 tempest-AttachVolumeTestJSON-1128520514 None] Deleting attachment 7edfd31f-c648-46fb-bd85-7aa559fb2630. {{(pid=86890) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:08:01 devstack sudo[93636]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:01 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-13c0abc1-93cc-4038-8cad-4611367d498a tempest-VolumesGetTest-2039441195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-661a7605-aa11-4ddf-8421-3c96a10e55d9 -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-661a7605-aa11-4ddf-8421-3c96a10e55d9.dafa74d2-3f6e-4398-8946-7fbf5f392a89" returned: 0 in 0.381s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:01 devstack cinder-volume[86890]: WARNING cinder.volume.drivers.remotefs [None req-13c0abc1-93cc-4038-8cad-4611367d498a tempest-VolumesGetTest-2039441195 None] /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-661a7605-aa11-4ddf-8421-3c96a10e55d9.dafa74d2-3f6e-4398-8946-7fbf5f392a89 is being set with open permissions: ugo+rw Nov 02 10:08:01 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-13c0abc1-93cc-4038-8cad-4611367d498a tempest-VolumesGetTest-2039441195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-661a7605-aa11-4ddf-8421-3c96a10e55d9.dafa74d2-3f6e-4398-8946-7fbf5f392a89 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:01 devstack sudo[93643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-661a7605-aa11-4ddf-8421-3c96a10e55d9.dafa74d2-3f6e-4398-8946-7fbf5f392a89 Nov 02 10:08:01 devstack sudo[93643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:01 devstack sudo[93643]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:01 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-13c0abc1-93cc-4038-8cad-4611367d498a tempest-VolumesGetTest-2039441195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-661a7605-aa11-4ddf-8421-3c96a10e55d9.dafa74d2-3f6e-4398-8946-7fbf5f392a89" returned: 0 in 0.254s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:01 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-13c0abc1-93cc-4038-8cad-4611367d498a tempest-VolumesGetTest-2039441195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-661a7605-aa11-4ddf-8421-3c96a10e55d9.info {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:01 devstack sudo[93646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-661a7605-aa11-4ddf-8421-3c96a10e55d9.info Nov 02 10:08:01 devstack sudo[93646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:01 devstack sudo[93646]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:01 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-13c0abc1-93cc-4038-8cad-4611367d498a tempest-VolumesGetTest-2039441195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-661a7605-aa11-4ddf-8421-3c96a10e55d9.info" returned: 0 in 0.328s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:01 devstack cinder-volume[86890]: WARNING cinder.volume.drivers.remotefs [None req-13c0abc1-93cc-4038-8cad-4611367d498a tempest-VolumesGetTest-2039441195 None] /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-661a7605-aa11-4ddf-8421-3c96a10e55d9.info is being set with open permissions: ugo+rw Nov 02 10:08:01 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-13c0abc1-93cc-4038-8cad-4611367d498a tempest-VolumesGetTest-2039441195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-661a7605-aa11-4ddf-8421-3c96a10e55d9.info {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:01 devstack sudo[93649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-661a7605-aa11-4ddf-8421-3c96a10e55d9.info Nov 02 10:08:01 devstack sudo[93649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:02 devstack sudo[93649]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:02 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-13c0abc1-93cc-4038-8cad-4611367d498a tempest-VolumesGetTest-2039441195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-661a7605-aa11-4ddf-8421-3c96a10e55d9.info" returned: 0 in 0.329s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:02 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-13c0abc1-93cc-4038-8cad-4611367d498a tempest-VolumesGetTest-2039441195 None] Acquiring lock "cinder-quobyte-85e1b7b5-b708-410c-a7f7-2606b0dd0846" by "_copy_volume_from_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:08:02 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-13c0abc1-93cc-4038-8cad-4611367d498a tempest-VolumesGetTest-2039441195 None] Lock "cinder-quobyte-85e1b7b5-b708-410c-a7f7-2606b0dd0846" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:08:02 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-13c0abc1-93cc-4038-8cad-4611367d498a tempest-VolumesGetTest-2039441195 None] snapshot: dafa74d2-3f6e-4398-8946-7fbf5f392a89, volume: 85e1b7b5-b708-410c-a7f7-2606b0dd0846, {{(pid=86890) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 10:08:02 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-13c0abc1-93cc-4038-8cad-4611367d498a tempest-VolumesGetTest-2039441195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:08:02 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-13c0abc1-93cc-4038-8cad-4611367d498a tempest-VolumesGetTest-2039441195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:08:02 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-13c0abc1-93cc-4038-8cad-4611367d498a tempest-VolumesGetTest-2039441195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:08:02 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-13c0abc1-93cc-4038-8cad-4611367d498a tempest-VolumesGetTest-2039441195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:08:02 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-13c0abc1-93cc-4038-8cad-4611367d498a tempest-VolumesGetTest-2039441195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:08:02 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c0d38cc-379c-4f46-9772-4008629c6bc8]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:08:02 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-13c0abc1-93cc-4038-8cad-4611367d498a tempest-VolumesGetTest-2039441195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-661a7605-aa11-4ddf-8421-3c96a10e55d9.dafa74d2-3f6e-4398-8946-7fbf5f392a89 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:02 devstack sudo[93653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-661a7605-aa11-4ddf-8421-3c96a10e55d9.dafa74d2-3f6e-4398-8946-7fbf5f392a89 Nov 02 10:08:02 devstack sudo[93653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:02 devstack sudo[93653]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:02 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-13c0abc1-93cc-4038-8cad-4611367d498a tempest-VolumesGetTest-2039441195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-661a7605-aa11-4ddf-8421-3c96a10e55d9.dafa74d2-3f6e-4398-8946-7fbf5f392a89" returned: 0 in 0.719s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:02 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-13c0abc1-93cc-4038-8cad-4611367d498a tempest-VolumesGetTest-2039441195 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-661a7605-aa11-4ddf-8421-3c96a10e55d9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86890) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:08:02 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[b75787c6-68a4-4f50-921b-f227fd6566a5]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:08:02 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-13c0abc1-93cc-4038-8cad-4611367d498a tempest-VolumesGetTest-2039441195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-661a7605-aa11-4ddf-8421-3c96a10e55d9 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:03 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fb9d4a3-8686-44b5-974c-832c1903cc92 tempest-SnapshotsActionsTest-1742624275 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:08:03 devstack sudo[93679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-661a7605-aa11-4ddf-8421-3c96a10e55d9 Nov 02 10:08:03 devstack sudo[93679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:03 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-5fb9d4a3-8686-44b5-974c-832c1903cc92 tempest-SnapshotsActionsTest-1742624275 None] Flow 'volume_create_manager' (89be53ba-be96-4599-bb40-6133ce11fd0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:08:03 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-5fb9d4a3-8686-44b5-974c-832c1903cc92 tempest-SnapshotsActionsTest-1742624275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42c1990c-e071-4939-93c1-45c7c285c96e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:08:03 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-5fb9d4a3-8686-44b5-974c-832c1903cc92 tempest-SnapshotsActionsTest-1742624275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42c1990c-e071-4939-93c1-45c7c285c96e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:08:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-2036411375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dcd8769-0716-4a69-901e-6040bf232294,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1ba8ff74a624855a7f6be07354e20bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:08:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:08:03Z,use_quota=True,user_id='904611488b1342a7aae4ecd79c0071f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:08:03 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-5fb9d4a3-8686-44b5-974c-832c1903cc92 tempest-SnapshotsActionsTest-1742624275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97fa318c-6bf3-4989-8d1b-0d26883929ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:08:03 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-5fb9d4a3-8686-44b5-974c-832c1903cc92 tempest-SnapshotsActionsTest-1742624275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97fa318c-6bf3-4989-8d1b-0d26883929ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:08:03 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-5fb9d4a3-8686-44b5-974c-832c1903cc92 tempest-SnapshotsActionsTest-1742624275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (129906b5-3416-44f8-ad27-d88ad90171f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:08:03 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-5fb9d4a3-8686-44b5-974c-832c1903cc92 tempest-SnapshotsActionsTest-1742624275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (129906b5-3416-44f8-ad27-d88ad90171f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3dcd8769-0716-4a69-901e-6040bf232294', 'volume_name': 'volume-3dcd8769-0716-4a69-901e-6040bf232294', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:08:03 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-5fb9d4a3-8686-44b5-974c-832c1903cc92 tempest-SnapshotsActionsTest-1742624275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2acf2ff6-9612-4258-ac23-9044cb2ada58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:08:03 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-5fb9d4a3-8686-44b5-974c-832c1903cc92 tempest-SnapshotsActionsTest-1742624275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2acf2ff6-9612-4258-ac23-9044cb2ada58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:08:03 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-5fb9d4a3-8686-44b5-974c-832c1903cc92 tempest-SnapshotsActionsTest-1742624275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9e01da1-6c64-4877-a114-1aef39edece6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:08:03 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-5fb9d4a3-8686-44b5-974c-832c1903cc92 tempest-SnapshotsActionsTest-1742624275 None] Volume 3dcd8769-0716-4a69-901e-6040bf232294: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3dcd8769-0716-4a69-901e-6040bf232294', 'volume_size': 1} Nov 02 10:08:03 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-5fb9d4a3-8686-44b5-974c-832c1903cc92 tempest-SnapshotsActionsTest-1742624275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:08:03 devstack sudo[93679]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:03 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-13c0abc1-93cc-4038-8cad-4611367d498a tempest-VolumesGetTest-2039441195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-661a7605-aa11-4ddf-8421-3c96a10e55d9" returned: 0 in 0.658s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:03 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-13c0abc1-93cc-4038-8cad-4611367d498a tempest-VolumesGetTest-2039441195 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-661a7605-aa11-4ddf-8421-3c96a10e55d9 {{(pid=86890) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 10:08:03 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-13c0abc1-93cc-4038-8cad-4611367d498a tempest-VolumesGetTest-2039441195 None] Creating direct copy from snapshot {{(pid=86890) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 10:08:03 devstack cinder-volume[86890]: DEBUG cinder.utils [None req-13c0abc1-93cc-4038-8cad-4611367d498a tempest-VolumesGetTest-2039441195 None] Path /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-85e1b7b5-b708-410c-a7f7-2606b0dd0846 not found in is_blk_device check {{(pid=86890) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 10:08:03 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-13c0abc1-93cc-4038-8cad-4611367d498a tempest-VolumesGetTest-2039441195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-661a7605-aa11-4ddf-8421-3c96a10e55d9 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-85e1b7b5-b708-410c-a7f7-2606b0dd0846 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:03 devstack sudo[93688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-661a7605-aa11-4ddf-8421-3c96a10e55d9 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-85e1b7b5-b708-410c-a7f7-2606b0dd0846 Nov 02 10:08:03 devstack sudo[93688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:08 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-92c3b3a5-78b9-4c71-8c89-9947e80b990a tempest-AttachVolumeTestJSON-1128520514 None] Acquiring lock "cinder-3823828e-2446-4877-a013-d112e548aa21-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:08:08 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-92c3b3a5-78b9-4c71-8c89-9947e80b990a tempest-AttachVolumeTestJSON-1128520514 None] Lock "cinder-3823828e-2446-4877-a013-d112e548aa21-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:08:08 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-92c3b3a5-78b9-4c71-8c89-9947e80b990a tempest-AttachVolumeTestJSON-1128520514 None] Acquiring lock "cinder-quobyte-3823828e-2446-4877-a013-d112e548aa21" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:08:08 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-92c3b3a5-78b9-4c71-8c89-9947e80b990a tempest-AttachVolumeTestJSON-1128520514 None] Lock "cinder-quobyte-3823828e-2446-4877-a013-d112e548aa21" acquired by "delete_volume" :: waited 0.020s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:08:09 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b78f3f5-0e73-4adb-98a9-5d78af027905]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:08:09 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-92c3b3a5-78b9-4c71-8c89-9947e80b990a tempest-AttachVolumeTestJSON-1128520514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3823828e-2446-4877-a013-d112e548aa21 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:09 devstack sudo[93745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3823828e-2446-4877-a013-d112e548aa21 Nov 02 10:08:09 devstack sudo[93745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:09 devstack sudo[93745]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:09 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-92c3b3a5-78b9-4c71-8c89-9947e80b990a tempest-AttachVolumeTestJSON-1128520514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3823828e-2446-4877-a013-d112e548aa21" returned: 0 in 0.824s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:09 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-92c3b3a5-78b9-4c71-8c89-9947e80b990a tempest-AttachVolumeTestJSON-1128520514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3823828e-2446-4877-a013-d112e548aa21 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:09 devstack sudo[93750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3823828e-2446-4877-a013-d112e548aa21 Nov 02 10:08:09 devstack sudo[93750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:10 devstack sudo[93750]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:10 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-92c3b3a5-78b9-4c71-8c89-9947e80b990a tempest-AttachVolumeTestJSON-1128520514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3823828e-2446-4877-a013-d112e548aa21" returned: 0 in 0.497s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:10 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-92c3b3a5-78b9-4c71-8c89-9947e80b990a tempest-AttachVolumeTestJSON-1128520514 None] Lock "cinder-quobyte-3823828e-2446-4877-a013-d112e548aa21" released by "delete_volume" :: held 1.411s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:08:10 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-92c3b3a5-78b9-4c71-8c89-9947e80b990a tempest-AttachVolumeTestJSON-1128520514 None] Created reservations ['e017ac7c-1365-49bf-9b48-7c2370d2dc64', '6d713271-0fba-4c0b-b7ed-0b0dab3a841a', '8c6e23aa-0d22-431c-9009-2f13d03f52c9', '8d90ddd2-24c2-4e02-b20a-1389c2232524'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:08:10 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-92c3b3a5-78b9-4c71-8c89-9947e80b990a tempest-AttachVolumeTestJSON-1128520514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:08:10 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-92c3b3a5-78b9-4c71-8c89-9947e80b990a tempest-AttachVolumeTestJSON-1128520514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:08:10 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-92c3b3a5-78b9-4c71-8c89-9947e80b990a tempest-AttachVolumeTestJSON-1128520514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:08:10 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-92c3b3a5-78b9-4c71-8c89-9947e80b990a tempest-AttachVolumeTestJSON-1128520514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:08:10 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-92c3b3a5-78b9-4c71-8c89-9947e80b990a tempest-AttachVolumeTestJSON-1128520514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:08:10 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-92c3b3a5-78b9-4c71-8c89-9947e80b990a tempest-AttachVolumeTestJSON-1128520514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:10 devstack sudo[93753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:08:10 devstack sudo[93753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:11 devstack sudo[93753]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:11 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-92c3b3a5-78b9-4c71-8c89-9947e80b990a tempest-AttachVolumeTestJSON-1128520514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.542s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:11 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-92c3b3a5-78b9-4c71-8c89-9947e80b990a tempest-AttachVolumeTestJSON-1128520514 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:08:11 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-92c3b3a5-78b9-4c71-8c89-9947e80b990a tempest-AttachVolumeTestJSON-1128520514 None] Deleted volume successfully. Nov 02 10:08:11 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-92c3b3a5-78b9-4c71-8c89-9947e80b990a tempest-AttachVolumeTestJSON-1128520514 None] Lock "cinder-3823828e-2446-4877-a013-d112e548aa21-delete_volume" released by "delete_volume" :: held 2.381s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:08:11 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-13c0abc1-93cc-4038-8cad-4611367d498a tempest-VolumesGetTest-2039441195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-661a7605-aa11-4ddf-8421-3c96a10e55d9 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-85e1b7b5-b708-410c-a7f7-2606b0dd0846" returned: 0 in 7.699s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:11 devstack cinder-volume[86890]: DEBUG cinder.image.image_utils [None req-13c0abc1-93cc-4038-8cad-4611367d498a tempest-VolumesGetTest-2039441195 None] Image conversion details: src /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-661a7605-aa11-4ddf-8421-3c96a10e55d9, size 1024.00 MB, duration 7.70 sec, destination /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-85e1b7b5-b708-410c-a7f7-2606b0dd0846 {{(pid=86890) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 10:08:11 devstack cinder-volume[86890]: INFO cinder.image.image_utils [None req-13c0abc1-93cc-4038-8cad-4611367d498a tempest-VolumesGetTest-2039441195 None] Converted 1024.00 MB image at 133.00 MB/s Nov 02 10:08:11 devstack cinder-volume[86890]: WARNING cinder.volume.drivers.remotefs [None req-13c0abc1-93cc-4038-8cad-4611367d498a tempest-VolumesGetTest-2039441195 None] /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-85e1b7b5-b708-410c-a7f7-2606b0dd0846 is being set with open permissions: ugo+rw Nov 02 10:08:11 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-13c0abc1-93cc-4038-8cad-4611367d498a tempest-VolumesGetTest-2039441195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-85e1b7b5-b708-410c-a7f7-2606b0dd0846 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:11 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-71ca9e56-2757-46c4-9ef5-d5497126899c tempest-AttachVolumeTestJSON-1128520514 None] Acquiring lock "cinder-2a96beed-1a85-4a11-9bbd-5fbb61ce4af6-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:08:11 devstack sudo[93758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-85e1b7b5-b708-410c-a7f7-2606b0dd0846 Nov 02 10:08:11 devstack sudo[93758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:11 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-71ca9e56-2757-46c4-9ef5-d5497126899c tempest-AttachVolumeTestJSON-1128520514 None] Lock "cinder-2a96beed-1a85-4a11-9bbd-5fbb61ce4af6-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:08:11 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-71ca9e56-2757-46c4-9ef5-d5497126899c tempest-AttachVolumeTestJSON-1128520514 None] Acquiring lock "cinder-quobyte-2a96beed-1a85-4a11-9bbd-5fbb61ce4af6" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:08:11 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-71ca9e56-2757-46c4-9ef5-d5497126899c tempest-AttachVolumeTestJSON-1128520514 None] Lock "cinder-quobyte-2a96beed-1a85-4a11-9bbd-5fbb61ce4af6" acquired by "delete_volume" :: waited 0.014s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:08:11 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3b700fd-6585-4fe4-8e00-6de5f965d208]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:08:11 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-71ca9e56-2757-46c4-9ef5-d5497126899c tempest-AttachVolumeTestJSON-1128520514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-2a96beed-1a85-4a11-9bbd-5fbb61ce4af6 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:11 devstack sudo[93758]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:11 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-13c0abc1-93cc-4038-8cad-4611367d498a tempest-VolumesGetTest-2039441195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-85e1b7b5-b708-410c-a7f7-2606b0dd0846" returned: 0 in 0.285s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:11 devstack sudo[93760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-2a96beed-1a85-4a11-9bbd-5fbb61ce4af6 Nov 02 10:08:11 devstack sudo[93760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:11 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-13c0abc1-93cc-4038-8cad-4611367d498a tempest-VolumesGetTest-2039441195 None] Lock "cinder-quobyte-85e1b7b5-b708-410c-a7f7-2606b0dd0846" released by "_copy_volume_from_snapshot" :: held 9.487s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:08:11 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-13c0abc1-93cc-4038-8cad-4611367d498a tempest-VolumesGetTest-2039441195 None] Acquiring lock "cinder-quobyte-dafa74d2-3f6e-4398-8946-7fbf5f392a89" by "_delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:08:11 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-13c0abc1-93cc-4038-8cad-4611367d498a tempest-VolumesGetTest-2039441195 None] Lock "cinder-quobyte-dafa74d2-3f6e-4398-8946-7fbf5f392a89" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:08:11 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-13c0abc1-93cc-4038-8cad-4611367d498a tempest-VolumesGetTest-2039441195 None] Deleting offline snapshot dafa74d2-3f6e-4398-8946-7fbf5f392a89 of volume 661a7605-aa11-4ddf-8421-3c96a10e55d9 {{(pid=86890) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:08:11 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-13c0abc1-93cc-4038-8cad-4611367d498a tempest-VolumesGetTest-2039441195 None] snapshot_file for this snap is: volume-661a7605-aa11-4ddf-8421-3c96a10e55d9.dafa74d2-3f6e-4398-8946-7fbf5f392a89 {{(pid=86890) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:08:11 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[40cfcfb8-b26c-4b9a-be41-cbc2b54fb410]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:08:11 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-13c0abc1-93cc-4038-8cad-4611367d498a tempest-VolumesGetTest-2039441195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-661a7605-aa11-4ddf-8421-3c96a10e55d9.dafa74d2-3f6e-4398-8946-7fbf5f392a89 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:11 devstack sudo[93763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-661a7605-aa11-4ddf-8421-3c96a10e55d9.dafa74d2-3f6e-4398-8946-7fbf5f392a89 Nov 02 10:08:11 devstack sudo[93763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:11 devstack sudo[93760]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:11 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-71ca9e56-2757-46c4-9ef5-d5497126899c tempest-AttachVolumeTestJSON-1128520514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-2a96beed-1a85-4a11-9bbd-5fbb61ce4af6" returned: 0 in 0.482s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:11 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-71ca9e56-2757-46c4-9ef5-d5497126899c tempest-AttachVolumeTestJSON-1128520514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-2a96beed-1a85-4a11-9bbd-5fbb61ce4af6 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:11 devstack sudo[93769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-2a96beed-1a85-4a11-9bbd-5fbb61ce4af6 Nov 02 10:08:11 devstack sudo[93769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:12 devstack sudo[93769]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:12 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-71ca9e56-2757-46c4-9ef5-d5497126899c tempest-AttachVolumeTestJSON-1128520514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-2a96beed-1a85-4a11-9bbd-5fbb61ce4af6" returned: 0 in 0.295s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:12 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-71ca9e56-2757-46c4-9ef5-d5497126899c tempest-AttachVolumeTestJSON-1128520514 None] Lock "cinder-quobyte-2a96beed-1a85-4a11-9bbd-5fbb61ce4af6" released by "delete_volume" :: held 0.860s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:08:12 devstack sudo[93763]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:12 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-13c0abc1-93cc-4038-8cad-4611367d498a tempest-VolumesGetTest-2039441195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-661a7605-aa11-4ddf-8421-3c96a10e55d9.dafa74d2-3f6e-4398-8946-7fbf5f392a89" returned: 0 in 0.638s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:12 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-13c0abc1-93cc-4038-8cad-4611367d498a tempest-VolumesGetTest-2039441195 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-661a7605-aa11-4ddf-8421-3c96a10e55d9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86890) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:08:12 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ec7cbe3-8a3a-41b6-8a1a-4a83cfc64c3f]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:08:12 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-13c0abc1-93cc-4038-8cad-4611367d498a tempest-VolumesGetTest-2039441195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-661a7605-aa11-4ddf-8421-3c96a10e55d9 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:12 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-71ca9e56-2757-46c4-9ef5-d5497126899c tempest-AttachVolumeTestJSON-1128520514 None] Created reservations ['eb06bd24-608b-4518-8565-d2f665e3c195', 'c57ba804-24aa-4b21-a78b-73be7d075377', '35db1794-7d25-47e3-96fa-c9b246745335', '113bee27-ea5b-4ec5-a120-c37c2ebf1e3a'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:08:12 devstack sudo[93793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-661a7605-aa11-4ddf-8421-3c96a10e55d9 Nov 02 10:08:12 devstack sudo[93793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:12 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-71ca9e56-2757-46c4-9ef5-d5497126899c tempest-AttachVolumeTestJSON-1128520514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:08:12 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-71ca9e56-2757-46c4-9ef5-d5497126899c tempest-AttachVolumeTestJSON-1128520514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:08:12 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-71ca9e56-2757-46c4-9ef5-d5497126899c tempest-AttachVolumeTestJSON-1128520514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:08:12 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-71ca9e56-2757-46c4-9ef5-d5497126899c tempest-AttachVolumeTestJSON-1128520514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:08:12 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-71ca9e56-2757-46c4-9ef5-d5497126899c tempest-AttachVolumeTestJSON-1128520514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:08:12 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-71ca9e56-2757-46c4-9ef5-d5497126899c tempest-AttachVolumeTestJSON-1128520514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:12 devstack sudo[93800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:08:12 devstack sudo[93800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:12 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-c0183fb9-77b9-4bc6-b400-2fe240007d73 tempest-AttachVolumeTestJSON-1128520514 None] Acquiring lock "cinder-8e8cc696-07b4-4105-b5c8-1c691d34b5e4-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:08:12 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-c0183fb9-77b9-4bc6-b400-2fe240007d73 tempest-AttachVolumeTestJSON-1128520514 None] Lock "cinder-8e8cc696-07b4-4105-b5c8-1c691d34b5e4-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:08:12 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-c0183fb9-77b9-4bc6-b400-2fe240007d73 tempest-AttachVolumeTestJSON-1128520514 None] Acquiring lock "cinder-quobyte-8e8cc696-07b4-4105-b5c8-1c691d34b5e4" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:08:13 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-c0183fb9-77b9-4bc6-b400-2fe240007d73 tempest-AttachVolumeTestJSON-1128520514 None] Lock "cinder-quobyte-8e8cc696-07b4-4105-b5c8-1c691d34b5e4" acquired by "delete_volume" :: waited 0.038s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:08:13 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8745d1b-0ae5-4fb9-833b-a3fd2547b696]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:08:13 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c0183fb9-77b9-4bc6-b400-2fe240007d73 tempest-AttachVolumeTestJSON-1128520514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-8e8cc696-07b4-4105-b5c8-1c691d34b5e4 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:13 devstack sudo[93793]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:13 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-13c0abc1-93cc-4038-8cad-4611367d498a tempest-VolumesGetTest-2039441195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-661a7605-aa11-4ddf-8421-3c96a10e55d9" returned: 0 in 0.723s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:13 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-13c0abc1-93cc-4038-8cad-4611367d498a tempest-VolumesGetTest-2039441195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-661a7605-aa11-4ddf-8421-3c96a10e55d9.dafa74d2-3f6e-4398-8946-7fbf5f392a89 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:13 devstack sudo[93808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-661a7605-aa11-4ddf-8421-3c96a10e55d9.dafa74d2-3f6e-4398-8946-7fbf5f392a89 Nov 02 10:08:13 devstack sudo[93808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:13 devstack sudo[93800]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:13 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-71ca9e56-2757-46c4-9ef5-d5497126899c tempest-AttachVolumeTestJSON-1128520514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.652s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:13 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-71ca9e56-2757-46c4-9ef5-d5497126899c tempest-AttachVolumeTestJSON-1128520514 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:08:13 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-71ca9e56-2757-46c4-9ef5-d5497126899c tempest-AttachVolumeTestJSON-1128520514 None] Deleted volume successfully. Nov 02 10:08:13 devstack sudo[93807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-8e8cc696-07b4-4105-b5c8-1c691d34b5e4 Nov 02 10:08:13 devstack sudo[93807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:13 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-71ca9e56-2757-46c4-9ef5-d5497126899c tempest-AttachVolumeTestJSON-1128520514 None] Lock "cinder-2a96beed-1a85-4a11-9bbd-5fbb61ce4af6-delete_volume" released by "delete_volume" :: held 1.961s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:08:13 devstack sudo[93808]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:13 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-13c0abc1-93cc-4038-8cad-4611367d498a tempest-VolumesGetTest-2039441195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-661a7605-aa11-4ddf-8421-3c96a10e55d9.dafa74d2-3f6e-4398-8946-7fbf5f392a89" returned: 0 in 0.458s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:13 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-13c0abc1-93cc-4038-8cad-4611367d498a tempest-VolumesGetTest-2039441195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-661a7605-aa11-4ddf-8421-3c96a10e55d9.dafa74d2-3f6e-4398-8946-7fbf5f392a89 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:13 devstack sudo[93819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-661a7605-aa11-4ddf-8421-3c96a10e55d9.dafa74d2-3f6e-4398-8946-7fbf5f392a89 Nov 02 10:08:13 devstack sudo[93819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:13 devstack sudo[93807]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:13 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c0183fb9-77b9-4bc6-b400-2fe240007d73 tempest-AttachVolumeTestJSON-1128520514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-8e8cc696-07b4-4105-b5c8-1c691d34b5e4" returned: 0 in 0.588s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:13 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c0183fb9-77b9-4bc6-b400-2fe240007d73 tempest-AttachVolumeTestJSON-1128520514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-8e8cc696-07b4-4105-b5c8-1c691d34b5e4 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:13 devstack sudo[93823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-8e8cc696-07b4-4105-b5c8-1c691d34b5e4 Nov 02 10:08:13 devstack sudo[93823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:13 devstack sudo[93819]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:13 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-13c0abc1-93cc-4038-8cad-4611367d498a tempest-VolumesGetTest-2039441195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-661a7605-aa11-4ddf-8421-3c96a10e55d9.dafa74d2-3f6e-4398-8946-7fbf5f392a89" returned: 0 in 0.304s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:13 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-13c0abc1-93cc-4038-8cad-4611367d498a tempest-VolumesGetTest-2039441195 None] Lock "cinder-quobyte-dafa74d2-3f6e-4398-8946-7fbf5f392a89" released by "_delete_snapshot" :: held 2.285s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:08:13 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-13c0abc1-93cc-4038-8cad-4611367d498a tempest-VolumesGetTest-2039441195 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.286s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:08:13 devstack sudo[93823]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:13 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-5fb9d4a3-8686-44b5-974c-832c1903cc92 tempest-SnapshotsActionsTest-1742624275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.796s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:08:13 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-5fb9d4a3-8686-44b5-974c-832c1903cc92 tempest-SnapshotsActionsTest-1742624275 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:08:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-2036411375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dcd8769-0716-4a69-901e-6040bf232294,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1ba8ff74a624855a7f6be07354e20bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:08:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:08:03Z,use_quota=True,user_id='904611488b1342a7aae4ecd79c0071f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:08:13 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-5fb9d4a3-8686-44b5-974c-832c1903cc92 tempest-SnapshotsActionsTest-1742624275 None] Creating volume 3dcd8769-0716-4a69-901e-6040bf232294 {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:08:13 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-5fb9d4a3-8686-44b5-974c-832c1903cc92 tempest-SnapshotsActionsTest-1742624275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:08:13 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-5fb9d4a3-8686-44b5-974c-832c1903cc92 tempest-SnapshotsActionsTest-1742624275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:08:13 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-5fb9d4a3-8686-44b5-974c-832c1903cc92 tempest-SnapshotsActionsTest-1742624275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:08:14 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-5fb9d4a3-8686-44b5-974c-832c1903cc92 tempest-SnapshotsActionsTest-1742624275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:08:14 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-5fb9d4a3-8686-44b5-974c-832c1903cc92 tempest-SnapshotsActionsTest-1742624275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:08:14 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-5fb9d4a3-8686-44b5-974c-832c1903cc92 tempest-SnapshotsActionsTest-1742624275 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:08:14 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-5fb9d4a3-8686-44b5-974c-832c1903cc92 tempest-SnapshotsActionsTest-1742624275 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:08:14 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-5fb9d4a3-8686-44b5-974c-832c1903cc92 tempest-SnapshotsActionsTest-1742624275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:14 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c0183fb9-77b9-4bc6-b400-2fe240007d73 tempest-AttachVolumeTestJSON-1128520514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-8e8cc696-07b4-4105-b5c8-1c691d34b5e4" returned: 0 in 0.342s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:14 devstack sudo[93829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294 1073741824 Nov 02 10:08:14 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-13c0abc1-93cc-4038-8cad-4611367d498a tempest-VolumesGetTest-2039441195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (571c311b-0e2c-4528-863c-32f6f758dc75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85e1b7b5-b708-410c-a7f7-2606b0dd0846', 'volume_size': 1, 'source_volid': '661a7605-aa11-4ddf-8421-3c96a10e55d9', 'source_volstatus': 'available'}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:08:14 devstack sudo[93829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:14 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-13c0abc1-93cc-4038-8cad-4611367d498a tempest-VolumesGetTest-2039441195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30878db3-b988-4181-a2e7-e39568adfdde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:08:14 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-c0183fb9-77b9-4bc6-b400-2fe240007d73 tempest-AttachVolumeTestJSON-1128520514 None] Lock "cinder-quobyte-8e8cc696-07b4-4105-b5c8-1c691d34b5e4" released by "delete_volume" :: held 1.036s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:08:14 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-13c0abc1-93cc-4038-8cad-4611367d498a tempest-VolumesGetTest-2039441195 None] Volume volume-85e1b7b5-b708-410c-a7f7-2606b0dd0846 (85e1b7b5-b708-410c-a7f7-2606b0dd0846): created successfully Nov 02 10:08:14 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-13c0abc1-93cc-4038-8cad-4611367d498a tempest-VolumesGetTest-2039441195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30878db3-b988-4181-a2e7-e39568adfdde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:08:14 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-13c0abc1-93cc-4038-8cad-4611367d498a tempest-VolumesGetTest-2039441195 None] Flow 'volume_create_manager' (5a2f4741-2e86-4bb7-82f8-e1417f1cbb47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:08:14 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-13c0abc1-93cc-4038-8cad-4611367d498a tempest-VolumesGetTest-2039441195 None] Created volume successfully. Nov 02 10:08:14 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-c0183fb9-77b9-4bc6-b400-2fe240007d73 tempest-AttachVolumeTestJSON-1128520514 None] Created reservations ['3e3a1c85-1db6-4db7-9c48-0427a22da574', '1f2427ef-23a5-499e-a889-29c6bada62b3', 'ff654a4e-8c5d-4e08-ac20-11f844dc8afe', 'cce70a3a-e553-40ae-91dc-0711bff9473a'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:08:14 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c0183fb9-77b9-4bc6-b400-2fe240007d73 tempest-AttachVolumeTestJSON-1128520514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:08:14 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c0183fb9-77b9-4bc6-b400-2fe240007d73 tempest-AttachVolumeTestJSON-1128520514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:08:14 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c0183fb9-77b9-4bc6-b400-2fe240007d73 tempest-AttachVolumeTestJSON-1128520514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:08:14 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c0183fb9-77b9-4bc6-b400-2fe240007d73 tempest-AttachVolumeTestJSON-1128520514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:08:14 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c0183fb9-77b9-4bc6-b400-2fe240007d73 tempest-AttachVolumeTestJSON-1128520514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:08:14 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c0183fb9-77b9-4bc6-b400-2fe240007d73 tempest-AttachVolumeTestJSON-1128520514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:14 devstack sudo[93831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:08:14 devstack sudo[93831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:14 devstack cinder-volume[86890]: INFO cinder.volume.manager [req-71d26b70-bc32-4871-8902-bb133476a5e0 req-585a9b47-07cd-4fcc-afc7-6927657db2ca tempest-ServerActionsTestOtherA-634183357 None] Terminate volume connection completed successfully. Nov 02 10:08:14 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [req-71d26b70-bc32-4871-8902-bb133476a5e0 req-585a9b47-07cd-4fcc-afc7-6927657db2ca tempest-ServerActionsTestOtherA-634183357 None] Deleting attachment 0dfef2cd-821d-40e7-ac5b-b017b78f172b. {{(pid=86890) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:08:14 devstack sudo[93831]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:14 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c0183fb9-77b9-4bc6-b400-2fe240007d73 tempest-AttachVolumeTestJSON-1128520514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.334s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:14 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-c0183fb9-77b9-4bc6-b400-2fe240007d73 tempest-AttachVolumeTestJSON-1128520514 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:08:14 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-c0183fb9-77b9-4bc6-b400-2fe240007d73 tempest-AttachVolumeTestJSON-1128520514 None] Deleted volume successfully. Nov 02 10:08:14 devstack sudo[93829]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:14 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-5fb9d4a3-8686-44b5-974c-832c1903cc92 tempest-SnapshotsActionsTest-1742624275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294 1073741824" returned: 0 in 0.685s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:14 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-c0183fb9-77b9-4bc6-b400-2fe240007d73 tempest-AttachVolumeTestJSON-1128520514 None] Lock "cinder-8e8cc696-07b4-4105-b5c8-1c691d34b5e4-delete_volume" released by "delete_volume" :: held 1.832s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:08:14 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-5fb9d4a3-8686-44b5-974c-832c1903cc92 tempest-SnapshotsActionsTest-1742624275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:14 devstack cinder-volume[86890]: DEBUG cinder.coordination [req-71d26b70-bc32-4871-8902-bb133476a5e0 req-832fccbb-3b48-4ede-9fd9-3ae7488351c0 tempest-ServerActionsTestOtherA-634183357 None] Acquiring lock "cinder-6b09d6b7-2f7c-479f-8124-3b45da495257-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:08:14 devstack sudo[93838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294 Nov 02 10:08:14 devstack sudo[93838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:14 devstack cinder-volume[86890]: DEBUG cinder.coordination [req-71d26b70-bc32-4871-8902-bb133476a5e0 req-832fccbb-3b48-4ede-9fd9-3ae7488351c0 tempest-ServerActionsTestOtherA-634183357 None] Lock "cinder-6b09d6b7-2f7c-479f-8124-3b45da495257-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:08:14 devstack cinder-volume[86890]: DEBUG cinder.coordination [req-71d26b70-bc32-4871-8902-bb133476a5e0 req-832fccbb-3b48-4ede-9fd9-3ae7488351c0 tempest-ServerActionsTestOtherA-634183357 None] Acquiring lock "cinder-quobyte-6b09d6b7-2f7c-479f-8124-3b45da495257" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:08:14 devstack cinder-volume[86890]: DEBUG cinder.coordination [req-71d26b70-bc32-4871-8902-bb133476a5e0 req-832fccbb-3b48-4ede-9fd9-3ae7488351c0 tempest-ServerActionsTestOtherA-634183357 None] Lock "cinder-quobyte-6b09d6b7-2f7c-479f-8124-3b45da495257" acquired by "delete_volume" :: waited 0.019s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:08:14 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa5a25a4-7766-49c7-a80a-2baf58ba4e4f]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:08:14 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [req-71d26b70-bc32-4871-8902-bb133476a5e0 req-832fccbb-3b48-4ede-9fd9-3ae7488351c0 tempest-ServerActionsTestOtherA-634183357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-6b09d6b7-2f7c-479f-8124-3b45da495257 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:15 devstack sudo[93840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-6b09d6b7-2f7c-479f-8124-3b45da495257 Nov 02 10:08:15 devstack sudo[93840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:15 devstack sudo[93838]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:15 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-5fb9d4a3-8686-44b5-974c-832c1903cc92 tempest-SnapshotsActionsTest-1742624275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294" returned: 0 in 0.305s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:15 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-5fb9d4a3-8686-44b5-974c-832c1903cc92 tempest-SnapshotsActionsTest-1742624275 None] <== create_volume: return (1068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:08:15 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-5fb9d4a3-8686-44b5-974c-832c1903cc92 tempest-SnapshotsActionsTest-1742624275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.072s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:08:15 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-5fb9d4a3-8686-44b5-974c-832c1903cc92 tempest-SnapshotsActionsTest-1742624275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9e01da1-6c64-4877-a114-1aef39edece6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3dcd8769-0716-4a69-901e-6040bf232294', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:08:15 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-5fb9d4a3-8686-44b5-974c-832c1903cc92 tempest-SnapshotsActionsTest-1742624275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53f5b1e2-29a1-49b0-87b5-197d2bc8c4c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:08:15 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-5fb9d4a3-8686-44b5-974c-832c1903cc92 tempest-SnapshotsActionsTest-1742624275 None] Volume volume-3dcd8769-0716-4a69-901e-6040bf232294 (3dcd8769-0716-4a69-901e-6040bf232294): created successfully Nov 02 10:08:15 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-5fb9d4a3-8686-44b5-974c-832c1903cc92 tempest-SnapshotsActionsTest-1742624275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53f5b1e2-29a1-49b0-87b5-197d2bc8c4c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:08:15 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-5fb9d4a3-8686-44b5-974c-832c1903cc92 tempest-SnapshotsActionsTest-1742624275 None] Flow 'volume_create_manager' (89be53ba-be96-4599-bb40-6133ce11fd0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:08:15 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-5fb9d4a3-8686-44b5-974c-832c1903cc92 tempest-SnapshotsActionsTest-1742624275 None] Created volume successfully. Nov 02 10:08:15 devstack sudo[93840]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:15 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [req-71d26b70-bc32-4871-8902-bb133476a5e0 req-832fccbb-3b48-4ede-9fd9-3ae7488351c0 tempest-ServerActionsTestOtherA-634183357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-6b09d6b7-2f7c-479f-8124-3b45da495257" returned: 0 in 0.534s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:15 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [req-71d26b70-bc32-4871-8902-bb133476a5e0 req-832fccbb-3b48-4ede-9fd9-3ae7488351c0 tempest-ServerActionsTestOtherA-634183357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-6b09d6b7-2f7c-479f-8124-3b45da495257 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:15 devstack sudo[93852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-6b09d6b7-2f7c-479f-8124-3b45da495257 Nov 02 10:08:15 devstack sudo[93852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:15 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-dfc2defa-5f41-439d-a4a0-fe93a9eb8d59 tempest-SnapshotsActionsTest-1742624275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:08:15 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-dfc2defa-5f41-439d-a4a0-fe93a9eb8d59 tempest-SnapshotsActionsTest-1742624275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:08:15 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-dfc2defa-5f41-439d-a4a0-fe93a9eb8d59 tempest-SnapshotsActionsTest-1742624275 None] Creating offline snapshot 16a1f2b5-f260-42cc-92a0-60e8587b586b of volume 3dcd8769-0716-4a69-901e-6040bf232294 {{(pid=86890) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:08:15 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[db53d5fc-a811-4c3d-8e68-bdbf85a09df5]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:08:15 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-dfc2defa-5f41-439d-a4a0-fe93a9eb8d59 tempest-SnapshotsActionsTest-1742624275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:15 devstack sudo[93852]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:15 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [req-71d26b70-bc32-4871-8902-bb133476a5e0 req-832fccbb-3b48-4ede-9fd9-3ae7488351c0 tempest-ServerActionsTestOtherA-634183357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-6b09d6b7-2f7c-479f-8124-3b45da495257" returned: 0 in 0.385s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:15 devstack cinder-volume[86890]: DEBUG cinder.coordination [req-71d26b70-bc32-4871-8902-bb133476a5e0 req-832fccbb-3b48-4ede-9fd9-3ae7488351c0 tempest-ServerActionsTestOtherA-634183357 None] Lock "cinder-quobyte-6b09d6b7-2f7c-479f-8124-3b45da495257" released by "delete_volume" :: held 0.980s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:08:15 devstack cinder-volume[86890]: DEBUG cinder.quota [req-71d26b70-bc32-4871-8902-bb133476a5e0 req-832fccbb-3b48-4ede-9fd9-3ae7488351c0 tempest-ServerActionsTestOtherA-634183357 None] Created reservations ['b61147ea-c8eb-49bb-91ef-a499401e1ee5', 'e5776fcd-640d-4de8-970d-3e269e158a13', '75b5bfcb-6921-435e-ba55-9945f8b6178b', '4325c27f-3c9b-4cbb-aa0d-08291ec03808'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:08:15 devstack sudo[93855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294 Nov 02 10:08:15 devstack sudo[93855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:16 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [req-71d26b70-bc32-4871-8902-bb133476a5e0 req-832fccbb-3b48-4ede-9fd9-3ae7488351c0 tempest-ServerActionsTestOtherA-634183357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:08:16 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [req-71d26b70-bc32-4871-8902-bb133476a5e0 req-832fccbb-3b48-4ede-9fd9-3ae7488351c0 tempest-ServerActionsTestOtherA-634183357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:08:16 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [req-71d26b70-bc32-4871-8902-bb133476a5e0 req-832fccbb-3b48-4ede-9fd9-3ae7488351c0 tempest-ServerActionsTestOtherA-634183357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:08:16 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [req-71d26b70-bc32-4871-8902-bb133476a5e0 req-832fccbb-3b48-4ede-9fd9-3ae7488351c0 tempest-ServerActionsTestOtherA-634183357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:08:16 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [req-71d26b70-bc32-4871-8902-bb133476a5e0 req-832fccbb-3b48-4ede-9fd9-3ae7488351c0 tempest-ServerActionsTestOtherA-634183357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:08:16 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [req-71d26b70-bc32-4871-8902-bb133476a5e0 req-832fccbb-3b48-4ede-9fd9-3ae7488351c0 tempest-ServerActionsTestOtherA-634183357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:16 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-6897d12b-786b-41f7-9643-096645457c5e tempest-ServerActionsTestOtherA-634183357 None] Acquiring lock "cinder-ff9a5863-3f98-4ed2-8e0b-b6323204b916-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:08:16 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-6897d12b-786b-41f7-9643-096645457c5e tempest-ServerActionsTestOtherA-634183357 None] Lock "cinder-ff9a5863-3f98-4ed2-8e0b-b6323204b916-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:08:16 devstack sudo[93857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:08:16 devstack sudo[93857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:16 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-6897d12b-786b-41f7-9643-096645457c5e tempest-ServerActionsTestOtherA-634183357 None] Acquiring lock "cinder-quobyte-ff9a5863-3f98-4ed2-8e0b-b6323204b916" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:08:16 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-6897d12b-786b-41f7-9643-096645457c5e tempest-ServerActionsTestOtherA-634183357 None] Lock "cinder-quobyte-ff9a5863-3f98-4ed2-8e0b-b6323204b916" acquired by "delete_volume" :: waited 0.035s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:08:16 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[e25b8cbc-93bf-45b6-b9ce-34733b641283]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:08:16 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6897d12b-786b-41f7-9643-096645457c5e tempest-ServerActionsTestOtherA-634183357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ff9a5863-3f98-4ed2-8e0b-b6323204b916 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:16 devstack sudo[93855]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:16 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-dfc2defa-5f41-439d-a4a0-fe93a9eb8d59 tempest-SnapshotsActionsTest-1742624275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294" returned: 0 in 0.565s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:16 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-dfc2defa-5f41-439d-a4a0-fe93a9eb8d59 tempest-SnapshotsActionsTest-1742624275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.16a1f2b5-f260-42cc-92a0-60e8587b586b 1G {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:16 devstack sudo[93864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.16a1f2b5-f260-42cc-92a0-60e8587b586b 1G Nov 02 10:08:16 devstack sudo[93864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:16 devstack sudo[93862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ff9a5863-3f98-4ed2-8e0b-b6323204b916 Nov 02 10:08:16 devstack sudo[93862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:16 devstack sudo[93857]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:16 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [req-71d26b70-bc32-4871-8902-bb133476a5e0 req-832fccbb-3b48-4ede-9fd9-3ae7488351c0 tempest-ServerActionsTestOtherA-634183357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.514s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:16 devstack cinder-volume[86890]: DEBUG cinder.manager [req-71d26b70-bc32-4871-8902-bb133476a5e0 req-832fccbb-3b48-4ede-9fd9-3ae7488351c0 tempest-ServerActionsTestOtherA-634183357 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:08:16 devstack cinder-volume[86890]: INFO cinder.volume.manager [req-71d26b70-bc32-4871-8902-bb133476a5e0 req-832fccbb-3b48-4ede-9fd9-3ae7488351c0 tempest-ServerActionsTestOtherA-634183357 None] Deleted volume successfully. Nov 02 10:08:16 devstack cinder-volume[86890]: DEBUG cinder.coordination [req-71d26b70-bc32-4871-8902-bb133476a5e0 req-832fccbb-3b48-4ede-9fd9-3ae7488351c0 tempest-ServerActionsTestOtherA-634183357 None] Lock "cinder-6b09d6b7-2f7c-479f-8124-3b45da495257-delete_volume" released by "delete_volume" :: held 1.855s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:08:16 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2a1d965-ac24-45f5-b961-5c1896882357 tempest-VolumesGetTest-2039441195 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:08:16 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-e2a1d965-ac24-45f5-b961-5c1896882357 tempest-VolumesGetTest-2039441195 None] Flow 'volume_create_manager' (cdd0f649-6b51-4248-bc9d-866f10335159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:08:16 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-e2a1d965-ac24-45f5-b961-5c1896882357 tempest-VolumesGetTest-2039441195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b03c419f-5ac6-41be-b8eb-e80136a2d2b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:08:16 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-e2a1d965-ac24-45f5-b961-5c1896882357 tempest-VolumesGetTest-2039441195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b03c419f-5ac6-41be-b8eb-e80136a2d2b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:08:16Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1381591820',display_name='tempest-VolumesGetTest-Volume-709628206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bf115fe-0e65-49b0-a059-c9629d46dc62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9434cdefc464db38da17b8304add28b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:08:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:08:17Z,use_quota=True,user_id='48ed03cccb05426d978c6648244b5e52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:08:16 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-e2a1d965-ac24-45f5-b961-5c1896882357 tempest-VolumesGetTest-2039441195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (371ac3d3-b06e-4d01-a531-f85da308879b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:08:16 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-e2a1d965-ac24-45f5-b961-5c1896882357 tempest-VolumesGetTest-2039441195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (371ac3d3-b06e-4d01-a531-f85da308879b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:08:16 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-e2a1d965-ac24-45f5-b961-5c1896882357 tempest-VolumesGetTest-2039441195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6f43dae-0fad-4a61-a82a-5c6eccccbc0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:08:16 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-e2a1d965-ac24-45f5-b961-5c1896882357 tempest-VolumesGetTest-2039441195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6f43dae-0fad-4a61-a82a-5c6eccccbc0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4bf115fe-0e65-49b0-a059-c9629d46dc62', 'volume_name': 'volume-4bf115fe-0e65-49b0-a059-c9629d46dc62', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:08:16 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-e2a1d965-ac24-45f5-b961-5c1896882357 tempest-VolumesGetTest-2039441195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76b7cf96-6cc7-4304-a2a6-c8e27a616438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:08:16 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-e2a1d965-ac24-45f5-b961-5c1896882357 tempest-VolumesGetTest-2039441195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76b7cf96-6cc7-4304-a2a6-c8e27a616438) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:08:16 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-e2a1d965-ac24-45f5-b961-5c1896882357 tempest-VolumesGetTest-2039441195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01fa446b-9b01-40d9-98df-3eea698e2a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:08:16 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-e2a1d965-ac24-45f5-b961-5c1896882357 tempest-VolumesGetTest-2039441195 None] Volume 4bf115fe-0e65-49b0-a059-c9629d46dc62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4bf115fe-0e65-49b0-a059-c9629d46dc62', 'volume_size': 1} Nov 02 10:08:16 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-e2a1d965-ac24-45f5-b961-5c1896882357 tempest-VolumesGetTest-2039441195 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:08:16 devstack sudo[93862]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:16 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6897d12b-786b-41f7-9643-096645457c5e tempest-ServerActionsTestOtherA-634183357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ff9a5863-3f98-4ed2-8e0b-b6323204b916" returned: 0 in 0.682s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:16 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6897d12b-786b-41f7-9643-096645457c5e tempest-ServerActionsTestOtherA-634183357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ff9a5863-3f98-4ed2-8e0b-b6323204b916 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:16 devstack sudo[93877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ff9a5863-3f98-4ed2-8e0b-b6323204b916 Nov 02 10:08:16 devstack sudo[93877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:17 devstack sudo[93864]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:17 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-dfc2defa-5f41-439d-a4a0-fe93a9eb8d59 tempest-SnapshotsActionsTest-1742624275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.16a1f2b5-f260-42cc-92a0-60e8587b586b 1G" returned: 0 in 0.647s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:17 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-dfc2defa-5f41-439d-a4a0-fe93a9eb8d59 tempest-SnapshotsActionsTest-1742624275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3dcd8769-0716-4a69-901e-6040bf232294 -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.16a1f2b5-f260-42cc-92a0-60e8587b586b {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:17 devstack sudo[93879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3dcd8769-0716-4a69-901e-6040bf232294 -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.16a1f2b5-f260-42cc-92a0-60e8587b586b Nov 02 10:08:17 devstack sudo[93879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:17 devstack sudo[93877]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:17 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6897d12b-786b-41f7-9643-096645457c5e tempest-ServerActionsTestOtherA-634183357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ff9a5863-3f98-4ed2-8e0b-b6323204b916" returned: 0 in 0.287s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:17 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-6897d12b-786b-41f7-9643-096645457c5e tempest-ServerActionsTestOtherA-634183357 None] Lock "cinder-quobyte-ff9a5863-3f98-4ed2-8e0b-b6323204b916" released by "delete_volume" :: held 1.060s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:08:17 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-6897d12b-786b-41f7-9643-096645457c5e tempest-ServerActionsTestOtherA-634183357 None] Created reservations ['d947e506-7e15-44af-a461-4907f54cdc27', '145f9da6-fefb-4853-99d7-5464bf4b05f7', 'f3b80585-453f-40ae-af4e-40a4492cf880', 'fff40ef1-0377-47ee-9f7e-c95ff2cfe060'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:08:17 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-6897d12b-786b-41f7-9643-096645457c5e tempest-ServerActionsTestOtherA-634183357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:08:17 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-6897d12b-786b-41f7-9643-096645457c5e tempest-ServerActionsTestOtherA-634183357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:08:17 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-6897d12b-786b-41f7-9643-096645457c5e tempest-ServerActionsTestOtherA-634183357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:08:17 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-6897d12b-786b-41f7-9643-096645457c5e tempest-ServerActionsTestOtherA-634183357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:08:17 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-6897d12b-786b-41f7-9643-096645457c5e tempest-ServerActionsTestOtherA-634183357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:08:17 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6897d12b-786b-41f7-9643-096645457c5e tempest-ServerActionsTestOtherA-634183357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:17 devstack sudo[93885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:08:17 devstack sudo[93885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:17 devstack sudo[93879]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:17 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-dfc2defa-5f41-439d-a4a0-fe93a9eb8d59 tempest-SnapshotsActionsTest-1742624275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3dcd8769-0716-4a69-901e-6040bf232294 -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.16a1f2b5-f260-42cc-92a0-60e8587b586b" returned: 0 in 0.457s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:17 devstack cinder-volume[86890]: WARNING cinder.volume.drivers.remotefs [None req-dfc2defa-5f41-439d-a4a0-fe93a9eb8d59 tempest-SnapshotsActionsTest-1742624275 None] /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.16a1f2b5-f260-42cc-92a0-60e8587b586b is being set with open permissions: ugo+rw Nov 02 10:08:17 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-dfc2defa-5f41-439d-a4a0-fe93a9eb8d59 tempest-SnapshotsActionsTest-1742624275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.16a1f2b5-f260-42cc-92a0-60e8587b586b {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:17 devstack sudo[93887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.16a1f2b5-f260-42cc-92a0-60e8587b586b Nov 02 10:08:17 devstack sudo[93887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:17 devstack sudo[93885]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:17 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6897d12b-786b-41f7-9643-096645457c5e tempest-ServerActionsTestOtherA-634183357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.315s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:17 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-6897d12b-786b-41f7-9643-096645457c5e tempest-ServerActionsTestOtherA-634183357 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:08:17 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-6897d12b-786b-41f7-9643-096645457c5e tempest-ServerActionsTestOtherA-634183357 None] Deleted volume successfully. Nov 02 10:08:17 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-6897d12b-786b-41f7-9643-096645457c5e tempest-ServerActionsTestOtherA-634183357 None] Lock "cinder-ff9a5863-3f98-4ed2-8e0b-b6323204b916-delete_volume" released by "delete_volume" :: held 1.677s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:08:17 devstack sudo[93887]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:17 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-dfc2defa-5f41-439d-a4a0-fe93a9eb8d59 tempest-SnapshotsActionsTest-1742624275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.16a1f2b5-f260-42cc-92a0-60e8587b586b" returned: 0 in 0.332s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:17 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-dfc2defa-5f41-439d-a4a0-fe93a9eb8d59 tempest-SnapshotsActionsTest-1742624275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.info {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:17 devstack sudo[93892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.info Nov 02 10:08:17 devstack sudo[93892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:18 devstack sudo[93892]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:18 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-dfc2defa-5f41-439d-a4a0-fe93a9eb8d59 tempest-SnapshotsActionsTest-1742624275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.info" returned: 0 in 0.259s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:18 devstack cinder-volume[86890]: WARNING cinder.volume.drivers.remotefs [None req-dfc2defa-5f41-439d-a4a0-fe93a9eb8d59 tempest-SnapshotsActionsTest-1742624275 None] /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.info is being set with open permissions: ugo+rw Nov 02 10:08:18 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-dfc2defa-5f41-439d-a4a0-fe93a9eb8d59 tempest-SnapshotsActionsTest-1742624275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.info {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:18 devstack sudo[93895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.info Nov 02 10:08:18 devstack sudo[93895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:18 devstack sudo[93895]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:18 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-dfc2defa-5f41-439d-a4a0-fe93a9eb8d59 tempest-SnapshotsActionsTest-1742624275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.info" returned: 0 in 0.305s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:18 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-dfc2defa-5f41-439d-a4a0-fe93a9eb8d59 tempest-SnapshotsActionsTest-1742624275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.722s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:08:18 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-e2a1d965-ac24-45f5-b961-5c1896882357 tempest-VolumesGetTest-2039441195 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.541s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:08:18 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-e2a1d965-ac24-45f5-b961-5c1896882357 tempest-VolumesGetTest-2039441195 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:08:16Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1381591820',display_name='tempest-VolumesGetTest-Volume-709628206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bf115fe-0e65-49b0-a059-c9629d46dc62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9434cdefc464db38da17b8304add28b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:08:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:08:17Z,use_quota=True,user_id='48ed03cccb05426d978c6648244b5e52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:08:18 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-e2a1d965-ac24-45f5-b961-5c1896882357 tempest-VolumesGetTest-2039441195 None] Creating volume 4bf115fe-0e65-49b0-a059-c9629d46dc62 {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:08:18 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-e2a1d965-ac24-45f5-b961-5c1896882357 tempest-VolumesGetTest-2039441195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:08:18 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-e2a1d965-ac24-45f5-b961-5c1896882357 tempest-VolumesGetTest-2039441195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:08:18 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-e2a1d965-ac24-45f5-b961-5c1896882357 tempest-VolumesGetTest-2039441195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:08:18 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-e2a1d965-ac24-45f5-b961-5c1896882357 tempest-VolumesGetTest-2039441195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:08:18 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-e2a1d965-ac24-45f5-b961-5c1896882357 tempest-VolumesGetTest-2039441195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:08:18 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-e2a1d965-ac24-45f5-b961-5c1896882357 tempest-VolumesGetTest-2039441195 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:08:18 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-e2a1d965-ac24-45f5-b961-5c1896882357 tempest-VolumesGetTest-2039441195 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:08:18 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-e2a1d965-ac24-45f5-b961-5c1896882357 tempest-VolumesGetTest-2039441195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-4bf115fe-0e65-49b0-a059-c9629d46dc62 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:18 devstack sudo[93900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-4bf115fe-0e65-49b0-a059-c9629d46dc62 1073741824 Nov 02 10:08:18 devstack sudo[93900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:18 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-dfc2defa-5f41-439d-a4a0-fe93a9eb8d59 tempest-SnapshotsActionsTest-1742624275 None] Create snapshot completed successfully Nov 02 10:08:19 devstack sudo[93900]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:19 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-e2a1d965-ac24-45f5-b961-5c1896882357 tempest-VolumesGetTest-2039441195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-4bf115fe-0e65-49b0-a059-c9629d46dc62 1073741824" returned: 0 in 0.823s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:19 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-e2a1d965-ac24-45f5-b961-5c1896882357 tempest-VolumesGetTest-2039441195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-4bf115fe-0e65-49b0-a059-c9629d46dc62 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:19 devstack sudo[93927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-4bf115fe-0e65-49b0-a059-c9629d46dc62 Nov 02 10:08:19 devstack sudo[93927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:19 devstack sudo[93927]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:19 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-e2a1d965-ac24-45f5-b961-5c1896882357 tempest-VolumesGetTest-2039441195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-4bf115fe-0e65-49b0-a059-c9629d46dc62" returned: 0 in 0.335s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:19 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-e2a1d965-ac24-45f5-b961-5c1896882357 tempest-VolumesGetTest-2039441195 None] <== create_volume: return (1416ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:08:19 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-e2a1d965-ac24-45f5-b961-5c1896882357 tempest-VolumesGetTest-2039441195 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.420s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:08:19 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-e2a1d965-ac24-45f5-b961-5c1896882357 tempest-VolumesGetTest-2039441195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01fa446b-9b01-40d9-98df-3eea698e2a9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4bf115fe-0e65-49b0-a059-c9629d46dc62', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:08:19 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-e2a1d965-ac24-45f5-b961-5c1896882357 tempest-VolumesGetTest-2039441195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2543e5e2-84cd-45e0-a717-94ae34a1d6ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:08:19 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-e2a1d965-ac24-45f5-b961-5c1896882357 tempest-VolumesGetTest-2039441195 None] Volume volume-4bf115fe-0e65-49b0-a059-c9629d46dc62 (4bf115fe-0e65-49b0-a059-c9629d46dc62): created successfully Nov 02 10:08:19 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-e2a1d965-ac24-45f5-b961-5c1896882357 tempest-VolumesGetTest-2039441195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2543e5e2-84cd-45e0-a717-94ae34a1d6ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:08:19 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-e2a1d965-ac24-45f5-b961-5c1896882357 tempest-VolumesGetTest-2039441195 None] Flow 'volume_create_manager' (cdd0f649-6b51-4248-bc9d-866f10335159) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:08:19 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-e2a1d965-ac24-45f5-b961-5c1896882357 tempest-VolumesGetTest-2039441195 None] Created volume successfully. Nov 02 10:08:20 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-5661f528-0704-48c3-8203-e943e5187a24 tempest-SnapshotsActionsTest-1742624275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:08:20 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-5661f528-0704-48c3-8203-e943e5187a24 tempest-SnapshotsActionsTest-1742624275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:08:20 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-5661f528-0704-48c3-8203-e943e5187a24 tempest-SnapshotsActionsTest-1742624275 None] Creating offline snapshot d32cd0fd-38aa-44ed-8c6f-c82a5e64adea of volume 3dcd8769-0716-4a69-901e-6040bf232294 {{(pid=86890) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:08:20 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8d8a983-e239-4bd5-8390-1951459e86a5]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:08:20 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-5661f528-0704-48c3-8203-e943e5187a24 tempest-SnapshotsActionsTest-1742624275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.16a1f2b5-f260-42cc-92a0-60e8587b586b {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:20 devstack sudo[93930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.16a1f2b5-f260-42cc-92a0-60e8587b586b Nov 02 10:08:20 devstack sudo[93930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:20 devstack sudo[93930]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:20 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-5661f528-0704-48c3-8203-e943e5187a24 tempest-SnapshotsActionsTest-1742624275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.16a1f2b5-f260-42cc-92a0-60e8587b586b" returned: 0 in 0.584s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:20 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-5661f528-0704-48c3-8203-e943e5187a24 tempest-SnapshotsActionsTest-1742624275 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3dcd8769-0716-4a69-901e-6040bf232294(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86890) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:08:20 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-5661f528-0704-48c3-8203-e943e5187a24 tempest-SnapshotsActionsTest-1742624275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.16a1f2b5-f260-42cc-92a0-60e8587b586b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.d32cd0fd-38aa-44ed-8c6f-c82a5e64adea 1G {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:20 devstack sudo[93937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.16a1f2b5-f260-42cc-92a0-60e8587b586b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.d32cd0fd-38aa-44ed-8c6f-c82a5e64adea 1G Nov 02 10:08:20 devstack sudo[93937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:21 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-ffd21f24-3a65-49e9-8df5-729851ea9a98 tempest-VolumesGetTest-2039441195 None] Acquiring lock "cinder-4bf115fe-0e65-49b0-a059-c9629d46dc62-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:08:21 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-ffd21f24-3a65-49e9-8df5-729851ea9a98 tempest-VolumesGetTest-2039441195 None] Lock "cinder-4bf115fe-0e65-49b0-a059-c9629d46dc62-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:08:21 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-ffd21f24-3a65-49e9-8df5-729851ea9a98 tempest-VolumesGetTest-2039441195 None] Acquiring lock "cinder-quobyte-4bf115fe-0e65-49b0-a059-c9629d46dc62" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:08:21 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-ffd21f24-3a65-49e9-8df5-729851ea9a98 tempest-VolumesGetTest-2039441195 None] Lock "cinder-quobyte-4bf115fe-0e65-49b0-a059-c9629d46dc62" acquired by "delete_volume" :: waited 0.028s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:08:21 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c8eb7c9-8909-46e9-a2f1-cc660c96ccda]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:08:21 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ffd21f24-3a65-49e9-8df5-729851ea9a98 tempest-VolumesGetTest-2039441195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-4bf115fe-0e65-49b0-a059-c9629d46dc62 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:21 devstack sudo[93943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-4bf115fe-0e65-49b0-a059-c9629d46dc62 Nov 02 10:08:21 devstack sudo[93943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:21 devstack sudo[93937]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:21 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-5661f528-0704-48c3-8203-e943e5187a24 tempest-SnapshotsActionsTest-1742624275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.16a1f2b5-f260-42cc-92a0-60e8587b586b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.d32cd0fd-38aa-44ed-8c6f-c82a5e64adea 1G" returned: 0 in 0.739s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:21 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-5661f528-0704-48c3-8203-e943e5187a24 tempest-SnapshotsActionsTest-1742624275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3dcd8769-0716-4a69-901e-6040bf232294.16a1f2b5-f260-42cc-92a0-60e8587b586b -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.d32cd0fd-38aa-44ed-8c6f-c82a5e64adea {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:21 devstack sudo[93947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3dcd8769-0716-4a69-901e-6040bf232294.16a1f2b5-f260-42cc-92a0-60e8587b586b -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.d32cd0fd-38aa-44ed-8c6f-c82a5e64adea Nov 02 10:08:21 devstack sudo[93947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:21 devstack sudo[93943]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:21 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ffd21f24-3a65-49e9-8df5-729851ea9a98 tempest-VolumesGetTest-2039441195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-4bf115fe-0e65-49b0-a059-c9629d46dc62" returned: 0 in 0.545s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:21 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ffd21f24-3a65-49e9-8df5-729851ea9a98 tempest-VolumesGetTest-2039441195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-4bf115fe-0e65-49b0-a059-c9629d46dc62 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:21 devstack sudo[93952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-4bf115fe-0e65-49b0-a059-c9629d46dc62 Nov 02 10:08:21 devstack sudo[93952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:22 devstack sudo[93947]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:22 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-5661f528-0704-48c3-8203-e943e5187a24 tempest-SnapshotsActionsTest-1742624275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3dcd8769-0716-4a69-901e-6040bf232294.16a1f2b5-f260-42cc-92a0-60e8587b586b -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.d32cd0fd-38aa-44ed-8c6f-c82a5e64adea" returned: 0 in 0.425s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:22 devstack cinder-volume[86890]: WARNING cinder.volume.drivers.remotefs [None req-5661f528-0704-48c3-8203-e943e5187a24 tempest-SnapshotsActionsTest-1742624275 None] /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.d32cd0fd-38aa-44ed-8c6f-c82a5e64adea is being set with open permissions: ugo+rw Nov 02 10:08:22 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-5661f528-0704-48c3-8203-e943e5187a24 tempest-SnapshotsActionsTest-1742624275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.d32cd0fd-38aa-44ed-8c6f-c82a5e64adea {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:22 devstack sudo[93958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.d32cd0fd-38aa-44ed-8c6f-c82a5e64adea Nov 02 10:08:22 devstack sudo[93958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:22 devstack sudo[93952]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:22 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ffd21f24-3a65-49e9-8df5-729851ea9a98 tempest-VolumesGetTest-2039441195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-4bf115fe-0e65-49b0-a059-c9629d46dc62" returned: 0 in 0.303s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:22 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-ffd21f24-3a65-49e9-8df5-729851ea9a98 tempest-VolumesGetTest-2039441195 None] Lock "cinder-quobyte-4bf115fe-0e65-49b0-a059-c9629d46dc62" released by "delete_volume" :: held 0.913s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:08:22 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-ffd21f24-3a65-49e9-8df5-729851ea9a98 tempest-VolumesGetTest-2039441195 None] Created reservations ['9c57db7e-3fe7-490c-a91a-a77c174a97d5', '4c916acc-6782-4fee-a782-42e9d89daf7c', '16a89e45-9416-4484-ab79-e421f474177e', 'a49fed3e-edd1-4317-b484-53811f7f8f92'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:08:22 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-ffd21f24-3a65-49e9-8df5-729851ea9a98 tempest-VolumesGetTest-2039441195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:08:22 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-ffd21f24-3a65-49e9-8df5-729851ea9a98 tempest-VolumesGetTest-2039441195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:08:22 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-ffd21f24-3a65-49e9-8df5-729851ea9a98 tempest-VolumesGetTest-2039441195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:08:22 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-ffd21f24-3a65-49e9-8df5-729851ea9a98 tempest-VolumesGetTest-2039441195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:08:22 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-ffd21f24-3a65-49e9-8df5-729851ea9a98 tempest-VolumesGetTest-2039441195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:08:22 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ffd21f24-3a65-49e9-8df5-729851ea9a98 tempest-VolumesGetTest-2039441195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:22 devstack sudo[93963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:08:22 devstack sudo[93958]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:22 devstack sudo[93963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:22 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-5661f528-0704-48c3-8203-e943e5187a24 tempest-SnapshotsActionsTest-1742624275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.d32cd0fd-38aa-44ed-8c6f-c82a5e64adea" returned: 0 in 0.365s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:22 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-5661f528-0704-48c3-8203-e943e5187a24 tempest-SnapshotsActionsTest-1742624275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.255s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:08:22 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-5661f528-0704-48c3-8203-e943e5187a24 tempest-SnapshotsActionsTest-1742624275 None] Create snapshot completed successfully Nov 02 10:08:22 devstack sudo[93963]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:22 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ffd21f24-3a65-49e9-8df5-729851ea9a98 tempest-VolumesGetTest-2039441195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.270s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:22 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-ffd21f24-3a65-49e9-8df5-729851ea9a98 tempest-VolumesGetTest-2039441195 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:08:22 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-ffd21f24-3a65-49e9-8df5-729851ea9a98 tempest-VolumesGetTest-2039441195 None] Deleted volume successfully. Nov 02 10:08:22 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-ffd21f24-3a65-49e9-8df5-729851ea9a98 tempest-VolumesGetTest-2039441195 None] Lock "cinder-4bf115fe-0e65-49b0-a059-c9629d46dc62-delete_volume" released by "delete_volume" :: held 1.572s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:08:23 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-52f3a387-31b3-49e9-8ea8-1356b8ef84a4 tempest-VolumesGetTest-2039441195 None] Acquiring lock "cinder-85e1b7b5-b708-410c-a7f7-2606b0dd0846-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:08:23 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-52f3a387-31b3-49e9-8ea8-1356b8ef84a4 tempest-VolumesGetTest-2039441195 None] Lock "cinder-85e1b7b5-b708-410c-a7f7-2606b0dd0846-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:08:23 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-52f3a387-31b3-49e9-8ea8-1356b8ef84a4 tempest-VolumesGetTest-2039441195 None] Acquiring lock "cinder-quobyte-85e1b7b5-b708-410c-a7f7-2606b0dd0846" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:08:23 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-6e6f73bd-70d1-4d03-98e9-a3b008461f12 tempest-SnapshotsActionsTest-707838012 None] Acquiring lock "cinder-d32cd0fd-38aa-44ed-8c6f-c82a5e64adea-delete_snapshot" by "delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:08:23 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-52f3a387-31b3-49e9-8ea8-1356b8ef84a4 tempest-VolumesGetTest-2039441195 None] Lock "cinder-quobyte-85e1b7b5-b708-410c-a7f7-2606b0dd0846" acquired by "delete_volume" :: waited 0.042s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:08:23 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-6e6f73bd-70d1-4d03-98e9-a3b008461f12 tempest-SnapshotsActionsTest-707838012 None] Lock "cinder-d32cd0fd-38aa-44ed-8c6f-c82a5e64adea-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:08:23 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-6e6f73bd-70d1-4d03-98e9-a3b008461f12 tempest-SnapshotsActionsTest-707838012 None] Acquiring lock "cinder-quobyte-3dcd8769-0716-4a69-901e-6040bf232294" by "delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:08:23 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f02b3e7-1690-4e4a-8e5e-6fd0f9549100]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:08:23 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-52f3a387-31b3-49e9-8ea8-1356b8ef84a4 tempest-VolumesGetTest-2039441195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-85e1b7b5-b708-410c-a7f7-2606b0dd0846 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:23 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-6e6f73bd-70d1-4d03-98e9-a3b008461f12 tempest-SnapshotsActionsTest-707838012 None] Lock "cinder-quobyte-3dcd8769-0716-4a69-901e-6040bf232294" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:08:23 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-6e6f73bd-70d1-4d03-98e9-a3b008461f12 tempest-SnapshotsActionsTest-707838012 None] Acquiring lock "cinder-quobyte-d32cd0fd-38aa-44ed-8c6f-c82a5e64adea" by "_delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:08:23 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-6e6f73bd-70d1-4d03-98e9-a3b008461f12 tempest-SnapshotsActionsTest-707838012 None] Lock "cinder-quobyte-d32cd0fd-38aa-44ed-8c6f-c82a5e64adea" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:08:23 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-6e6f73bd-70d1-4d03-98e9-a3b008461f12 tempest-SnapshotsActionsTest-707838012 None] Deleting offline snapshot d32cd0fd-38aa-44ed-8c6f-c82a5e64adea of volume 3dcd8769-0716-4a69-901e-6040bf232294 {{(pid=86890) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:08:23 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-6e6f73bd-70d1-4d03-98e9-a3b008461f12 tempest-SnapshotsActionsTest-707838012 None] snapshot_file for this snap is: volume-3dcd8769-0716-4a69-901e-6040bf232294.d32cd0fd-38aa-44ed-8c6f-c82a5e64adea {{(pid=86890) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:08:23 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[3477669d-39c4-4392-99a4-4d2f5dd88e3e]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:08:23 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6e6f73bd-70d1-4d03-98e9-a3b008461f12 tempest-SnapshotsActionsTest-707838012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.d32cd0fd-38aa-44ed-8c6f-c82a5e64adea {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:23 devstack sudo[93967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-85e1b7b5-b708-410c-a7f7-2606b0dd0846 Nov 02 10:08:23 devstack sudo[93967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:23 devstack sudo[93968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.d32cd0fd-38aa-44ed-8c6f-c82a5e64adea Nov 02 10:08:23 devstack sudo[93968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:24 devstack sudo[93967]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:24 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-52f3a387-31b3-49e9-8ea8-1356b8ef84a4 tempest-VolumesGetTest-2039441195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-85e1b7b5-b708-410c-a7f7-2606b0dd0846" returned: 0 in 0.492s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:24 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-52f3a387-31b3-49e9-8ea8-1356b8ef84a4 tempest-VolumesGetTest-2039441195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-85e1b7b5-b708-410c-a7f7-2606b0dd0846 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:24 devstack sudo[93975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-85e1b7b5-b708-410c-a7f7-2606b0dd0846 Nov 02 10:08:24 devstack sudo[93975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:24 devstack sudo[93968]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:24 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6e6f73bd-70d1-4d03-98e9-a3b008461f12 tempest-SnapshotsActionsTest-707838012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.d32cd0fd-38aa-44ed-8c6f-c82a5e64adea" returned: 0 in 0.541s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:24 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-6e6f73bd-70d1-4d03-98e9-a3b008461f12 tempest-SnapshotsActionsTest-707838012 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3dcd8769-0716-4a69-901e-6040bf232294(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86890) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:08:24 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f2065a6-585b-4ccd-b2ca-0a589675d14f]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:08:24 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6e6f73bd-70d1-4d03-98e9-a3b008461f12 tempest-SnapshotsActionsTest-707838012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.16a1f2b5-f260-42cc-92a0-60e8587b586b {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:24 devstack sudo[93980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.16a1f2b5-f260-42cc-92a0-60e8587b586b Nov 02 10:08:24 devstack sudo[93980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:24 devstack sudo[93975]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:24 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-52f3a387-31b3-49e9-8ea8-1356b8ef84a4 tempest-VolumesGetTest-2039441195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-85e1b7b5-b708-410c-a7f7-2606b0dd0846" returned: 0 in 0.386s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:24 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-52f3a387-31b3-49e9-8ea8-1356b8ef84a4 tempest-VolumesGetTest-2039441195 None] Lock "cinder-quobyte-85e1b7b5-b708-410c-a7f7-2606b0dd0846" released by "delete_volume" :: held 0.954s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:08:24 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-52f3a387-31b3-49e9-8ea8-1356b8ef84a4 tempest-VolumesGetTest-2039441195 None] Created reservations ['f3d33204-be12-44c2-a7d7-f7889cbfd25c', 'ff758b40-899b-4bac-ae93-33784f10a8b5', '1aaf3f71-44be-43d8-bfee-606528b4a255', '190033b0-2a15-46ae-a4cc-7865c39d21a0'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:08:24 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-52f3a387-31b3-49e9-8ea8-1356b8ef84a4 tempest-VolumesGetTest-2039441195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:08:24 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-52f3a387-31b3-49e9-8ea8-1356b8ef84a4 tempest-VolumesGetTest-2039441195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:08:24 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-52f3a387-31b3-49e9-8ea8-1356b8ef84a4 tempest-VolumesGetTest-2039441195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:08:24 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-52f3a387-31b3-49e9-8ea8-1356b8ef84a4 tempest-VolumesGetTest-2039441195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:08:24 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-52f3a387-31b3-49e9-8ea8-1356b8ef84a4 tempest-VolumesGetTest-2039441195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:08:24 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-52f3a387-31b3-49e9-8ea8-1356b8ef84a4 tempest-VolumesGetTest-2039441195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:24 devstack sudo[93983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:08:24 devstack sudo[93983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:25 devstack sudo[93980]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:25 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6e6f73bd-70d1-4d03-98e9-a3b008461f12 tempest-SnapshotsActionsTest-707838012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.16a1f2b5-f260-42cc-92a0-60e8587b586b" returned: 0 in 0.696s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:25 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-6e6f73bd-70d1-4d03-98e9-a3b008461f12 tempest-SnapshotsActionsTest-707838012 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3dcd8769-0716-4a69-901e-6040bf232294(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86890) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:08:25 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6e6f73bd-70d1-4d03-98e9-a3b008461f12 tempest-SnapshotsActionsTest-707838012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.d32cd0fd-38aa-44ed-8c6f-c82a5e64adea {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:25 devstack sudo[93988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.d32cd0fd-38aa-44ed-8c6f-c82a5e64adea Nov 02 10:08:25 devstack sudo[93988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:25 devstack sudo[93983]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:25 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-52f3a387-31b3-49e9-8ea8-1356b8ef84a4 tempest-VolumesGetTest-2039441195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.377s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:25 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-52f3a387-31b3-49e9-8ea8-1356b8ef84a4 tempest-VolumesGetTest-2039441195 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:08:25 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-52f3a387-31b3-49e9-8ea8-1356b8ef84a4 tempest-VolumesGetTest-2039441195 None] Deleted volume successfully. Nov 02 10:08:25 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-52f3a387-31b3-49e9-8ea8-1356b8ef84a4 tempest-VolumesGetTest-2039441195 None] Lock "cinder-85e1b7b5-b708-410c-a7f7-2606b0dd0846-delete_volume" released by "delete_volume" :: held 1.822s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:08:25 devstack sudo[93988]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:25 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6e6f73bd-70d1-4d03-98e9-a3b008461f12 tempest-SnapshotsActionsTest-707838012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.d32cd0fd-38aa-44ed-8c6f-c82a5e64adea" returned: 0 in 0.504s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:25 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6e6f73bd-70d1-4d03-98e9-a3b008461f12 tempest-SnapshotsActionsTest-707838012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.d32cd0fd-38aa-44ed-8c6f-c82a5e64adea {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:25 devstack sudo[93994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.d32cd0fd-38aa-44ed-8c6f-c82a5e64adea Nov 02 10:08:25 devstack sudo[93994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:25 devstack sudo[93994]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:25 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-d4e22f7e-97ae-449b-954a-5cd837a9b296 tempest-VolumesGetTest-2039441195 None] Acquiring lock "cinder-661a7605-aa11-4ddf-8421-3c96a10e55d9-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:08:25 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6e6f73bd-70d1-4d03-98e9-a3b008461f12 tempest-SnapshotsActionsTest-707838012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.d32cd0fd-38aa-44ed-8c6f-c82a5e64adea" returned: 0 in 0.409s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:26 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-d4e22f7e-97ae-449b-954a-5cd837a9b296 tempest-VolumesGetTest-2039441195 None] Lock "cinder-661a7605-aa11-4ddf-8421-3c96a10e55d9-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:08:26 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-6e6f73bd-70d1-4d03-98e9-a3b008461f12 tempest-SnapshotsActionsTest-707838012 None] Lock "cinder-quobyte-d32cd0fd-38aa-44ed-8c6f-c82a5e64adea" released by "_delete_snapshot" :: held 2.343s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:08:26 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-6e6f73bd-70d1-4d03-98e9-a3b008461f12 tempest-SnapshotsActionsTest-707838012 None] Lock "cinder-quobyte-3dcd8769-0716-4a69-901e-6040bf232294" released by "delete_snapshot" :: held 2.390s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:08:26 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-d4e22f7e-97ae-449b-954a-5cd837a9b296 tempest-VolumesGetTest-2039441195 None] Acquiring lock "cinder-quobyte-661a7605-aa11-4ddf-8421-3c96a10e55d9" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:08:26 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-d4e22f7e-97ae-449b-954a-5cd837a9b296 tempest-VolumesGetTest-2039441195 None] Lock "cinder-quobyte-661a7605-aa11-4ddf-8421-3c96a10e55d9" acquired by "delete_volume" :: waited 0.023s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:08:26 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9302c37-7572-4e15-b94b-44ee6104f4c8]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:08:26 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-d4e22f7e-97ae-449b-954a-5cd837a9b296 tempest-VolumesGetTest-2039441195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-661a7605-aa11-4ddf-8421-3c96a10e55d9 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:26 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-6e6f73bd-70d1-4d03-98e9-a3b008461f12 tempest-SnapshotsActionsTest-707838012 None] Created reservations ['6a441d2f-0657-4a05-9c13-b381c844685f', '7314a3be-e37d-4ea3-ba44-dbe8622228cd', 'c04d6a66-1045-4ae9-bae0-4594de6f3206', '70b58bdf-4e99-4df5-b50c-15c7b9ac2556'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:08:26 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-6e6f73bd-70d1-4d03-98e9-a3b008461f12 tempest-SnapshotsActionsTest-707838012 None] Delete snapshot completed successfully. Nov 02 10:08:26 devstack sudo[93998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-661a7605-aa11-4ddf-8421-3c96a10e55d9 Nov 02 10:08:26 devstack sudo[93998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:26 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-6e6f73bd-70d1-4d03-98e9-a3b008461f12 tempest-SnapshotsActionsTest-707838012 None] Lock "cinder-d32cd0fd-38aa-44ed-8c6f-c82a5e64adea-delete_snapshot" released by "delete_snapshot" :: held 2.758s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:08:26 devstack sudo[93998]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:26 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-d4e22f7e-97ae-449b-954a-5cd837a9b296 tempest-VolumesGetTest-2039441195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-661a7605-aa11-4ddf-8421-3c96a10e55d9" returned: 0 in 0.496s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:26 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-d4e22f7e-97ae-449b-954a-5cd837a9b296 tempest-VolumesGetTest-2039441195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-661a7605-aa11-4ddf-8421-3c96a10e55d9 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:26 devstack sudo[94003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-661a7605-aa11-4ddf-8421-3c96a10e55d9 Nov 02 10:08:26 devstack sudo[94003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:27 devstack sudo[94003]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:27 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-d4e22f7e-97ae-449b-954a-5cd837a9b296 tempest-VolumesGetTest-2039441195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-661a7605-aa11-4ddf-8421-3c96a10e55d9" returned: 0 in 0.444s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:27 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-d4e22f7e-97ae-449b-954a-5cd837a9b296 tempest-VolumesGetTest-2039441195 None] Lock "cinder-quobyte-661a7605-aa11-4ddf-8421-3c96a10e55d9" released by "delete_volume" :: held 1.068s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:08:27 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-d4e22f7e-97ae-449b-954a-5cd837a9b296 tempest-VolumesGetTest-2039441195 None] Created reservations ['2b0cd719-afc4-4f58-be59-0dbbf7032bef', '5e43eaac-cabf-44a9-96e0-52ab3159369d', '8c6bc27a-1e85-4d3d-ac58-20008eab7d31', 'c7ec688d-c4ca-4c65-a2eb-7cc5d928b045'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:08:27 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-8f4c3956-f558-4fa5-b7b2-1f861baa9614 tempest-SnapshotsActionsTest-1742624275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:08:27 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-8f4c3956-f558-4fa5-b7b2-1f861baa9614 tempest-SnapshotsActionsTest-1742624275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:08:27 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-8f4c3956-f558-4fa5-b7b2-1f861baa9614 tempest-SnapshotsActionsTest-1742624275 None] Creating offline snapshot 29eaf477-94db-4760-a4f4-4623b62b26ab of volume 3dcd8769-0716-4a69-901e-6040bf232294 {{(pid=86890) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:08:27 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-d4e22f7e-97ae-449b-954a-5cd837a9b296 tempest-VolumesGetTest-2039441195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:08:27 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-d4e22f7e-97ae-449b-954a-5cd837a9b296 tempest-VolumesGetTest-2039441195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:08:27 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-d4e22f7e-97ae-449b-954a-5cd837a9b296 tempest-VolumesGetTest-2039441195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:08:27 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-d4e22f7e-97ae-449b-954a-5cd837a9b296 tempest-VolumesGetTest-2039441195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:08:27 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-d4e22f7e-97ae-449b-954a-5cd837a9b296 tempest-VolumesGetTest-2039441195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:08:27 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-d4e22f7e-97ae-449b-954a-5cd837a9b296 tempest-VolumesGetTest-2039441195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:27 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8e9dee4-5e1d-4f81-93cb-b6c091c13702]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:08:27 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8f4c3956-f558-4fa5-b7b2-1f861baa9614 tempest-SnapshotsActionsTest-1742624275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.16a1f2b5-f260-42cc-92a0-60e8587b586b {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:27 devstack sudo[94006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:08:27 devstack sudo[94006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:27 devstack sudo[94007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.16a1f2b5-f260-42cc-92a0-60e8587b586b Nov 02 10:08:27 devstack sudo[94007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:28 devstack sudo[94006]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:28 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-d4e22f7e-97ae-449b-954a-5cd837a9b296 tempest-VolumesGetTest-2039441195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.403s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:28 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-d4e22f7e-97ae-449b-954a-5cd837a9b296 tempest-VolumesGetTest-2039441195 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:08:28 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-d4e22f7e-97ae-449b-954a-5cd837a9b296 tempest-VolumesGetTest-2039441195 None] Deleted volume successfully. Nov 02 10:08:28 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-d4e22f7e-97ae-449b-954a-5cd837a9b296 tempest-VolumesGetTest-2039441195 None] Lock "cinder-661a7605-aa11-4ddf-8421-3c96a10e55d9-delete_volume" released by "delete_volume" :: held 2.047s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:08:28 devstack sudo[94007]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:28 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8f4c3956-f558-4fa5-b7b2-1f861baa9614 tempest-SnapshotsActionsTest-1742624275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.16a1f2b5-f260-42cc-92a0-60e8587b586b" returned: 0 in 0.550s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:28 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-8f4c3956-f558-4fa5-b7b2-1f861baa9614 tempest-SnapshotsActionsTest-1742624275 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3dcd8769-0716-4a69-901e-6040bf232294(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86890) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:08:28 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8f4c3956-f558-4fa5-b7b2-1f861baa9614 tempest-SnapshotsActionsTest-1742624275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.16a1f2b5-f260-42cc-92a0-60e8587b586b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.29eaf477-94db-4760-a4f4-4623b62b26ab 1G {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:28 devstack sudo[94014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.16a1f2b5-f260-42cc-92a0-60e8587b586b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.29eaf477-94db-4760-a4f4-4623b62b26ab 1G Nov 02 10:08:28 devstack sudo[94014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:28 devstack sudo[94014]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:28 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8f4c3956-f558-4fa5-b7b2-1f861baa9614 tempest-SnapshotsActionsTest-1742624275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.16a1f2b5-f260-42cc-92a0-60e8587b586b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.29eaf477-94db-4760-a4f4-4623b62b26ab 1G" returned: 0 in 0.709s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:28 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8f4c3956-f558-4fa5-b7b2-1f861baa9614 tempest-SnapshotsActionsTest-1742624275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3dcd8769-0716-4a69-901e-6040bf232294.16a1f2b5-f260-42cc-92a0-60e8587b586b -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.29eaf477-94db-4760-a4f4-4623b62b26ab {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:28 devstack sudo[94020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3dcd8769-0716-4a69-901e-6040bf232294.16a1f2b5-f260-42cc-92a0-60e8587b586b -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.29eaf477-94db-4760-a4f4-4623b62b26ab Nov 02 10:08:28 devstack sudo[94020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:29 devstack sudo[94020]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:29 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8f4c3956-f558-4fa5-b7b2-1f861baa9614 tempest-SnapshotsActionsTest-1742624275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3dcd8769-0716-4a69-901e-6040bf232294.16a1f2b5-f260-42cc-92a0-60e8587b586b -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.29eaf477-94db-4760-a4f4-4623b62b26ab" returned: 0 in 0.443s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:29 devstack cinder-volume[86890]: WARNING cinder.volume.drivers.remotefs [None req-8f4c3956-f558-4fa5-b7b2-1f861baa9614 tempest-SnapshotsActionsTest-1742624275 None] /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.29eaf477-94db-4760-a4f4-4623b62b26ab is being set with open permissions: ugo+rw Nov 02 10:08:29 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8f4c3956-f558-4fa5-b7b2-1f861baa9614 tempest-SnapshotsActionsTest-1742624275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.29eaf477-94db-4760-a4f4-4623b62b26ab {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:29 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb3168be-9510-45f9-9ae3-cb15041b1874 tempest-VolumesGetTest-2039441195 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:08:29 devstack sudo[94026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.29eaf477-94db-4760-a4f4-4623b62b26ab Nov 02 10:08:29 devstack sudo[94026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:29 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-eb3168be-9510-45f9-9ae3-cb15041b1874 tempest-VolumesGetTest-2039441195 None] Flow 'volume_create_manager' (6d710c96-dd1c-4653-a7c5-7c37900fc1d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:08:29 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-eb3168be-9510-45f9-9ae3-cb15041b1874 tempest-VolumesGetTest-2039441195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e84b380d-bb8f-4ae7-8ff5-4580213d9710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:08:29 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-eb3168be-9510-45f9-9ae3-cb15041b1874 tempest-VolumesGetTest-2039441195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e84b380d-bb8f-4ae7-8ff5-4580213d9710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:08:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-321930101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40ac8eb2-fdc2-4db4-8695-872b1ad4a0b5,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e9434cdefc464db38da17b8304add28b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:08:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:08:29Z,use_quota=True,user_id='48ed03cccb05426d978c6648244b5e52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:08:29 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-eb3168be-9510-45f9-9ae3-cb15041b1874 tempest-VolumesGetTest-2039441195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89d5e377-ae7b-4cf1-8a98-66c5bb3b56c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:08:29 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-eb3168be-9510-45f9-9ae3-cb15041b1874 tempest-VolumesGetTest-2039441195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89d5e377-ae7b-4cf1-8a98-66c5bb3b56c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:08:29 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-eb3168be-9510-45f9-9ae3-cb15041b1874 tempest-VolumesGetTest-2039441195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad5b7d53-cba9-47b4-b76a-b8c1c4d4f73d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:08:29 devstack cinder-volume[86890]: DEBUG cinder.image.glance [None req-eb3168be-9510-45f9-9ae3-cb15041b1874 tempest-VolumesGetTest-2039441195 None] Creating Keystone auth plugin from conf {{(pid=86890) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 10:08:29 devstack sudo[94026]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:29 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8f4c3956-f558-4fa5-b7b2-1f861baa9614 tempest-SnapshotsActionsTest-1742624275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.29eaf477-94db-4760-a4f4-4623b62b26ab" returned: 0 in 0.382s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:29 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-8f4c3956-f558-4fa5-b7b2-1f861baa9614 tempest-SnapshotsActionsTest-1742624275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.383s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:08:29 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-8f4c3956-f558-4fa5-b7b2-1f861baa9614 tempest-SnapshotsActionsTest-1742624275 None] Create snapshot completed successfully Nov 02 10:08:30 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-eb3168be-9510-45f9-9ae3-cb15041b1874 tempest-VolumesGetTest-2039441195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad5b7d53-cba9-47b4-b76a-b8c1c4d4f73d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '40ac8eb2-fdc2-4db4-8695-872b1ad4a0b5', 'volume_name': 'volume-40ac8eb2-fdc2-4db4-8695-872b1ad4a0b5', 'volume_size': 1, 'image_id': '7a393fa7-4879-486c-8216-4d35448485cf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7a393fa7-4879-486c-8216-4d35448485cf', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '606cf27a36794aa3805ebe6d987aa1a4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7a393fa7-4879-486c-8216-4d35448485cf', 'created_at': datetime.datetime(2026, 11, 2, 8, 55, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 8, 55, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7a393fa7-4879-486c-8216-4d35448485cf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:08:30 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-eb3168be-9510-45f9-9ae3-cb15041b1874 tempest-VolumesGetTest-2039441195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2a50943-56a7-4d24-9f1d-e389e0502c95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:08:30 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-eb3168be-9510-45f9-9ae3-cb15041b1874 tempest-VolumesGetTest-2039441195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2a50943-56a7-4d24-9f1d-e389e0502c95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:08:30 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-eb3168be-9510-45f9-9ae3-cb15041b1874 tempest-VolumesGetTest-2039441195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb2154b1-8aa6-4f25-b2b4-c7b514690701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:08:30 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-eb3168be-9510-45f9-9ae3-cb15041b1874 tempest-VolumesGetTest-2039441195 None] Volume 40ac8eb2-fdc2-4db4-8695-872b1ad4a0b5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-40ac8eb2-fdc2-4db4-8695-872b1ad4a0b5', 'volume_size': 1, 'image_id': '7a393fa7-4879-486c-8216-4d35448485cf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7a393fa7-4879-486c-8216-4d35448485cf', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '606cf27a36794aa3805ebe6d987aa1a4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7a393fa7-4879-486c-8216-4d35448485cf', 'created_at': datetime.datetime(2026, 11, 2, 8, 55, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 8, 55, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7a393fa7-4879-486c-8216-4d35448485cf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 02 10:08:30 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb3168be-9510-45f9-9ae3-cb15041b1874 tempest-VolumesGetTest-2039441195 None] Trying to clone 40ac8eb2-fdc2-4db4-8695-872b1ad4a0b5 from image 7a393fa7-4879-486c-8216-4d35448485cf at location (None, [{'url': 'file:///opt/stack/data/glance/images/7a393fa7-4879-486c-8216-4d35448485cf', 'metadata': {}}]). {{(pid=86890) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 02 10:08:30 devstack cinder-volume[86890]: DEBUG cinder.image.image_utils [None req-eb3168be-9510-45f9-9ae3-cb15041b1874 tempest-VolumesGetTest-2039441195 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7a393fa7-4879-486c-8216-4d35448485cf_xq3w0qgkdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86890) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 02 10:08:30 devstack cinder-volume[86890]: INFO cinder.image.image_utils [None req-eb3168be-9510-45f9-9ae3-cb15041b1874 tempest-VolumesGetTest-2039441195 None] Image download 20.69 MB at 20.69 MB/s Nov 02 10:08:30 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-67b3e8c8-5f38-4e99-a4a0-de81b426dd6d tempest-SnapshotsActionsTest-707838012 None] Acquiring lock "cinder-29eaf477-94db-4760-a4f4-4623b62b26ab-delete_snapshot" by "delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:08:30 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[654505c4-8e10-4928-bffc-4129db65b2d2]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:08:30 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-eb3168be-9510-45f9-9ae3-cb15041b1874 tempest-VolumesGetTest-2039441195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7a393fa7-4879-486c-8216-4d35448485cf_xq3w0qgkdevstack@QuobyteHD {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:30 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-67b3e8c8-5f38-4e99-a4a0-de81b426dd6d tempest-SnapshotsActionsTest-707838012 None] Lock "cinder-29eaf477-94db-4760-a4f4-4623b62b26ab-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:08:30 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-67b3e8c8-5f38-4e99-a4a0-de81b426dd6d tempest-SnapshotsActionsTest-707838012 None] Acquiring lock "cinder-quobyte-3dcd8769-0716-4a69-901e-6040bf232294" by "delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:08:30 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-67b3e8c8-5f38-4e99-a4a0-de81b426dd6d tempest-SnapshotsActionsTest-707838012 None] Lock "cinder-quobyte-3dcd8769-0716-4a69-901e-6040bf232294" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:08:30 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-67b3e8c8-5f38-4e99-a4a0-de81b426dd6d tempest-SnapshotsActionsTest-707838012 None] Acquiring lock "cinder-quobyte-29eaf477-94db-4760-a4f4-4623b62b26ab" by "_delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:08:30 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-67b3e8c8-5f38-4e99-a4a0-de81b426dd6d tempest-SnapshotsActionsTest-707838012 None] Lock "cinder-quobyte-29eaf477-94db-4760-a4f4-4623b62b26ab" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:08:31 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-67b3e8c8-5f38-4e99-a4a0-de81b426dd6d tempest-SnapshotsActionsTest-707838012 None] Deleting offline snapshot 29eaf477-94db-4760-a4f4-4623b62b26ab of volume 3dcd8769-0716-4a69-901e-6040bf232294 {{(pid=86890) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:08:31 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-67b3e8c8-5f38-4e99-a4a0-de81b426dd6d tempest-SnapshotsActionsTest-707838012 None] snapshot_file for this snap is: volume-3dcd8769-0716-4a69-901e-6040bf232294.29eaf477-94db-4760-a4f4-4623b62b26ab {{(pid=86890) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:08:31 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3bf08bf-0029-427a-b0eb-e4d94cb11949]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:08:31 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-67b3e8c8-5f38-4e99-a4a0-de81b426dd6d tempest-SnapshotsActionsTest-707838012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.29eaf477-94db-4760-a4f4-4623b62b26ab {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:31 devstack sudo[94031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7a393fa7-4879-486c-8216-4d35448485cf_xq3w0qgkdevstack@QuobyteHD Nov 02 10:08:31 devstack sudo[94031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:31 devstack sudo[94032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.29eaf477-94db-4760-a4f4-4623b62b26ab Nov 02 10:08:31 devstack sudo[94032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:31 devstack sudo[94031]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:31 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-eb3168be-9510-45f9-9ae3-cb15041b1874 tempest-VolumesGetTest-2039441195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7a393fa7-4879-486c-8216-4d35448485cf_xq3w0qgkdevstack@QuobyteHD" returned: 0 in 0.517s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:31 devstack cinder-volume[86890]: DEBUG cinder.image.image_utils [None req-eb3168be-9510-45f9-9ae3-cb15041b1874 tempest-VolumesGetTest-2039441195 None] Temporary image 7a393fa7-4879-486c-8216-4d35448485cf is fetched for user 48ed03cccb05426d978c6648244b5e52. {{(pid=86890) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 02 10:08:31 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc40a65f-414b-419f-ad6a-04f5834907f8]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:08:31 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-eb3168be-9510-45f9-9ae3-cb15041b1874 tempest-VolumesGetTest-2039441195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7a393fa7-4879-486c-8216-4d35448485cf_xq3w0qgkdevstack@QuobyteHD {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:31 devstack sudo[94032]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:31 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-67b3e8c8-5f38-4e99-a4a0-de81b426dd6d tempest-SnapshotsActionsTest-707838012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.29eaf477-94db-4760-a4f4-4623b62b26ab" returned: 0 in 0.522s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:31 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-67b3e8c8-5f38-4e99-a4a0-de81b426dd6d tempest-SnapshotsActionsTest-707838012 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3dcd8769-0716-4a69-901e-6040bf232294(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86890) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:08:31 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[758477cc-b80f-4b39-a670-3c1a4cf288d3]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:08:31 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-67b3e8c8-5f38-4e99-a4a0-de81b426dd6d tempest-SnapshotsActionsTest-707838012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.16a1f2b5-f260-42cc-92a0-60e8587b586b {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:31 devstack sudo[94042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7a393fa7-4879-486c-8216-4d35448485cf_xq3w0qgkdevstack@QuobyteHD Nov 02 10:08:31 devstack sudo[94042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:31 devstack sudo[94043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.16a1f2b5-f260-42cc-92a0-60e8587b586b Nov 02 10:08:31 devstack sudo[94043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:32 devstack sudo[94042]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:32 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-eb3168be-9510-45f9-9ae3-cb15041b1874 tempest-VolumesGetTest-2039441195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7a393fa7-4879-486c-8216-4d35448485cf_xq3w0qgkdevstack@QuobyteHD" returned: 0 in 0.524s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:32 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-eb3168be-9510-45f9-9ae3-cb15041b1874 tempest-VolumesGetTest-2039441195 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:08:32 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-eb3168be-9510-45f9-9ae3-cb15041b1874 tempest-VolumesGetTest-2039441195 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:08:32 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-eb3168be-9510-45f9-9ae3-cb15041b1874 tempest-VolumesGetTest-2039441195 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:08:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-321930101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40ac8eb2-fdc2-4db4-8695-872b1ad4a0b5,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e9434cdefc464db38da17b8304add28b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:08:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:08:29Z,use_quota=True,user_id='48ed03cccb05426d978c6648244b5e52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:08:32 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-eb3168be-9510-45f9-9ae3-cb15041b1874 tempest-VolumesGetTest-2039441195 None] Creating volume 40ac8eb2-fdc2-4db4-8695-872b1ad4a0b5 {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:08:32 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-eb3168be-9510-45f9-9ae3-cb15041b1874 tempest-VolumesGetTest-2039441195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:08:32 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-eb3168be-9510-45f9-9ae3-cb15041b1874 tempest-VolumesGetTest-2039441195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:08:32 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-eb3168be-9510-45f9-9ae3-cb15041b1874 tempest-VolumesGetTest-2039441195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:08:32 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-eb3168be-9510-45f9-9ae3-cb15041b1874 tempest-VolumesGetTest-2039441195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:08:32 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-eb3168be-9510-45f9-9ae3-cb15041b1874 tempest-VolumesGetTest-2039441195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:08:32 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-eb3168be-9510-45f9-9ae3-cb15041b1874 tempest-VolumesGetTest-2039441195 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:08:32 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-eb3168be-9510-45f9-9ae3-cb15041b1874 tempest-VolumesGetTest-2039441195 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:08:32 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-eb3168be-9510-45f9-9ae3-cb15041b1874 tempest-VolumesGetTest-2039441195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-40ac8eb2-fdc2-4db4-8695-872b1ad4a0b5 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:32 devstack sudo[94049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-40ac8eb2-fdc2-4db4-8695-872b1ad4a0b5 1073741824 Nov 02 10:08:32 devstack sudo[94049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:32 devstack sudo[94043]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:32 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-67b3e8c8-5f38-4e99-a4a0-de81b426dd6d tempest-SnapshotsActionsTest-707838012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.16a1f2b5-f260-42cc-92a0-60e8587b586b" returned: 0 in 0.612s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:32 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-67b3e8c8-5f38-4e99-a4a0-de81b426dd6d tempest-SnapshotsActionsTest-707838012 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3dcd8769-0716-4a69-901e-6040bf232294(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86890) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:08:32 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-67b3e8c8-5f38-4e99-a4a0-de81b426dd6d tempest-SnapshotsActionsTest-707838012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.29eaf477-94db-4760-a4f4-4623b62b26ab {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:32 devstack sudo[94055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.29eaf477-94db-4760-a4f4-4623b62b26ab Nov 02 10:08:32 devstack sudo[94055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:32 devstack sudo[94049]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:32 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-eb3168be-9510-45f9-9ae3-cb15041b1874 tempest-VolumesGetTest-2039441195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-40ac8eb2-fdc2-4db4-8695-872b1ad4a0b5 1073741824" returned: 0 in 0.692s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:32 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-eb3168be-9510-45f9-9ae3-cb15041b1874 tempest-VolumesGetTest-2039441195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-40ac8eb2-fdc2-4db4-8695-872b1ad4a0b5 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:32 devstack sudo[94065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-40ac8eb2-fdc2-4db4-8695-872b1ad4a0b5 Nov 02 10:08:32 devstack sudo[94065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:32 devstack sudo[94055]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:32 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-67b3e8c8-5f38-4e99-a4a0-de81b426dd6d tempest-SnapshotsActionsTest-707838012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.29eaf477-94db-4760-a4f4-4623b62b26ab" returned: 0 in 0.625s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:32 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-67b3e8c8-5f38-4e99-a4a0-de81b426dd6d tempest-SnapshotsActionsTest-707838012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.29eaf477-94db-4760-a4f4-4623b62b26ab {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:32 devstack sudo[94067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.29eaf477-94db-4760-a4f4-4623b62b26ab Nov 02 10:08:32 devstack sudo[94067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:33 devstack sudo[94065]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:33 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-eb3168be-9510-45f9-9ae3-cb15041b1874 tempest-VolumesGetTest-2039441195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-40ac8eb2-fdc2-4db4-8695-872b1ad4a0b5" returned: 0 in 0.479s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:33 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-eb3168be-9510-45f9-9ae3-cb15041b1874 tempest-VolumesGetTest-2039441195 None] <== create_volume: return (1234ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:08:33 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-eb3168be-9510-45f9-9ae3-cb15041b1874 tempest-VolumesGetTest-2039441195 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.241s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:08:33 devstack cinder-volume[86890]: DEBUG cinder.volume.volume_utils [None req-eb3168be-9510-45f9-9ae3-cb15041b1874 tempest-VolumesGetTest-2039441195 None] Attempting download of 7a393fa7-4879-486c-8216-4d35448485cf ((None, [{'url': 'file:///opt/stack/data/glance/images/7a393fa7-4879-486c-8216-4d35448485cf', 'metadata': {}}])) to volume 40ac8eb2-fdc2-4db4-8695-872b1ad4a0b5. {{(pid=86890) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 02 10:08:33 devstack sudo[94067]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:33 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-67b3e8c8-5f38-4e99-a4a0-de81b426dd6d tempest-SnapshotsActionsTest-707838012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.29eaf477-94db-4760-a4f4-4623b62b26ab" returned: 0 in 0.539s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:33 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[74e46661-9d4d-43b5-99d0-55e05c54179a]: (4, 'raw') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:08:33 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-eb3168be-9510-45f9-9ae3-cb15041b1874 tempest-VolumesGetTest-2039441195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7a393fa7-4879-486c-8216-4d35448485cf_zj0snj1_ {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:33 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-67b3e8c8-5f38-4e99-a4a0-de81b426dd6d tempest-SnapshotsActionsTest-707838012 None] Lock "cinder-quobyte-29eaf477-94db-4760-a4f4-4623b62b26ab" released by "_delete_snapshot" :: held 2.503s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:08:33 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-67b3e8c8-5f38-4e99-a4a0-de81b426dd6d tempest-SnapshotsActionsTest-707838012 None] Lock "cinder-quobyte-3dcd8769-0716-4a69-901e-6040bf232294" released by "delete_snapshot" :: held 2.545s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:08:33 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-67b3e8c8-5f38-4e99-a4a0-de81b426dd6d tempest-SnapshotsActionsTest-707838012 None] Created reservations ['c5707728-b0b3-4e7d-98cd-0ba7679ef9de', '880c80d2-1be6-4402-a61b-8656cb8f028e', '48d9cb7f-fdcf-4f75-b411-7d8c311ac36a', '50a0a4e8-2a4b-4709-af12-6ea9cb79aa11'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:08:33 devstack sudo[94072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7a393fa7-4879-486c-8216-4d35448485cf_zj0snj1_ Nov 02 10:08:33 devstack sudo[94072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:33 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-67b3e8c8-5f38-4e99-a4a0-de81b426dd6d tempest-SnapshotsActionsTest-707838012 None] Delete snapshot completed successfully. Nov 02 10:08:33 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-67b3e8c8-5f38-4e99-a4a0-de81b426dd6d tempest-SnapshotsActionsTest-707838012 None] Lock "cinder-29eaf477-94db-4760-a4f4-4623b62b26ab-delete_snapshot" released by "delete_snapshot" :: held 2.780s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:08:33 devstack sudo[94072]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:33 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-eb3168be-9510-45f9-9ae3-cb15041b1874 tempest-VolumesGetTest-2039441195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7a393fa7-4879-486c-8216-4d35448485cf_zj0snj1_" returned: 0 in 0.453s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:33 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-eb3168be-9510-45f9-9ae3-cb15041b1874 tempest-VolumesGetTest-2039441195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7a393fa7-4879-486c-8216-4d35448485cf_zj0snj1_ {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:34 devstack sudo[94076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7a393fa7-4879-486c-8216-4d35448485cf_zj0snj1_ Nov 02 10:08:34 devstack sudo[94076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:34 devstack sudo[94076]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-eb3168be-9510-45f9-9ae3-cb15041b1874 tempest-VolumesGetTest-2039441195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7a393fa7-4879-486c-8216-4d35448485cf_zj0snj1_" returned: 1 in 0.459s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-eb3168be-9510-45f9-9ae3-cb15041b1874 tempest-VolumesGetTest-2039441195 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7a393fa7-4879-486c-8216-4d35448485cf_zj0snj1_' failed. Not Retrying. {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 10:08:34 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[67b1d5ff-c92e-458d-8cf8-18672378397b]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:08:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-eb3168be-9510-45f9-9ae3-cb15041b1874 tempest-VolumesGetTest-2039441195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7a393fa7-4879-486c-8216-4d35448485cf_xq3w0qgkdevstack@QuobyteHD {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-7634ddfa-4037-4fba-87c5-9ae39ec09f84 tempest-SnapshotsActionsTest-1742624275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:08:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-7634ddfa-4037-4fba-87c5-9ae39ec09f84 tempest-SnapshotsActionsTest-1742624275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:08:34 devstack sudo[94080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7a393fa7-4879-486c-8216-4d35448485cf_xq3w0qgkdevstack@QuobyteHD Nov 02 10:08:34 devstack sudo[94080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:34 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-7634ddfa-4037-4fba-87c5-9ae39ec09f84 tempest-SnapshotsActionsTest-1742624275 None] Creating offline snapshot 304a139c-8884-4d25-b9a3-0ebe3606bec1 of volume 3dcd8769-0716-4a69-901e-6040bf232294 {{(pid=86890) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:08:34 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[5512c8fb-fbfb-4ed0-b8e6-eb1222918e3c]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:08:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-7634ddfa-4037-4fba-87c5-9ae39ec09f84 tempest-SnapshotsActionsTest-1742624275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.16a1f2b5-f260-42cc-92a0-60e8587b586b {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:34 devstack cinder-volume[86890]: DEBUG oslo_service.periodic_task [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86890) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:08:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:08:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:08:34 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:08:34 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:08:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:08:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:34 devstack sudo[94083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:08:34 devstack sudo[94083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:34 devstack sudo[94082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.16a1f2b5-f260-42cc-92a0-60e8587b586b Nov 02 10:08:34 devstack sudo[94082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:35 devstack sudo[94080]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:35 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-eb3168be-9510-45f9-9ae3-cb15041b1874 tempest-VolumesGetTest-2039441195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7a393fa7-4879-486c-8216-4d35448485cf_xq3w0qgkdevstack@QuobyteHD" returned: 0 in 0.612s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:35 devstack cinder-volume[86890]: DEBUG cinder.image.image_utils [None req-eb3168be-9510-45f9-9ae3-cb15041b1874 tempest-VolumesGetTest-2039441195 None] 7a393fa7-4879-486c-8216-4d35448485cf was qcow2, converting to qcow2 {{(pid=86890) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 02 10:08:35 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-eb3168be-9510-45f9-9ae3-cb15041b1874 tempest-VolumesGetTest-2039441195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7a393fa7-4879-486c-8216-4d35448485cf_xq3w0qgkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-40ac8eb2-fdc2-4db4-8695-872b1ad4a0b5 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:35 devstack sudo[94089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7a393fa7-4879-486c-8216-4d35448485cf_xq3w0qgkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-40ac8eb2-fdc2-4db4-8695-872b1ad4a0b5 Nov 02 10:08:35 devstack sudo[94089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:35 devstack sudo[94083]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:35 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.320s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:35 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:08:35 devstack cinder-volume[86890]: DEBUG oslo_service.periodic_task [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Running periodic task VolumeManager._thread_info {{(pid=86890) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:08:35 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] thread count: 28 {{(pid=86890) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:08:35 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] thread info: [<_MainThread(MainThread, started 133913319395456)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86890) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:08:35 devstack sudo[94082]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:35 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-7634ddfa-4037-4fba-87c5-9ae39ec09f84 tempest-SnapshotsActionsTest-1742624275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.16a1f2b5-f260-42cc-92a0-60e8587b586b" returned: 0 in 0.548s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:35 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-7634ddfa-4037-4fba-87c5-9ae39ec09f84 tempest-SnapshotsActionsTest-1742624275 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3dcd8769-0716-4a69-901e-6040bf232294(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86890) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:08:35 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-7634ddfa-4037-4fba-87c5-9ae39ec09f84 tempest-SnapshotsActionsTest-1742624275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.16a1f2b5-f260-42cc-92a0-60e8587b586b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.304a139c-8884-4d25-b9a3-0ebe3606bec1 1G {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:35 devstack sudo[94096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.16a1f2b5-f260-42cc-92a0-60e8587b586b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.304a139c-8884-4d25-b9a3-0ebe3606bec1 1G Nov 02 10:08:35 devstack sudo[94096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:36 devstack sudo[94096]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:36 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-7634ddfa-4037-4fba-87c5-9ae39ec09f84 tempest-SnapshotsActionsTest-1742624275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.16a1f2b5-f260-42cc-92a0-60e8587b586b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.304a139c-8884-4d25-b9a3-0ebe3606bec1 1G" returned: 0 in 0.752s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:36 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-7634ddfa-4037-4fba-87c5-9ae39ec09f84 tempest-SnapshotsActionsTest-1742624275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3dcd8769-0716-4a69-901e-6040bf232294.16a1f2b5-f260-42cc-92a0-60e8587b586b -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.304a139c-8884-4d25-b9a3-0ebe3606bec1 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:36 devstack sudo[94110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3dcd8769-0716-4a69-901e-6040bf232294.16a1f2b5-f260-42cc-92a0-60e8587b586b -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.304a139c-8884-4d25-b9a3-0ebe3606bec1 Nov 02 10:08:36 devstack sudo[94110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:36 devstack sudo[94110]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:36 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-7634ddfa-4037-4fba-87c5-9ae39ec09f84 tempest-SnapshotsActionsTest-1742624275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3dcd8769-0716-4a69-901e-6040bf232294.16a1f2b5-f260-42cc-92a0-60e8587b586b -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.304a139c-8884-4d25-b9a3-0ebe3606bec1" returned: 0 in 0.529s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:36 devstack cinder-volume[86890]: WARNING cinder.volume.drivers.remotefs [None req-7634ddfa-4037-4fba-87c5-9ae39ec09f84 tempest-SnapshotsActionsTest-1742624275 None] /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.304a139c-8884-4d25-b9a3-0ebe3606bec1 is being set with open permissions: ugo+rw Nov 02 10:08:36 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-7634ddfa-4037-4fba-87c5-9ae39ec09f84 tempest-SnapshotsActionsTest-1742624275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.304a139c-8884-4d25-b9a3-0ebe3606bec1 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:36 devstack sudo[94115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.304a139c-8884-4d25-b9a3-0ebe3606bec1 Nov 02 10:08:36 devstack sudo[94115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:37 devstack sudo[94115]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:37 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-7634ddfa-4037-4fba-87c5-9ae39ec09f84 tempest-SnapshotsActionsTest-1742624275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.304a139c-8884-4d25-b9a3-0ebe3606bec1" returned: 0 in 0.451s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:37 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-7634ddfa-4037-4fba-87c5-9ae39ec09f84 tempest-SnapshotsActionsTest-1742624275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.503s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:08:37 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-7634ddfa-4037-4fba-87c5-9ae39ec09f84 tempest-SnapshotsActionsTest-1742624275 None] Create snapshot completed successfully Nov 02 10:08:37 devstack sudo[94089]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:37 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-eb3168be-9510-45f9-9ae3-cb15041b1874 tempest-VolumesGetTest-2039441195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7a393fa7-4879-486c-8216-4d35448485cf_xq3w0qgkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-40ac8eb2-fdc2-4db4-8695-872b1ad4a0b5" returned: 0 in 2.915s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:37 devstack cinder-volume[86890]: DEBUG cinder.image.image_utils [None req-eb3168be-9510-45f9-9ae3-cb15041b1874 tempest-VolumesGetTest-2039441195 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7a393fa7-4879-486c-8216-4d35448485cf_xq3w0qgkdevstack@QuobyteHD, size 112.00 MB, duration 2.92 sec, destination /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-40ac8eb2-fdc2-4db4-8695-872b1ad4a0b5 {{(pid=86890) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 10:08:37 devstack cinder-volume[86890]: INFO cinder.image.image_utils [None req-eb3168be-9510-45f9-9ae3-cb15041b1874 tempest-VolumesGetTest-2039441195 None] Converted 112.00 MB image at 38.41 MB/s Nov 02 10:08:37 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-eb3168be-9510-45f9-9ae3-cb15041b1874 tempest-VolumesGetTest-2039441195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-40ac8eb2-fdc2-4db4-8695-872b1ad4a0b5 1G {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:37 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-62c25d63-7b10-4874-b225-8a8ab99cbd39 tempest-SnapshotsActionsTest-707838012 None] Acquiring lock "cinder-304a139c-8884-4d25-b9a3-0ebe3606bec1-delete_snapshot" by "delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:08:38 devstack sudo[94118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-40ac8eb2-fdc2-4db4-8695-872b1ad4a0b5 1G Nov 02 10:08:38 devstack sudo[94118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:38 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-62c25d63-7b10-4874-b225-8a8ab99cbd39 tempest-SnapshotsActionsTest-707838012 None] Lock "cinder-304a139c-8884-4d25-b9a3-0ebe3606bec1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:08:38 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-62c25d63-7b10-4874-b225-8a8ab99cbd39 tempest-SnapshotsActionsTest-707838012 None] Acquiring lock "cinder-quobyte-3dcd8769-0716-4a69-901e-6040bf232294" by "delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:08:38 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-62c25d63-7b10-4874-b225-8a8ab99cbd39 tempest-SnapshotsActionsTest-707838012 None] Lock "cinder-quobyte-3dcd8769-0716-4a69-901e-6040bf232294" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:08:38 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-62c25d63-7b10-4874-b225-8a8ab99cbd39 tempest-SnapshotsActionsTest-707838012 None] Acquiring lock "cinder-quobyte-304a139c-8884-4d25-b9a3-0ebe3606bec1" by "_delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:08:38 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-62c25d63-7b10-4874-b225-8a8ab99cbd39 tempest-SnapshotsActionsTest-707838012 None] Lock "cinder-quobyte-304a139c-8884-4d25-b9a3-0ebe3606bec1" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:08:38 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-62c25d63-7b10-4874-b225-8a8ab99cbd39 tempest-SnapshotsActionsTest-707838012 None] Deleting offline snapshot 304a139c-8884-4d25-b9a3-0ebe3606bec1 of volume 3dcd8769-0716-4a69-901e-6040bf232294 {{(pid=86890) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:08:38 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-62c25d63-7b10-4874-b225-8a8ab99cbd39 tempest-SnapshotsActionsTest-707838012 None] snapshot_file for this snap is: volume-3dcd8769-0716-4a69-901e-6040bf232294.304a139c-8884-4d25-b9a3-0ebe3606bec1 {{(pid=86890) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:08:38 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[f74d63bf-5e41-4606-88d5-263d04e0d41f]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:08:38 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-62c25d63-7b10-4874-b225-8a8ab99cbd39 tempest-SnapshotsActionsTest-707838012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.304a139c-8884-4d25-b9a3-0ebe3606bec1 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:38 devstack sudo[94120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.304a139c-8884-4d25-b9a3-0ebe3606bec1 Nov 02 10:08:38 devstack sudo[94120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:38 devstack sudo[94118]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:38 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-eb3168be-9510-45f9-9ae3-cb15041b1874 tempest-VolumesGetTest-2039441195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-40ac8eb2-fdc2-4db4-8695-872b1ad4a0b5 1G" returned: 0 in 0.489s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:38 devstack cinder-volume[86890]: DEBUG cinder.volume.volume_utils [None req-eb3168be-9510-45f9-9ae3-cb15041b1874 tempest-VolumesGetTest-2039441195 None] Downloaded image 7a393fa7-4879-486c-8216-4d35448485cf ((None, [{'url': 'file:///opt/stack/data/glance/images/7a393fa7-4879-486c-8216-4d35448485cf', 'metadata': {}}])) to volume 40ac8eb2-fdc2-4db4-8695-872b1ad4a0b5 successfully. {{(pid=86890) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 02 10:08:38 devstack cinder-volume[86890]: DEBUG cinder.image.image_utils [None req-eb3168be-9510-45f9-9ae3-cb15041b1874 tempest-VolumesGetTest-2039441195 None] Temporary image 7a393fa7-4879-486c-8216-4d35448485cf for user 48ed03cccb05426d978c6648244b5e52 is deleted. {{(pid=86890) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 02 10:08:38 devstack cinder-volume[86890]: DEBUG cinder.volume.volume_utils [None req-eb3168be-9510-45f9-9ae3-cb15041b1874 tempest-VolumesGetTest-2039441195 None] Marking volume 40ac8eb2-fdc2-4db4-8695-872b1ad4a0b5 as bootable. {{(pid=86890) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 02 10:08:38 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb3168be-9510-45f9-9ae3-cb15041b1874 tempest-VolumesGetTest-2039441195 None] Copying metadata from image 7a393fa7-4879-486c-8216-4d35448485cf to 40ac8eb2-fdc2-4db4-8695-872b1ad4a0b5. {{(pid=86890) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 10:08:38 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb3168be-9510-45f9-9ae3-cb15041b1874 tempest-VolumesGetTest-2039441195 None] Creating volume glance metadata for volume 40ac8eb2-fdc2-4db4-8695-872b1ad4a0b5 backed by image 7a393fa7-4879-486c-8216-4d35448485cf with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '7a393fa7-4879-486c-8216-4d35448485cf', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86890) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 10:08:38 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-eb3168be-9510-45f9-9ae3-cb15041b1874 tempest-VolumesGetTest-2039441195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb2154b1-8aa6-4f25-b2b4-c7b514690701) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40ac8eb2-fdc2-4db4-8695-872b1ad4a0b5', 'volume_size': 1, 'image_id': '7a393fa7-4879-486c-8216-4d35448485cf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7a393fa7-4879-486c-8216-4d35448485cf', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '606cf27a36794aa3805ebe6d987aa1a4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7a393fa7-4879-486c-8216-4d35448485cf', 'created_at': datetime.datetime(2026, 11, 2, 8, 55, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 8, 55, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7a393fa7-4879-486c-8216-4d35448485cf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:08:38 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-eb3168be-9510-45f9-9ae3-cb15041b1874 tempest-VolumesGetTest-2039441195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c71ba9d8-c49c-4ce4-ac6c-600038eeb961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:08:38 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-eb3168be-9510-45f9-9ae3-cb15041b1874 tempest-VolumesGetTest-2039441195 None] Volume volume-40ac8eb2-fdc2-4db4-8695-872b1ad4a0b5 (40ac8eb2-fdc2-4db4-8695-872b1ad4a0b5): created successfully Nov 02 10:08:38 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-eb3168be-9510-45f9-9ae3-cb15041b1874 tempest-VolumesGetTest-2039441195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c71ba9d8-c49c-4ce4-ac6c-600038eeb961) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:08:38 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-eb3168be-9510-45f9-9ae3-cb15041b1874 tempest-VolumesGetTest-2039441195 None] Flow 'volume_create_manager' (6d710c96-dd1c-4653-a7c5-7c37900fc1d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:08:38 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-eb3168be-9510-45f9-9ae3-cb15041b1874 tempest-VolumesGetTest-2039441195 None] Created volume successfully. Nov 02 10:08:38 devstack sudo[94120]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:38 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-62c25d63-7b10-4874-b225-8a8ab99cbd39 tempest-SnapshotsActionsTest-707838012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.304a139c-8884-4d25-b9a3-0ebe3606bec1" returned: 0 in 0.665s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:38 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-62c25d63-7b10-4874-b225-8a8ab99cbd39 tempest-SnapshotsActionsTest-707838012 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3dcd8769-0716-4a69-901e-6040bf232294(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86890) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:08:38 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[84301d5a-2603-4bec-a32b-bbe038c2f975]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:08:38 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-62c25d63-7b10-4874-b225-8a8ab99cbd39 tempest-SnapshotsActionsTest-707838012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.16a1f2b5-f260-42cc-92a0-60e8587b586b {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:39 devstack sudo[94129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.16a1f2b5-f260-42cc-92a0-60e8587b586b Nov 02 10:08:39 devstack sudo[94129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:39 devstack sudo[94129]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:39 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-62c25d63-7b10-4874-b225-8a8ab99cbd39 tempest-SnapshotsActionsTest-707838012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.16a1f2b5-f260-42cc-92a0-60e8587b586b" returned: 0 in 0.640s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:39 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-62c25d63-7b10-4874-b225-8a8ab99cbd39 tempest-SnapshotsActionsTest-707838012 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3dcd8769-0716-4a69-901e-6040bf232294(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86890) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:08:39 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-62c25d63-7b10-4874-b225-8a8ab99cbd39 tempest-SnapshotsActionsTest-707838012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.304a139c-8884-4d25-b9a3-0ebe3606bec1 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:39 devstack sudo[94134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.304a139c-8884-4d25-b9a3-0ebe3606bec1 Nov 02 10:08:39 devstack sudo[94134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:40 devstack sudo[94134]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:40 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-62c25d63-7b10-4874-b225-8a8ab99cbd39 tempest-SnapshotsActionsTest-707838012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.304a139c-8884-4d25-b9a3-0ebe3606bec1" returned: 0 in 0.642s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:40 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-62c25d63-7b10-4874-b225-8a8ab99cbd39 tempest-SnapshotsActionsTest-707838012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.304a139c-8884-4d25-b9a3-0ebe3606bec1 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:40 devstack sudo[94140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.304a139c-8884-4d25-b9a3-0ebe3606bec1 Nov 02 10:08:40 devstack sudo[94140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:40 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-3fb6120b-d76d-46a9-916f-d68bde1ceeae tempest-VolumesGetTest-2039441195 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:08:40 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-3fb6120b-d76d-46a9-916f-d68bde1ceeae tempest-VolumesGetTest-2039441195 None] Flow 'volume_create_manager' (cb2de27a-e7e2-40a2-bef0-8316c2ae48ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:08:40 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-3fb6120b-d76d-46a9-916f-d68bde1ceeae tempest-VolumesGetTest-2039441195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4e76437-0234-436b-84e9-7ac037b5a163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:08:40 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-3fb6120b-d76d-46a9-916f-d68bde1ceeae tempest-VolumesGetTest-2039441195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4e76437-0234-436b-84e9-7ac037b5a163) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:08:40Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-256893282',display_name='tempest-VolumesGetTest-Volume-1627691770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b43baff3-b619-48b4-a03f-e8410eea2149,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9434cdefc464db38da17b8304add28b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:08:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:08:40Z,use_quota=True,user_id='48ed03cccb05426d978c6648244b5e52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:08:40 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-3fb6120b-d76d-46a9-916f-d68bde1ceeae tempest-VolumesGetTest-2039441195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84de9b5b-c511-4ce0-a44a-fa9521f27dce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:08:40 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-3fb6120b-d76d-46a9-916f-d68bde1ceeae tempest-VolumesGetTest-2039441195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84de9b5b-c511-4ce0-a44a-fa9521f27dce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:08:40 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-3fb6120b-d76d-46a9-916f-d68bde1ceeae tempest-VolumesGetTest-2039441195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30f90ce1-d2e5-41a9-96cf-f06f1ba7aaf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:08:40 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-3fb6120b-d76d-46a9-916f-d68bde1ceeae tempest-VolumesGetTest-2039441195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30f90ce1-d2e5-41a9-96cf-f06f1ba7aaf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b43baff3-b619-48b4-a03f-e8410eea2149', 'volume_name': 'volume-b43baff3-b619-48b4-a03f-e8410eea2149', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:08:40 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-3fb6120b-d76d-46a9-916f-d68bde1ceeae tempest-VolumesGetTest-2039441195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ac804ab-b5dd-434a-a3da-4ffd8b3d30cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:08:40 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-3fb6120b-d76d-46a9-916f-d68bde1ceeae tempest-VolumesGetTest-2039441195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ac804ab-b5dd-434a-a3da-4ffd8b3d30cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:08:40 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-3fb6120b-d76d-46a9-916f-d68bde1ceeae tempest-VolumesGetTest-2039441195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a35640e1-4587-4571-a6f8-fd19797b584c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:08:40 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-3fb6120b-d76d-46a9-916f-d68bde1ceeae tempest-VolumesGetTest-2039441195 None] Volume b43baff3-b619-48b4-a03f-e8410eea2149: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b43baff3-b619-48b4-a03f-e8410eea2149', 'volume_size': 1} Nov 02 10:08:40 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-3fb6120b-d76d-46a9-916f-d68bde1ceeae tempest-VolumesGetTest-2039441195 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:08:40 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-3fb6120b-d76d-46a9-916f-d68bde1ceeae tempest-VolumesGetTest-2039441195 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:08:40 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-3fb6120b-d76d-46a9-916f-d68bde1ceeae tempest-VolumesGetTest-2039441195 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:08:40Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-256893282',display_name='tempest-VolumesGetTest-Volume-1627691770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b43baff3-b619-48b4-a03f-e8410eea2149,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9434cdefc464db38da17b8304add28b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:08:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:08:40Z,use_quota=True,user_id='48ed03cccb05426d978c6648244b5e52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:08:40 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-3fb6120b-d76d-46a9-916f-d68bde1ceeae tempest-VolumesGetTest-2039441195 None] Creating volume b43baff3-b619-48b4-a03f-e8410eea2149 {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:08:40 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-3fb6120b-d76d-46a9-916f-d68bde1ceeae tempest-VolumesGetTest-2039441195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:08:40 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-3fb6120b-d76d-46a9-916f-d68bde1ceeae tempest-VolumesGetTest-2039441195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:08:40 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-3fb6120b-d76d-46a9-916f-d68bde1ceeae tempest-VolumesGetTest-2039441195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:08:40 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-3fb6120b-d76d-46a9-916f-d68bde1ceeae tempest-VolumesGetTest-2039441195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:08:40 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-3fb6120b-d76d-46a9-916f-d68bde1ceeae tempest-VolumesGetTest-2039441195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:08:40 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-3fb6120b-d76d-46a9-916f-d68bde1ceeae tempest-VolumesGetTest-2039441195 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:08:40 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-3fb6120b-d76d-46a9-916f-d68bde1ceeae tempest-VolumesGetTest-2039441195 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:08:40 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-3fb6120b-d76d-46a9-916f-d68bde1ceeae tempest-VolumesGetTest-2039441195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b43baff3-b619-48b4-a03f-e8410eea2149 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:40 devstack sudo[94140]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:40 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-62c25d63-7b10-4874-b225-8a8ab99cbd39 tempest-SnapshotsActionsTest-707838012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.304a139c-8884-4d25-b9a3-0ebe3606bec1" returned: 0 in 0.348s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:40 devstack sudo[94143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b43baff3-b619-48b4-a03f-e8410eea2149 1073741824 Nov 02 10:08:40 devstack sudo[94143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:40 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-62c25d63-7b10-4874-b225-8a8ab99cbd39 tempest-SnapshotsActionsTest-707838012 None] Lock "cinder-quobyte-304a139c-8884-4d25-b9a3-0ebe3606bec1" released by "_delete_snapshot" :: held 2.496s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:08:40 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-62c25d63-7b10-4874-b225-8a8ab99cbd39 tempest-SnapshotsActionsTest-707838012 None] Lock "cinder-quobyte-3dcd8769-0716-4a69-901e-6040bf232294" released by "delete_snapshot" :: held 2.538s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:08:40 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-62c25d63-7b10-4874-b225-8a8ab99cbd39 tempest-SnapshotsActionsTest-707838012 None] Created reservations ['04d41019-25d1-46d8-81c0-61df10e1bbf6', '37e096b8-c1a3-4973-bdce-6adec5fa4156', 'c84fd78d-6fc4-4420-a0e1-d161d402a694', 'a611f966-9775-4cc8-ae49-6488ca8a1f60'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:08:40 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-62c25d63-7b10-4874-b225-8a8ab99cbd39 tempest-SnapshotsActionsTest-707838012 None] Delete snapshot completed successfully. Nov 02 10:08:40 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-62c25d63-7b10-4874-b225-8a8ab99cbd39 tempest-SnapshotsActionsTest-707838012 None] Lock "cinder-304a139c-8884-4d25-b9a3-0ebe3606bec1-delete_snapshot" released by "delete_snapshot" :: held 2.775s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:08:41 devstack sudo[94143]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:41 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-3fb6120b-d76d-46a9-916f-d68bde1ceeae tempest-VolumesGetTest-2039441195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b43baff3-b619-48b4-a03f-e8410eea2149 1073741824" returned: 0 in 0.603s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:41 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-3fb6120b-d76d-46a9-916f-d68bde1ceeae tempest-VolumesGetTest-2039441195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b43baff3-b619-48b4-a03f-e8410eea2149 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:41 devstack sudo[94149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b43baff3-b619-48b4-a03f-e8410eea2149 Nov 02 10:08:41 devstack sudo[94149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:41 devstack sudo[94149]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:41 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-3fb6120b-d76d-46a9-916f-d68bde1ceeae tempest-VolumesGetTest-2039441195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b43baff3-b619-48b4-a03f-e8410eea2149" returned: 0 in 0.482s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:41 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-3fb6120b-d76d-46a9-916f-d68bde1ceeae tempest-VolumesGetTest-2039441195 None] <== create_volume: return (1191ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:08:41 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-3fb6120b-d76d-46a9-916f-d68bde1ceeae tempest-VolumesGetTest-2039441195 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.196s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:08:41 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-3fb6120b-d76d-46a9-916f-d68bde1ceeae tempest-VolumesGetTest-2039441195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a35640e1-4587-4571-a6f8-fd19797b584c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b43baff3-b619-48b4-a03f-e8410eea2149', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:08:41 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-3fb6120b-d76d-46a9-916f-d68bde1ceeae tempest-VolumesGetTest-2039441195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02c149ed-69da-4ffa-a5ea-fa0e1107f86f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:08:41 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-8dedaae6-c755-4929-94ca-3a690fa51679 tempest-SnapshotsActionsTest-1742624275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:08:41 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-8dedaae6-c755-4929-94ca-3a690fa51679 tempest-SnapshotsActionsTest-1742624275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:08:41 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-8dedaae6-c755-4929-94ca-3a690fa51679 tempest-SnapshotsActionsTest-1742624275 None] Creating offline snapshot 9f0db210-7789-450d-bca1-a05da775ccc9 of volume 3dcd8769-0716-4a69-901e-6040bf232294 {{(pid=86890) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:08:41 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-3fb6120b-d76d-46a9-916f-d68bde1ceeae tempest-VolumesGetTest-2039441195 None] Volume volume-b43baff3-b619-48b4-a03f-e8410eea2149 (b43baff3-b619-48b4-a03f-e8410eea2149): created successfully Nov 02 10:08:41 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-3fb6120b-d76d-46a9-916f-d68bde1ceeae tempest-VolumesGetTest-2039441195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02c149ed-69da-4ffa-a5ea-fa0e1107f86f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:08:41 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-3fb6120b-d76d-46a9-916f-d68bde1ceeae tempest-VolumesGetTest-2039441195 None] Flow 'volume_create_manager' (cb2de27a-e7e2-40a2-bef0-8316c2ae48ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:08:41 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b814a26-fed9-4a96-abbe-8f3ec3f1bd54]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:08:41 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8dedaae6-c755-4929-94ca-3a690fa51679 tempest-SnapshotsActionsTest-1742624275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.16a1f2b5-f260-42cc-92a0-60e8587b586b {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:41 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-3fb6120b-d76d-46a9-916f-d68bde1ceeae tempest-VolumesGetTest-2039441195 None] Created volume successfully. Nov 02 10:08:42 devstack sudo[94152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.16a1f2b5-f260-42cc-92a0-60e8587b586b Nov 02 10:08:42 devstack sudo[94152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:42 devstack sudo[94152]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:42 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8dedaae6-c755-4929-94ca-3a690fa51679 tempest-SnapshotsActionsTest-1742624275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.16a1f2b5-f260-42cc-92a0-60e8587b586b" returned: 0 in 0.553s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:42 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-8dedaae6-c755-4929-94ca-3a690fa51679 tempest-SnapshotsActionsTest-1742624275 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3dcd8769-0716-4a69-901e-6040bf232294(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86890) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:08:42 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8dedaae6-c755-4929-94ca-3a690fa51679 tempest-SnapshotsActionsTest-1742624275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.16a1f2b5-f260-42cc-92a0-60e8587b586b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.9f0db210-7789-450d-bca1-a05da775ccc9 1G {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:42 devstack sudo[94158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.16a1f2b5-f260-42cc-92a0-60e8587b586b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.9f0db210-7789-450d-bca1-a05da775ccc9 1G Nov 02 10:08:42 devstack sudo[94158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:42 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-e4a02560-7519-4e14-8710-a2c06565916e tempest-VolumesGetTest-2039441195 None] Acquiring lock "cinder-b43baff3-b619-48b4-a03f-e8410eea2149-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:08:42 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-e4a02560-7519-4e14-8710-a2c06565916e tempest-VolumesGetTest-2039441195 None] Lock "cinder-b43baff3-b619-48b4-a03f-e8410eea2149-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:08:42 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-e4a02560-7519-4e14-8710-a2c06565916e tempest-VolumesGetTest-2039441195 None] Acquiring lock "cinder-quobyte-b43baff3-b619-48b4-a03f-e8410eea2149" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:08:42 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-e4a02560-7519-4e14-8710-a2c06565916e tempest-VolumesGetTest-2039441195 None] Lock "cinder-quobyte-b43baff3-b619-48b4-a03f-e8410eea2149" acquired by "delete_volume" :: waited 0.038s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:08:42 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[73bf59c8-dec0-4266-9067-ebab02e2ff53]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:08:42 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-e4a02560-7519-4e14-8710-a2c06565916e tempest-VolumesGetTest-2039441195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b43baff3-b619-48b4-a03f-e8410eea2149 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:43 devstack sudo[94163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b43baff3-b619-48b4-a03f-e8410eea2149 Nov 02 10:08:43 devstack sudo[94163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:43 devstack sudo[94158]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:43 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8dedaae6-c755-4929-94ca-3a690fa51679 tempest-SnapshotsActionsTest-1742624275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.16a1f2b5-f260-42cc-92a0-60e8587b586b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.9f0db210-7789-450d-bca1-a05da775ccc9 1G" returned: 0 in 0.758s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:43 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8dedaae6-c755-4929-94ca-3a690fa51679 tempest-SnapshotsActionsTest-1742624275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3dcd8769-0716-4a69-901e-6040bf232294.16a1f2b5-f260-42cc-92a0-60e8587b586b -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.9f0db210-7789-450d-bca1-a05da775ccc9 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:43 devstack sudo[94167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3dcd8769-0716-4a69-901e-6040bf232294.16a1f2b5-f260-42cc-92a0-60e8587b586b -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.9f0db210-7789-450d-bca1-a05da775ccc9 Nov 02 10:08:43 devstack sudo[94167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:43 devstack sudo[94163]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:43 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-e4a02560-7519-4e14-8710-a2c06565916e tempest-VolumesGetTest-2039441195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b43baff3-b619-48b4-a03f-e8410eea2149" returned: 0 in 0.626s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:43 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-e4a02560-7519-4e14-8710-a2c06565916e tempest-VolumesGetTest-2039441195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b43baff3-b619-48b4-a03f-e8410eea2149 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:43 devstack sudo[94172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b43baff3-b619-48b4-a03f-e8410eea2149 Nov 02 10:08:43 devstack sudo[94172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:43 devstack sudo[94167]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:43 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8dedaae6-c755-4929-94ca-3a690fa51679 tempest-SnapshotsActionsTest-1742624275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3dcd8769-0716-4a69-901e-6040bf232294.16a1f2b5-f260-42cc-92a0-60e8587b586b -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.9f0db210-7789-450d-bca1-a05da775ccc9" returned: 0 in 0.439s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:43 devstack cinder-volume[86890]: WARNING cinder.volume.drivers.remotefs [None req-8dedaae6-c755-4929-94ca-3a690fa51679 tempest-SnapshotsActionsTest-1742624275 None] /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.9f0db210-7789-450d-bca1-a05da775ccc9 is being set with open permissions: ugo+rw Nov 02 10:08:43 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8dedaae6-c755-4929-94ca-3a690fa51679 tempest-SnapshotsActionsTest-1742624275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.9f0db210-7789-450d-bca1-a05da775ccc9 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:43 devstack sudo[94177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.9f0db210-7789-450d-bca1-a05da775ccc9 Nov 02 10:08:43 devstack sudo[94177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:43 devstack sudo[94172]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:43 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-e4a02560-7519-4e14-8710-a2c06565916e tempest-VolumesGetTest-2039441195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b43baff3-b619-48b4-a03f-e8410eea2149" returned: 0 in 0.450s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:43 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-e4a02560-7519-4e14-8710-a2c06565916e tempest-VolumesGetTest-2039441195 None] Lock "cinder-quobyte-b43baff3-b619-48b4-a03f-e8410eea2149" released by "delete_volume" :: held 1.145s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:08:44 devstack sudo[94177]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:44 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8dedaae6-c755-4929-94ca-3a690fa51679 tempest-SnapshotsActionsTest-1742624275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.9f0db210-7789-450d-bca1-a05da775ccc9" returned: 0 in 0.359s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:44 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-8dedaae6-c755-4929-94ca-3a690fa51679 tempest-SnapshotsActionsTest-1742624275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.282s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:08:44 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-e4a02560-7519-4e14-8710-a2c06565916e tempest-VolumesGetTest-2039441195 None] Created reservations ['ef91301d-8bf0-4b7c-b4e6-e6e1c8c78240', 'a3afe209-5a4e-4892-9ad6-0ed2550ce042', 'b147384e-6b33-4448-bee7-9945720b0e91', '2ec9d16b-8dbb-4aae-8144-9b1738258e6a'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:08:44 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-8dedaae6-c755-4929-94ca-3a690fa51679 tempest-SnapshotsActionsTest-1742624275 None] Create snapshot completed successfully Nov 02 10:08:44 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-e4a02560-7519-4e14-8710-a2c06565916e tempest-VolumesGetTest-2039441195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:08:44 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-e4a02560-7519-4e14-8710-a2c06565916e tempest-VolumesGetTest-2039441195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:08:44 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-e4a02560-7519-4e14-8710-a2c06565916e tempest-VolumesGetTest-2039441195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:08:44 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-e4a02560-7519-4e14-8710-a2c06565916e tempest-VolumesGetTest-2039441195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:08:44 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-e4a02560-7519-4e14-8710-a2c06565916e tempest-VolumesGetTest-2039441195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:08:44 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-e4a02560-7519-4e14-8710-a2c06565916e tempest-VolumesGetTest-2039441195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:44 devstack sudo[94181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:08:44 devstack sudo[94181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:44 devstack sudo[94181]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:44 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-e4a02560-7519-4e14-8710-a2c06565916e tempest-VolumesGetTest-2039441195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.277s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:44 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-e4a02560-7519-4e14-8710-a2c06565916e tempest-VolumesGetTest-2039441195 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:08:44 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-e4a02560-7519-4e14-8710-a2c06565916e tempest-VolumesGetTest-2039441195 None] Deleted volume successfully. Nov 02 10:08:44 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-e4a02560-7519-4e14-8710-a2c06565916e tempest-VolumesGetTest-2039441195 None] Lock "cinder-b43baff3-b619-48b4-a03f-e8410eea2149-delete_volume" released by "delete_volume" :: held 1.805s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:08:45 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-e86dc7f9-0b95-418a-bb95-6b8b02a97549 tempest-SnapshotsActionsTest-707838012 None] Acquiring lock "cinder-9f0db210-7789-450d-bca1-a05da775ccc9-delete_snapshot" by "delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:08:45 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-e86dc7f9-0b95-418a-bb95-6b8b02a97549 tempest-SnapshotsActionsTest-707838012 None] Lock "cinder-9f0db210-7789-450d-bca1-a05da775ccc9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:08:45 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-e86dc7f9-0b95-418a-bb95-6b8b02a97549 tempest-SnapshotsActionsTest-707838012 None] Acquiring lock "cinder-quobyte-3dcd8769-0716-4a69-901e-6040bf232294" by "delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:08:45 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-e86dc7f9-0b95-418a-bb95-6b8b02a97549 tempest-SnapshotsActionsTest-707838012 None] Lock "cinder-quobyte-3dcd8769-0716-4a69-901e-6040bf232294" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:08:45 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-e86dc7f9-0b95-418a-bb95-6b8b02a97549 tempest-SnapshotsActionsTest-707838012 None] Acquiring lock "cinder-quobyte-9f0db210-7789-450d-bca1-a05da775ccc9" by "_delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:08:45 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-e86dc7f9-0b95-418a-bb95-6b8b02a97549 tempest-SnapshotsActionsTest-707838012 None] Lock "cinder-quobyte-9f0db210-7789-450d-bca1-a05da775ccc9" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:08:45 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-e86dc7f9-0b95-418a-bb95-6b8b02a97549 tempest-SnapshotsActionsTest-707838012 None] Deleting offline snapshot 9f0db210-7789-450d-bca1-a05da775ccc9 of volume 3dcd8769-0716-4a69-901e-6040bf232294 {{(pid=86890) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:08:45 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-e86dc7f9-0b95-418a-bb95-6b8b02a97549 tempest-SnapshotsActionsTest-707838012 None] snapshot_file for this snap is: volume-3dcd8769-0716-4a69-901e-6040bf232294.9f0db210-7789-450d-bca1-a05da775ccc9 {{(pid=86890) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:08:45 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bfee386-c69c-4504-8d01-c4a37cc8a4ab]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:08:45 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-e86dc7f9-0b95-418a-bb95-6b8b02a97549 tempest-SnapshotsActionsTest-707838012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.9f0db210-7789-450d-bca1-a05da775ccc9 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:45 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-96a41468-8b2d-46b1-a9ef-9056c85f7ba0 tempest-VolumesGetTest-2039441195 None] Acquiring lock "cinder-40ac8eb2-fdc2-4db4-8695-872b1ad4a0b5-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:08:45 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-96a41468-8b2d-46b1-a9ef-9056c85f7ba0 tempest-VolumesGetTest-2039441195 None] Lock "cinder-40ac8eb2-fdc2-4db4-8695-872b1ad4a0b5-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:08:45 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-96a41468-8b2d-46b1-a9ef-9056c85f7ba0 tempest-VolumesGetTest-2039441195 None] Acquiring lock "cinder-quobyte-40ac8eb2-fdc2-4db4-8695-872b1ad4a0b5" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:08:45 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-96a41468-8b2d-46b1-a9ef-9056c85f7ba0 tempest-VolumesGetTest-2039441195 None] Lock "cinder-quobyte-40ac8eb2-fdc2-4db4-8695-872b1ad4a0b5" acquired by "delete_volume" :: waited 0.024s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:08:45 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef3423ae-f84e-4ec5-ac1c-989474ca97b0]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:08:45 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-96a41468-8b2d-46b1-a9ef-9056c85f7ba0 tempest-VolumesGetTest-2039441195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-40ac8eb2-fdc2-4db4-8695-872b1ad4a0b5 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:45 devstack sudo[94184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.9f0db210-7789-450d-bca1-a05da775ccc9 Nov 02 10:08:45 devstack sudo[94184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:45 devstack sudo[94185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-40ac8eb2-fdc2-4db4-8695-872b1ad4a0b5 Nov 02 10:08:45 devstack sudo[94185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:45 devstack sudo[94184]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:45 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-e86dc7f9-0b95-418a-bb95-6b8b02a97549 tempest-SnapshotsActionsTest-707838012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.9f0db210-7789-450d-bca1-a05da775ccc9" returned: 0 in 0.592s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:45 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-e86dc7f9-0b95-418a-bb95-6b8b02a97549 tempest-SnapshotsActionsTest-707838012 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3dcd8769-0716-4a69-901e-6040bf232294(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86890) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:08:45 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ddb25bf-418b-4724-9d8c-b0ea78e9c826]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:08:45 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-e86dc7f9-0b95-418a-bb95-6b8b02a97549 tempest-SnapshotsActionsTest-707838012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.16a1f2b5-f260-42cc-92a0-60e8587b586b {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:45 devstack sudo[94185]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:45 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-96a41468-8b2d-46b1-a9ef-9056c85f7ba0 tempest-VolumesGetTest-2039441195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-40ac8eb2-fdc2-4db4-8695-872b1ad4a0b5" returned: 0 in 0.569s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:45 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-96a41468-8b2d-46b1-a9ef-9056c85f7ba0 tempest-VolumesGetTest-2039441195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-40ac8eb2-fdc2-4db4-8695-872b1ad4a0b5 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:45 devstack sudo[94196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.16a1f2b5-f260-42cc-92a0-60e8587b586b Nov 02 10:08:45 devstack sudo[94196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:46 devstack sudo[94198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-40ac8eb2-fdc2-4db4-8695-872b1ad4a0b5 Nov 02 10:08:46 devstack sudo[94198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:46 devstack sudo[94198]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:46 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-96a41468-8b2d-46b1-a9ef-9056c85f7ba0 tempest-VolumesGetTest-2039441195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-40ac8eb2-fdc2-4db4-8695-872b1ad4a0b5" returned: 0 in 0.422s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:46 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-96a41468-8b2d-46b1-a9ef-9056c85f7ba0 tempest-VolumesGetTest-2039441195 None] Lock "cinder-quobyte-40ac8eb2-fdc2-4db4-8695-872b1ad4a0b5" released by "delete_volume" :: held 1.068s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:08:46 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-96a41468-8b2d-46b1-a9ef-9056c85f7ba0 tempest-VolumesGetTest-2039441195 None] Created reservations ['1d8881c2-40d4-4658-99d2-b5354e5b5ab3', 'a8ae82ff-b7d6-4f7b-9f9a-cdcbb5bd3d42', 'b6342fcd-fb19-4835-9292-8ef0bb3f6f32', 'c2544e98-c75b-4549-821b-3e58ffda185a'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:08:46 devstack sudo[94196]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:46 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-e86dc7f9-0b95-418a-bb95-6b8b02a97549 tempest-SnapshotsActionsTest-707838012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.16a1f2b5-f260-42cc-92a0-60e8587b586b" returned: 0 in 0.674s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:46 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-e86dc7f9-0b95-418a-bb95-6b8b02a97549 tempest-SnapshotsActionsTest-707838012 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3dcd8769-0716-4a69-901e-6040bf232294(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86890) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:08:46 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-e86dc7f9-0b95-418a-bb95-6b8b02a97549 tempest-SnapshotsActionsTest-707838012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.9f0db210-7789-450d-bca1-a05da775ccc9 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:46 devstack sudo[94205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.9f0db210-7789-450d-bca1-a05da775ccc9 Nov 02 10:08:46 devstack sudo[94205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:46 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-96a41468-8b2d-46b1-a9ef-9056c85f7ba0 tempest-VolumesGetTest-2039441195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:08:46 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-96a41468-8b2d-46b1-a9ef-9056c85f7ba0 tempest-VolumesGetTest-2039441195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:08:46 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-96a41468-8b2d-46b1-a9ef-9056c85f7ba0 tempest-VolumesGetTest-2039441195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:08:46 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-96a41468-8b2d-46b1-a9ef-9056c85f7ba0 tempest-VolumesGetTest-2039441195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:08:46 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-96a41468-8b2d-46b1-a9ef-9056c85f7ba0 tempest-VolumesGetTest-2039441195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:08:46 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-96a41468-8b2d-46b1-a9ef-9056c85f7ba0 tempest-VolumesGetTest-2039441195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:46 devstack sudo[94208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:08:46 devstack sudo[94208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:46 devstack sudo[94208]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:46 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-96a41468-8b2d-46b1-a9ef-9056c85f7ba0 tempest-VolumesGetTest-2039441195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.342s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:46 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-96a41468-8b2d-46b1-a9ef-9056c85f7ba0 tempest-VolumesGetTest-2039441195 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:08:46 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-96a41468-8b2d-46b1-a9ef-9056c85f7ba0 tempest-VolumesGetTest-2039441195 None] Deleted volume successfully. Nov 02 10:08:47 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-96a41468-8b2d-46b1-a9ef-9056c85f7ba0 tempest-VolumesGetTest-2039441195 None] Lock "cinder-40ac8eb2-fdc2-4db4-8695-872b1ad4a0b5-delete_volume" released by "delete_volume" :: held 1.728s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:08:47 devstack sudo[94205]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:47 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-e86dc7f9-0b95-418a-bb95-6b8b02a97549 tempest-SnapshotsActionsTest-707838012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.9f0db210-7789-450d-bca1-a05da775ccc9" returned: 0 in 0.572s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:47 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-e86dc7f9-0b95-418a-bb95-6b8b02a97549 tempest-SnapshotsActionsTest-707838012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.9f0db210-7789-450d-bca1-a05da775ccc9 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:47 devstack sudo[94216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.9f0db210-7789-450d-bca1-a05da775ccc9 Nov 02 10:08:47 devstack sudo[94216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:47 devstack sudo[94216]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:47 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-e86dc7f9-0b95-418a-bb95-6b8b02a97549 tempest-SnapshotsActionsTest-707838012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.9f0db210-7789-450d-bca1-a05da775ccc9" returned: 0 in 0.322s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:47 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-e86dc7f9-0b95-418a-bb95-6b8b02a97549 tempest-SnapshotsActionsTest-707838012 None] Lock "cinder-quobyte-9f0db210-7789-450d-bca1-a05da775ccc9" released by "_delete_snapshot" :: held 2.363s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:08:47 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-e86dc7f9-0b95-418a-bb95-6b8b02a97549 tempest-SnapshotsActionsTest-707838012 None] Lock "cinder-quobyte-3dcd8769-0716-4a69-901e-6040bf232294" released by "delete_snapshot" :: held 2.398s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:08:47 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-e86dc7f9-0b95-418a-bb95-6b8b02a97549 tempest-SnapshotsActionsTest-707838012 None] Created reservations ['ccc68ab3-9abc-4d1f-9a95-38a74477ac02', 'b684f413-ed34-437a-9780-34043c5d00c6', '5408be56-e7ed-4a92-873c-c7d8b965dab3', '002689cb-073a-43c1-b2e1-e918d98e0299'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:08:47 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-e86dc7f9-0b95-418a-bb95-6b8b02a97549 tempest-SnapshotsActionsTest-707838012 None] Delete snapshot completed successfully. Nov 02 10:08:47 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-e86dc7f9-0b95-418a-bb95-6b8b02a97549 tempest-SnapshotsActionsTest-707838012 None] Lock "cinder-9f0db210-7789-450d-bca1-a05da775ccc9-delete_snapshot" released by "delete_snapshot" :: held 2.763s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:08:49 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-77ffb912-75b5-4728-990e-9cdd16fd29b7 tempest-SnapshotsActionsTest-1742624275 None] Acquiring lock "cinder-16a1f2b5-f260-42cc-92a0-60e8587b586b-delete_snapshot" by "delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:08:49 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-77ffb912-75b5-4728-990e-9cdd16fd29b7 tempest-SnapshotsActionsTest-1742624275 None] Lock "cinder-16a1f2b5-f260-42cc-92a0-60e8587b586b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:08:49 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-77ffb912-75b5-4728-990e-9cdd16fd29b7 tempest-SnapshotsActionsTest-1742624275 None] Acquiring lock "cinder-quobyte-3dcd8769-0716-4a69-901e-6040bf232294" by "delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:08:49 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-77ffb912-75b5-4728-990e-9cdd16fd29b7 tempest-SnapshotsActionsTest-1742624275 None] Lock "cinder-quobyte-3dcd8769-0716-4a69-901e-6040bf232294" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:08:49 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-77ffb912-75b5-4728-990e-9cdd16fd29b7 tempest-SnapshotsActionsTest-1742624275 None] Acquiring lock "cinder-quobyte-16a1f2b5-f260-42cc-92a0-60e8587b586b" by "_delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:08:49 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-77ffb912-75b5-4728-990e-9cdd16fd29b7 tempest-SnapshotsActionsTest-1742624275 None] Lock "cinder-quobyte-16a1f2b5-f260-42cc-92a0-60e8587b586b" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:08:49 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-77ffb912-75b5-4728-990e-9cdd16fd29b7 tempest-SnapshotsActionsTest-1742624275 None] Deleting offline snapshot 16a1f2b5-f260-42cc-92a0-60e8587b586b of volume 3dcd8769-0716-4a69-901e-6040bf232294 {{(pid=86890) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:08:49 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-77ffb912-75b5-4728-990e-9cdd16fd29b7 tempest-SnapshotsActionsTest-1742624275 None] snapshot_file for this snap is: volume-3dcd8769-0716-4a69-901e-6040bf232294.16a1f2b5-f260-42cc-92a0-60e8587b586b {{(pid=86890) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:08:49 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbd8db2d-3008-4400-8da4-127ec651c1b0]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:08:49 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-77ffb912-75b5-4728-990e-9cdd16fd29b7 tempest-SnapshotsActionsTest-1742624275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.16a1f2b5-f260-42cc-92a0-60e8587b586b {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:49 devstack sudo[94236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.16a1f2b5-f260-42cc-92a0-60e8587b586b Nov 02 10:08:49 devstack sudo[94236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:50 devstack sudo[94236]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:50 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-77ffb912-75b5-4728-990e-9cdd16fd29b7 tempest-SnapshotsActionsTest-1742624275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.16a1f2b5-f260-42cc-92a0-60e8587b586b" returned: 0 in 0.510s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:50 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-77ffb912-75b5-4728-990e-9cdd16fd29b7 tempest-SnapshotsActionsTest-1742624275 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3dcd8769-0716-4a69-901e-6040bf232294(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86890) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:08:50 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[528bbe1a-d2c4-4350-a3f6-42045098a811]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:08:50 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-77ffb912-75b5-4728-990e-9cdd16fd29b7 tempest-SnapshotsActionsTest-1742624275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:50 devstack sudo[94242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294 Nov 02 10:08:50 devstack sudo[94242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:50 devstack sudo[94242]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:50 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-77ffb912-75b5-4728-990e-9cdd16fd29b7 tempest-SnapshotsActionsTest-1742624275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294" returned: 0 in 0.458s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:50 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-77ffb912-75b5-4728-990e-9cdd16fd29b7 tempest-SnapshotsActionsTest-1742624275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.16a1f2b5-f260-42cc-92a0-60e8587b586b {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:50 devstack sudo[94247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.16a1f2b5-f260-42cc-92a0-60e8587b586b Nov 02 10:08:50 devstack sudo[94247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:50 devstack sudo[94247]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:51 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-77ffb912-75b5-4728-990e-9cdd16fd29b7 tempest-SnapshotsActionsTest-1742624275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.16a1f2b5-f260-42cc-92a0-60e8587b586b" returned: 0 in 0.494s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:51 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-77ffb912-75b5-4728-990e-9cdd16fd29b7 tempest-SnapshotsActionsTest-1742624275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.16a1f2b5-f260-42cc-92a0-60e8587b586b {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:51 devstack sudo[94253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.16a1f2b5-f260-42cc-92a0-60e8587b586b Nov 02 10:08:51 devstack sudo[94253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:51 devstack sudo[94253]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:51 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-77ffb912-75b5-4728-990e-9cdd16fd29b7 tempest-SnapshotsActionsTest-1742624275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294.16a1f2b5-f260-42cc-92a0-60e8587b586b" returned: 0 in 0.371s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:51 devstack cinder-volume[86890]: DEBUG dbcounter [-] [86890] Writing DB stats cinder:UPDATE=190,cinder:SELECT=144,cinder:DELETE=13,cinder:INSERT=54 {{(pid=86890) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:08:51 devstack cinder-volume[86890]: DEBUG dbcounter [-] [86890] Writing DB stats cinder:UPDATE=173,cinder:SELECT=166,cinder:INSERT=46,cinder:DELETE=14 {{(pid=86890) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:08:51 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-77ffb912-75b5-4728-990e-9cdd16fd29b7 tempest-SnapshotsActionsTest-1742624275 None] Lock "cinder-quobyte-16a1f2b5-f260-42cc-92a0-60e8587b586b" released by "_delete_snapshot" :: held 2.019s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:08:51 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-77ffb912-75b5-4728-990e-9cdd16fd29b7 tempest-SnapshotsActionsTest-1742624275 None] Lock "cinder-quobyte-3dcd8769-0716-4a69-901e-6040bf232294" released by "delete_snapshot" :: held 2.052s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:08:51 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-77ffb912-75b5-4728-990e-9cdd16fd29b7 tempest-SnapshotsActionsTest-1742624275 None] Created reservations ['2cf894c6-15c1-446b-9a89-36b9bfa82018', '30117b8a-ee0e-404d-9b90-bc081b32b0d6', '4946d7d3-c283-4a5e-9624-834500d6d139', '65ab880e-c1e5-4bec-a00a-b23cfa9c37f0'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:08:51 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-77ffb912-75b5-4728-990e-9cdd16fd29b7 tempest-SnapshotsActionsTest-1742624275 None] Delete snapshot completed successfully. Nov 02 10:08:51 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-77ffb912-75b5-4728-990e-9cdd16fd29b7 tempest-SnapshotsActionsTest-1742624275 None] Lock "cinder-16a1f2b5-f260-42cc-92a0-60e8587b586b-delete_snapshot" released by "delete_snapshot" :: held 2.258s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:08:52 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-db4d0c6a-0bcc-4515-8528-1c9dbf5ae210 tempest-SnapshotsActionsTest-1742624275 None] Acquiring lock "cinder-3dcd8769-0716-4a69-901e-6040bf232294-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:08:52 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-db4d0c6a-0bcc-4515-8528-1c9dbf5ae210 tempest-SnapshotsActionsTest-1742624275 None] Lock "cinder-3dcd8769-0716-4a69-901e-6040bf232294-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:08:52 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-db4d0c6a-0bcc-4515-8528-1c9dbf5ae210 tempest-SnapshotsActionsTest-1742624275 None] Acquiring lock "cinder-quobyte-3dcd8769-0716-4a69-901e-6040bf232294" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:08:52 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-db4d0c6a-0bcc-4515-8528-1c9dbf5ae210 tempest-SnapshotsActionsTest-1742624275 None] Lock "cinder-quobyte-3dcd8769-0716-4a69-901e-6040bf232294" acquired by "delete_volume" :: waited 0.022s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:08:52 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a5fe28c-588a-4294-8538-014923af7142]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:08:52 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-db4d0c6a-0bcc-4515-8528-1c9dbf5ae210 tempest-SnapshotsActionsTest-1742624275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:53 devstack sudo[94256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294 Nov 02 10:08:53 devstack sudo[94256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:53 devstack sudo[94256]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:53 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-db4d0c6a-0bcc-4515-8528-1c9dbf5ae210 tempest-SnapshotsActionsTest-1742624275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294" returned: 0 in 0.541s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:53 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-db4d0c6a-0bcc-4515-8528-1c9dbf5ae210 tempest-SnapshotsActionsTest-1742624275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:53 devstack sudo[94263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294 Nov 02 10:08:53 devstack sudo[94263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:53 devstack sudo[94263]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:53 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-db4d0c6a-0bcc-4515-8528-1c9dbf5ae210 tempest-SnapshotsActionsTest-1742624275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3dcd8769-0716-4a69-901e-6040bf232294" returned: 0 in 0.360s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:53 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-db4d0c6a-0bcc-4515-8528-1c9dbf5ae210 tempest-SnapshotsActionsTest-1742624275 None] Lock "cinder-quobyte-3dcd8769-0716-4a69-901e-6040bf232294" released by "delete_volume" :: held 1.014s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:08:54 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-db4d0c6a-0bcc-4515-8528-1c9dbf5ae210 tempest-SnapshotsActionsTest-1742624275 None] Created reservations ['93e0b195-79c9-41d7-9cf0-41e6f3dbe70e', '463cd939-40f8-4070-9f73-43102922cc72', 'fb3df286-659c-4669-9331-7bdc1849dc5e', '6754388c-f56f-4ec6-a7b1-f8875af5286c'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:08:54 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-db4d0c6a-0bcc-4515-8528-1c9dbf5ae210 tempest-SnapshotsActionsTest-1742624275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:08:54 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-db4d0c6a-0bcc-4515-8528-1c9dbf5ae210 tempest-SnapshotsActionsTest-1742624275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:08:54 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-db4d0c6a-0bcc-4515-8528-1c9dbf5ae210 tempest-SnapshotsActionsTest-1742624275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:08:54 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-db4d0c6a-0bcc-4515-8528-1c9dbf5ae210 tempest-SnapshotsActionsTest-1742624275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:08:54 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-db4d0c6a-0bcc-4515-8528-1c9dbf5ae210 tempest-SnapshotsActionsTest-1742624275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:08:54 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-db4d0c6a-0bcc-4515-8528-1c9dbf5ae210 tempest-SnapshotsActionsTest-1742624275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:54 devstack sudo[94266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:08:54 devstack sudo[94266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:54 devstack sudo[94266]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:54 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-db4d0c6a-0bcc-4515-8528-1c9dbf5ae210 tempest-SnapshotsActionsTest-1742624275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.316s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:54 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-db4d0c6a-0bcc-4515-8528-1c9dbf5ae210 tempest-SnapshotsActionsTest-1742624275 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:08:54 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-db4d0c6a-0bcc-4515-8528-1c9dbf5ae210 tempest-SnapshotsActionsTest-1742624275 None] Deleted volume successfully. Nov 02 10:08:54 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-db4d0c6a-0bcc-4515-8528-1c9dbf5ae210 tempest-SnapshotsActionsTest-1742624275 None] Lock "cinder-3dcd8769-0716-4a69-901e-6040bf232294-delete_volume" released by "delete_volume" :: held 1.651s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:09:01 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6943c47-f17a-4ea8-b1d6-9d26a35aa39a tempest-VolumesNegativeTest-928408438 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:09:01 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-a6943c47-f17a-4ea8-b1d6-9d26a35aa39a tempest-VolumesNegativeTest-928408438 None] Flow 'volume_create_manager' (a4f6b9d7-1568-4f97-93f4-9bcd73395713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:09:02 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-a6943c47-f17a-4ea8-b1d6-9d26a35aa39a tempest-VolumesNegativeTest-928408438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (692db9ec-946f-44da-9bac-5aedce070e57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:09:02 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-a6943c47-f17a-4ea8-b1d6-9d26a35aa39a tempest-VolumesNegativeTest-928408438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (692db9ec-946f-44da-9bac-5aedce070e57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:09:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-993387525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c3f4b5c-edb8-4364-9ca2-a927705f63c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='295edebf6d37400e8207f2e355c1c30e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:09:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:09:02Z,use_quota=True,user_id='31d323068c6947d3acb989687c683003',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:09:02 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-a6943c47-f17a-4ea8-b1d6-9d26a35aa39a tempest-VolumesNegativeTest-928408438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50c4f315-8131-41b2-81e3-3a1c7092ce36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:09:02 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-a6943c47-f17a-4ea8-b1d6-9d26a35aa39a tempest-VolumesNegativeTest-928408438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50c4f315-8131-41b2-81e3-3a1c7092ce36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:09:02 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-a6943c47-f17a-4ea8-b1d6-9d26a35aa39a tempest-VolumesNegativeTest-928408438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c16965e-e765-4318-97cc-2762833de957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:09:02 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-a6943c47-f17a-4ea8-b1d6-9d26a35aa39a tempest-VolumesNegativeTest-928408438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c16965e-e765-4318-97cc-2762833de957) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c3f4b5c-edb8-4364-9ca2-a927705f63c9', 'volume_name': 'volume-1c3f4b5c-edb8-4364-9ca2-a927705f63c9', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:09:02 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-a6943c47-f17a-4ea8-b1d6-9d26a35aa39a tempest-VolumesNegativeTest-928408438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ad81ddc-adb4-4c18-b8f7-8d409bd8931c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:09:02 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-a6943c47-f17a-4ea8-b1d6-9d26a35aa39a tempest-VolumesNegativeTest-928408438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ad81ddc-adb4-4c18-b8f7-8d409bd8931c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:09:02 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-a6943c47-f17a-4ea8-b1d6-9d26a35aa39a tempest-VolumesNegativeTest-928408438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4f75327-0cca-488b-ae58-14b16ead99f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:09:02 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-a6943c47-f17a-4ea8-b1d6-9d26a35aa39a tempest-VolumesNegativeTest-928408438 None] Volume 1c3f4b5c-edb8-4364-9ca2-a927705f63c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c3f4b5c-edb8-4364-9ca2-a927705f63c9', 'volume_size': 1} Nov 02 10:09:02 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-a6943c47-f17a-4ea8-b1d6-9d26a35aa39a tempest-VolumesNegativeTest-928408438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:09:02 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-a6943c47-f17a-4ea8-b1d6-9d26a35aa39a tempest-VolumesNegativeTest-928408438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:09:02 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-a6943c47-f17a-4ea8-b1d6-9d26a35aa39a tempest-VolumesNegativeTest-928408438 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:09:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-993387525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c3f4b5c-edb8-4364-9ca2-a927705f63c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='295edebf6d37400e8207f2e355c1c30e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:09:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:09:02Z,use_quota=True,user_id='31d323068c6947d3acb989687c683003',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:09:02 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-a6943c47-f17a-4ea8-b1d6-9d26a35aa39a tempest-VolumesNegativeTest-928408438 None] Creating volume 1c3f4b5c-edb8-4364-9ca2-a927705f63c9 {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:09:02 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-a6943c47-f17a-4ea8-b1d6-9d26a35aa39a tempest-VolumesNegativeTest-928408438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:09:02 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-a6943c47-f17a-4ea8-b1d6-9d26a35aa39a tempest-VolumesNegativeTest-928408438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:09:02 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-a6943c47-f17a-4ea8-b1d6-9d26a35aa39a tempest-VolumesNegativeTest-928408438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:09:02 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-a6943c47-f17a-4ea8-b1d6-9d26a35aa39a tempest-VolumesNegativeTest-928408438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:09:02 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-a6943c47-f17a-4ea8-b1d6-9d26a35aa39a tempest-VolumesNegativeTest-928408438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:09:02 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-a6943c47-f17a-4ea8-b1d6-9d26a35aa39a tempest-VolumesNegativeTest-928408438 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:09:02 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-a6943c47-f17a-4ea8-b1d6-9d26a35aa39a tempest-VolumesNegativeTest-928408438 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:09:02 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a6943c47-f17a-4ea8-b1d6-9d26a35aa39a tempest-VolumesNegativeTest-928408438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-1c3f4b5c-edb8-4364-9ca2-a927705f63c9 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:02 devstack sudo[94370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-1c3f4b5c-edb8-4364-9ca2-a927705f63c9 1073741824 Nov 02 10:09:02 devstack sudo[94370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:03 devstack sudo[94370]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:03 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a6943c47-f17a-4ea8-b1d6-9d26a35aa39a tempest-VolumesNegativeTest-928408438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-1c3f4b5c-edb8-4364-9ca2-a927705f63c9 1073741824" returned: 0 in 0.916s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:03 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a6943c47-f17a-4ea8-b1d6-9d26a35aa39a tempest-VolumesNegativeTest-928408438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-1c3f4b5c-edb8-4364-9ca2-a927705f63c9 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:03 devstack sudo[94376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-1c3f4b5c-edb8-4364-9ca2-a927705f63c9 Nov 02 10:09:03 devstack sudo[94376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:03 devstack sudo[94376]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:03 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a6943c47-f17a-4ea8-b1d6-9d26a35aa39a tempest-VolumesNegativeTest-928408438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-1c3f4b5c-edb8-4364-9ca2-a927705f63c9" returned: 0 in 0.695s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:03 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-a6943c47-f17a-4ea8-b1d6-9d26a35aa39a tempest-VolumesNegativeTest-928408438 None] <== create_volume: return (1685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:09:03 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-a6943c47-f17a-4ea8-b1d6-9d26a35aa39a tempest-VolumesNegativeTest-928408438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.689s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:09:03 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-a6943c47-f17a-4ea8-b1d6-9d26a35aa39a tempest-VolumesNegativeTest-928408438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4f75327-0cca-488b-ae58-14b16ead99f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c3f4b5c-edb8-4364-9ca2-a927705f63c9', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:09:03 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-a6943c47-f17a-4ea8-b1d6-9d26a35aa39a tempest-VolumesNegativeTest-928408438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc402f22-9e3f-44a6-b3dd-92b8864366a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:09:03 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-a6943c47-f17a-4ea8-b1d6-9d26a35aa39a tempest-VolumesNegativeTest-928408438 None] Volume volume-1c3f4b5c-edb8-4364-9ca2-a927705f63c9 (1c3f4b5c-edb8-4364-9ca2-a927705f63c9): created successfully Nov 02 10:09:03 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-a6943c47-f17a-4ea8-b1d6-9d26a35aa39a tempest-VolumesNegativeTest-928408438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc402f22-9e3f-44a6-b3dd-92b8864366a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:09:03 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-a6943c47-f17a-4ea8-b1d6-9d26a35aa39a tempest-VolumesNegativeTest-928408438 None] Flow 'volume_create_manager' (a4f6b9d7-1568-4f97-93f4-9bcd73395713) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:09:03 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-a6943c47-f17a-4ea8-b1d6-9d26a35aa39a tempest-VolumesNegativeTest-928408438 None] Created volume successfully. Nov 02 10:09:13 devstack cinder-volume[86890]: DEBUG dbcounter [-] [86890] Writing DB stats cinder:SELECT=12,cinder:INSERT=5,cinder:UPDATE=19,cinder:DELETE=1 {{(pid=86890) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:09:14 devstack cinder-volume[86890]: DEBUG dbcounter [-] [86890] Writing DB stats cinder:SELECT=12,cinder:INSERT=4,cinder:UPDATE=15,cinder:DELETE=1 {{(pid=86890) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:09:22 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae75b5a4-ce96-4761-ba03-5f0985a8c13a tempest-AttachVolumeNegativeTest-1700545160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:09:22 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-ae75b5a4-ce96-4761-ba03-5f0985a8c13a tempest-AttachVolumeNegativeTest-1700545160 None] Flow 'volume_create_manager' (d302011f-dfec-43fb-9db2-1f0f89928394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:09:22 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-ae75b5a4-ce96-4761-ba03-5f0985a8c13a tempest-AttachVolumeNegativeTest-1700545160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8be32576-ea3e-4f2a-912a-bb4710741267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:09:22 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-ae75b5a4-ce96-4761-ba03-5f0985a8c13a tempest-AttachVolumeNegativeTest-1700545160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8be32576-ea3e-4f2a-912a-bb4710741267) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:09:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1276905167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a3345e9-17e6-4b0c-82be-04eb9765e8ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='253ee95a4446482e922e1729e2adb6c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:09:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:09:22Z,use_quota=True,user_id='ea709b481078418fad7a82c87c527935',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:09:22 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-ae75b5a4-ce96-4761-ba03-5f0985a8c13a tempest-AttachVolumeNegativeTest-1700545160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d40bcf9-9c4f-47c7-aff8-140f58dd9560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:09:22 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-ae75b5a4-ce96-4761-ba03-5f0985a8c13a tempest-AttachVolumeNegativeTest-1700545160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d40bcf9-9c4f-47c7-aff8-140f58dd9560) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:09:22 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-ae75b5a4-ce96-4761-ba03-5f0985a8c13a tempest-AttachVolumeNegativeTest-1700545160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bc2b70a-1acb-4a7b-94c3-2166f1884ab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:09:22 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-ae75b5a4-ce96-4761-ba03-5f0985a8c13a tempest-AttachVolumeNegativeTest-1700545160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bc2b70a-1acb-4a7b-94c3-2166f1884ab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a3345e9-17e6-4b0c-82be-04eb9765e8ef', 'volume_name': 'volume-9a3345e9-17e6-4b0c-82be-04eb9765e8ef', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:09:22 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-ae75b5a4-ce96-4761-ba03-5f0985a8c13a tempest-AttachVolumeNegativeTest-1700545160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40d52519-ab12-44a3-8dbe-bf497e2e15dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:09:22 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-ae75b5a4-ce96-4761-ba03-5f0985a8c13a tempest-AttachVolumeNegativeTest-1700545160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40d52519-ab12-44a3-8dbe-bf497e2e15dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:09:22 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-ae75b5a4-ce96-4761-ba03-5f0985a8c13a tempest-AttachVolumeNegativeTest-1700545160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77f48911-f22c-4999-959b-81bdd8142e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:09:22 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-ae75b5a4-ce96-4761-ba03-5f0985a8c13a tempest-AttachVolumeNegativeTest-1700545160 None] Volume 9a3345e9-17e6-4b0c-82be-04eb9765e8ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a3345e9-17e6-4b0c-82be-04eb9765e8ef', 'volume_size': 1} Nov 02 10:09:22 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-ae75b5a4-ce96-4761-ba03-5f0985a8c13a tempest-AttachVolumeNegativeTest-1700545160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:09:22 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-ae75b5a4-ce96-4761-ba03-5f0985a8c13a tempest-AttachVolumeNegativeTest-1700545160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:09:22 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-ae75b5a4-ce96-4761-ba03-5f0985a8c13a tempest-AttachVolumeNegativeTest-1700545160 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:09:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1276905167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a3345e9-17e6-4b0c-82be-04eb9765e8ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='253ee95a4446482e922e1729e2adb6c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:09:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:09:22Z,use_quota=True,user_id='ea709b481078418fad7a82c87c527935',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:09:22 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-ae75b5a4-ce96-4761-ba03-5f0985a8c13a tempest-AttachVolumeNegativeTest-1700545160 None] Creating volume 9a3345e9-17e6-4b0c-82be-04eb9765e8ef {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:09:22 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-ae75b5a4-ce96-4761-ba03-5f0985a8c13a tempest-AttachVolumeNegativeTest-1700545160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:09:22 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-ae75b5a4-ce96-4761-ba03-5f0985a8c13a tempest-AttachVolumeNegativeTest-1700545160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:09:22 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-ae75b5a4-ce96-4761-ba03-5f0985a8c13a tempest-AttachVolumeNegativeTest-1700545160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:09:22 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-ae75b5a4-ce96-4761-ba03-5f0985a8c13a tempest-AttachVolumeNegativeTest-1700545160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:09:22 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-ae75b5a4-ce96-4761-ba03-5f0985a8c13a tempest-AttachVolumeNegativeTest-1700545160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:09:22 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-ae75b5a4-ce96-4761-ba03-5f0985a8c13a tempest-AttachVolumeNegativeTest-1700545160 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:09:22 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-ae75b5a4-ce96-4761-ba03-5f0985a8c13a tempest-AttachVolumeNegativeTest-1700545160 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:09:22 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ae75b5a4-ce96-4761-ba03-5f0985a8c13a tempest-AttachVolumeNegativeTest-1700545160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-9a3345e9-17e6-4b0c-82be-04eb9765e8ef 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:22 devstack sudo[94650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-9a3345e9-17e6-4b0c-82be-04eb9765e8ef 1073741824 Nov 02 10:09:22 devstack sudo[94650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:22 devstack sudo[94650]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:22 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ae75b5a4-ce96-4761-ba03-5f0985a8c13a tempest-AttachVolumeNegativeTest-1700545160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-9a3345e9-17e6-4b0c-82be-04eb9765e8ef 1073741824" returned: 0 in 0.653s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:22 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ae75b5a4-ce96-4761-ba03-5f0985a8c13a tempest-AttachVolumeNegativeTest-1700545160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-9a3345e9-17e6-4b0c-82be-04eb9765e8ef {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:23 devstack sudo[94692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-9a3345e9-17e6-4b0c-82be-04eb9765e8ef Nov 02 10:09:23 devstack sudo[94692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:23 devstack sudo[94692]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:23 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ae75b5a4-ce96-4761-ba03-5f0985a8c13a tempest-AttachVolumeNegativeTest-1700545160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-9a3345e9-17e6-4b0c-82be-04eb9765e8ef" returned: 0 in 0.325s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:23 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-ae75b5a4-ce96-4761-ba03-5f0985a8c13a tempest-AttachVolumeNegativeTest-1700545160 None] <== create_volume: return (1068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:09:23 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-ae75b5a4-ce96-4761-ba03-5f0985a8c13a tempest-AttachVolumeNegativeTest-1700545160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.073s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:09:23 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-ae75b5a4-ce96-4761-ba03-5f0985a8c13a tempest-AttachVolumeNegativeTest-1700545160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77f48911-f22c-4999-959b-81bdd8142e25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a3345e9-17e6-4b0c-82be-04eb9765e8ef', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:09:23 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-ae75b5a4-ce96-4761-ba03-5f0985a8c13a tempest-AttachVolumeNegativeTest-1700545160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d786f03b-eafc-44a9-b555-458a3b721879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:09:23 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-ae75b5a4-ce96-4761-ba03-5f0985a8c13a tempest-AttachVolumeNegativeTest-1700545160 None] Volume volume-9a3345e9-17e6-4b0c-82be-04eb9765e8ef (9a3345e9-17e6-4b0c-82be-04eb9765e8ef): created successfully Nov 02 10:09:23 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-ae75b5a4-ce96-4761-ba03-5f0985a8c13a tempest-AttachVolumeNegativeTest-1700545160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d786f03b-eafc-44a9-b555-458a3b721879) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:09:23 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-ae75b5a4-ce96-4761-ba03-5f0985a8c13a tempest-AttachVolumeNegativeTest-1700545160 None] Flow 'volume_create_manager' (d302011f-dfec-43fb-9db2-1f0f89928394) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:09:23 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-ae75b5a4-ce96-4761-ba03-5f0985a8c13a tempest-AttachVolumeNegativeTest-1700545160 None] Created volume successfully. Nov 02 10:09:25 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [req-b9440f72-e8a5-47ca-9807-85ce7a4c5b18 req-c61fb808-fafa-4573-8e05-59e613f7111a tempest-AttachVolumeNegativeTest-1700545160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:09:25 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [req-b9440f72-e8a5-47ca-9807-85ce7a4c5b18 req-c61fb808-fafa-4573-8e05-59e613f7111a tempest-AttachVolumeNegativeTest-1700545160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:09:25 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [req-b9440f72-e8a5-47ca-9807-85ce7a4c5b18 req-c61fb808-fafa-4573-8e05-59e613f7111a tempest-AttachVolumeNegativeTest-1700545160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:09:25 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [req-b9440f72-e8a5-47ca-9807-85ce7a4c5b18 req-c61fb808-fafa-4573-8e05-59e613f7111a tempest-AttachVolumeNegativeTest-1700545160 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67', 'name': 'volume-9a3345e9-17e6-4b0c-82be-04eb9765e8ef', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e2a01ccf-5828-4bbc-8c52-17cafa67b77d', 'enforce_multipath': True} {{(pid=86890) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:09:25 devstack cinder-volume[86890]: INFO cinder.volume.manager [req-b9440f72-e8a5-47ca-9807-85ce7a4c5b18 req-c61fb808-fafa-4573-8e05-59e613f7111a tempest-AttachVolumeNegativeTest-1700545160 None] attachment_update completed successfully. Nov 02 10:09:30 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-4d4d46d0-2497-4506-8717-c4cc28bb40ed tempest-VolumesNegativeTest-928408438 None] Acquiring lock "cinder-1c3f4b5c-edb8-4364-9ca2-a927705f63c9-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:09:30 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-4d4d46d0-2497-4506-8717-c4cc28bb40ed tempest-VolumesNegativeTest-928408438 None] Lock "cinder-1c3f4b5c-edb8-4364-9ca2-a927705f63c9-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:09:30 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-4d4d46d0-2497-4506-8717-c4cc28bb40ed tempest-VolumesNegativeTest-928408438 None] Acquiring lock "cinder-quobyte-1c3f4b5c-edb8-4364-9ca2-a927705f63c9" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:09:30 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-4d4d46d0-2497-4506-8717-c4cc28bb40ed tempest-VolumesNegativeTest-928408438 None] Lock "cinder-quobyte-1c3f4b5c-edb8-4364-9ca2-a927705f63c9" acquired by "delete_volume" :: waited 0.023s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:09:30 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[a202b105-52fd-4759-aa65-eff1aacd4d8d]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:09:30 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-4d4d46d0-2497-4506-8717-c4cc28bb40ed tempest-VolumesNegativeTest-928408438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-1c3f4b5c-edb8-4364-9ca2-a927705f63c9 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:30 devstack sudo[95127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-1c3f4b5c-edb8-4364-9ca2-a927705f63c9 Nov 02 10:09:30 devstack sudo[95127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:31 devstack sudo[95127]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:31 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-4d4d46d0-2497-4506-8717-c4cc28bb40ed tempest-VolumesNegativeTest-928408438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-1c3f4b5c-edb8-4364-9ca2-a927705f63c9" returned: 0 in 0.555s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:31 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-4d4d46d0-2497-4506-8717-c4cc28bb40ed tempest-VolumesNegativeTest-928408438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-1c3f4b5c-edb8-4364-9ca2-a927705f63c9 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:31 devstack sudo[95132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-1c3f4b5c-edb8-4364-9ca2-a927705f63c9 Nov 02 10:09:31 devstack sudo[95132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:31 devstack sudo[95132]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:31 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-4d4d46d0-2497-4506-8717-c4cc28bb40ed tempest-VolumesNegativeTest-928408438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-1c3f4b5c-edb8-4364-9ca2-a927705f63c9" returned: 0 in 0.407s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:31 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-4d4d46d0-2497-4506-8717-c4cc28bb40ed tempest-VolumesNegativeTest-928408438 None] Lock "cinder-quobyte-1c3f4b5c-edb8-4364-9ca2-a927705f63c9" released by "delete_volume" :: held 1.041s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:09:31 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-4d4d46d0-2497-4506-8717-c4cc28bb40ed tempest-VolumesNegativeTest-928408438 None] Created reservations ['412f8928-71eb-47b1-a385-2a774a6abd75', '20a3698a-b251-4625-b4ec-7dbf771f9b35', '5bd7319a-abcd-4630-8295-21bf66910aae', 'b0b495f8-e681-427e-9a5c-0052291c782e'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:09:31 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-4d4d46d0-2497-4506-8717-c4cc28bb40ed tempest-VolumesNegativeTest-928408438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:09:31 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-4d4d46d0-2497-4506-8717-c4cc28bb40ed tempest-VolumesNegativeTest-928408438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:09:31 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-4d4d46d0-2497-4506-8717-c4cc28bb40ed tempest-VolumesNegativeTest-928408438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:09:31 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-4d4d46d0-2497-4506-8717-c4cc28bb40ed tempest-VolumesNegativeTest-928408438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:09:31 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-4d4d46d0-2497-4506-8717-c4cc28bb40ed tempest-VolumesNegativeTest-928408438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:09:31 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-4d4d46d0-2497-4506-8717-c4cc28bb40ed tempest-VolumesNegativeTest-928408438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:31 devstack sudo[95138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:09:31 devstack sudo[95138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:32 devstack sudo[95138]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:32 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-4d4d46d0-2497-4506-8717-c4cc28bb40ed tempest-VolumesNegativeTest-928408438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.334s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:32 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-4d4d46d0-2497-4506-8717-c4cc28bb40ed tempest-VolumesNegativeTest-928408438 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:09:32 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-4d4d46d0-2497-4506-8717-c4cc28bb40ed tempest-VolumesNegativeTest-928408438 None] Deleted volume successfully. Nov 02 10:09:32 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-4d4d46d0-2497-4506-8717-c4cc28bb40ed tempest-VolumesNegativeTest-928408438 None] Lock "cinder-1c3f4b5c-edb8-4364-9ca2-a927705f63c9-delete_volume" released by "delete_volume" :: held 1.720s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:09:32 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-de41ae3e-e2d4-4ec0-96b2-1bcb88990be7 tempest-VolumesServicesTestJSON-2115271167 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:09:32 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-de41ae3e-e2d4-4ec0-96b2-1bcb88990be7 tempest-VolumesServicesTestJSON-2115271167 None] Flow 'volume_create_manager' (99b35545-df82-4eae-98f5-dc476b305e5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:09:32 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-de41ae3e-e2d4-4ec0-96b2-1bcb88990be7 tempest-VolumesServicesTestJSON-2115271167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64df840d-59f5-4fa0-a57a-c051496cc65d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:09:32 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-de41ae3e-e2d4-4ec0-96b2-1bcb88990be7 tempest-VolumesServicesTestJSON-2115271167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64df840d-59f5-4fa0-a57a-c051496cc65d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:09:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1380254770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc3bdaac-3c59-432d-8d07-901efa5c42a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75e5513019384999b6def4f3044ab65a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:09:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:09:33Z,use_quota=True,user_id='9f8ba757ef9c4ad2a6d4b364f1478808',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:09:32 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-de41ae3e-e2d4-4ec0-96b2-1bcb88990be7 tempest-VolumesServicesTestJSON-2115271167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c8189f2-cd6c-4bb6-b09e-4f6c7ef3a87c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:09:32 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-de41ae3e-e2d4-4ec0-96b2-1bcb88990be7 tempest-VolumesServicesTestJSON-2115271167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c8189f2-cd6c-4bb6-b09e-4f6c7ef3a87c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:09:32 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-de41ae3e-e2d4-4ec0-96b2-1bcb88990be7 tempest-VolumesServicesTestJSON-2115271167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7b15404-f938-4319-bab3-9394cb196b6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:09:32 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-de41ae3e-e2d4-4ec0-96b2-1bcb88990be7 tempest-VolumesServicesTestJSON-2115271167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7b15404-f938-4319-bab3-9394cb196b6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc3bdaac-3c59-432d-8d07-901efa5c42a1', 'volume_name': 'volume-dc3bdaac-3c59-432d-8d07-901efa5c42a1', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:09:32 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-de41ae3e-e2d4-4ec0-96b2-1bcb88990be7 tempest-VolumesServicesTestJSON-2115271167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7997913-6643-4191-b607-95e4b59478db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:09:32 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-de41ae3e-e2d4-4ec0-96b2-1bcb88990be7 tempest-VolumesServicesTestJSON-2115271167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7997913-6643-4191-b607-95e4b59478db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:09:32 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-de41ae3e-e2d4-4ec0-96b2-1bcb88990be7 tempest-VolumesServicesTestJSON-2115271167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1503897-df3a-4555-83a7-2d1b064fb19a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:09:32 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-de41ae3e-e2d4-4ec0-96b2-1bcb88990be7 tempest-VolumesServicesTestJSON-2115271167 None] Volume dc3bdaac-3c59-432d-8d07-901efa5c42a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc3bdaac-3c59-432d-8d07-901efa5c42a1', 'volume_size': 1} Nov 02 10:09:32 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-de41ae3e-e2d4-4ec0-96b2-1bcb88990be7 tempest-VolumesServicesTestJSON-2115271167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:09:32 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-de41ae3e-e2d4-4ec0-96b2-1bcb88990be7 tempest-VolumesServicesTestJSON-2115271167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:09:32 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-de41ae3e-e2d4-4ec0-96b2-1bcb88990be7 tempest-VolumesServicesTestJSON-2115271167 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:09:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1380254770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc3bdaac-3c59-432d-8d07-901efa5c42a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75e5513019384999b6def4f3044ab65a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:09:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:09:33Z,use_quota=True,user_id='9f8ba757ef9c4ad2a6d4b364f1478808',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:09:32 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-de41ae3e-e2d4-4ec0-96b2-1bcb88990be7 tempest-VolumesServicesTestJSON-2115271167 None] Creating volume dc3bdaac-3c59-432d-8d07-901efa5c42a1 {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:09:32 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-de41ae3e-e2d4-4ec0-96b2-1bcb88990be7 tempest-VolumesServicesTestJSON-2115271167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:09:32 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-de41ae3e-e2d4-4ec0-96b2-1bcb88990be7 tempest-VolumesServicesTestJSON-2115271167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:09:32 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-de41ae3e-e2d4-4ec0-96b2-1bcb88990be7 tempest-VolumesServicesTestJSON-2115271167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:09:32 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-de41ae3e-e2d4-4ec0-96b2-1bcb88990be7 tempest-VolumesServicesTestJSON-2115271167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:09:32 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-de41ae3e-e2d4-4ec0-96b2-1bcb88990be7 tempest-VolumesServicesTestJSON-2115271167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:09:32 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-de41ae3e-e2d4-4ec0-96b2-1bcb88990be7 tempest-VolumesServicesTestJSON-2115271167 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:09:32 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-de41ae3e-e2d4-4ec0-96b2-1bcb88990be7 tempest-VolumesServicesTestJSON-2115271167 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:09:32 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-de41ae3e-e2d4-4ec0-96b2-1bcb88990be7 tempest-VolumesServicesTestJSON-2115271167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dc3bdaac-3c59-432d-8d07-901efa5c42a1 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:32 devstack sudo[95144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dc3bdaac-3c59-432d-8d07-901efa5c42a1 1073741824 Nov 02 10:09:32 devstack sudo[95144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:33 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c319201-3a34-4711-8a0b-9812dc8ad774 tempest-AttachVolumeShelveTestJSON-1576967688 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:09:33 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-3c319201-3a34-4711-8a0b-9812dc8ad774 tempest-AttachVolumeShelveTestJSON-1576967688 None] Flow 'volume_create_manager' (be6f8cc3-7d69-4bc1-8b61-70459deba78e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:09:33 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-3c319201-3a34-4711-8a0b-9812dc8ad774 tempest-AttachVolumeShelveTestJSON-1576967688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab611a62-b97f-4fb6-88a1-480041763a89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:09:33 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-3c319201-3a34-4711-8a0b-9812dc8ad774 tempest-AttachVolumeShelveTestJSON-1576967688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab611a62-b97f-4fb6-88a1-480041763a89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:09:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1539164297',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f4fa2b4-7f36-4a3e-94c6-3de8ecad679e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4620333538734026bd8a191cd104ccc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:09:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:09:33Z,use_quota=True,user_id='b6c59a69389f4de1b5fec7a6e9b06ba4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:09:33 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-3c319201-3a34-4711-8a0b-9812dc8ad774 tempest-AttachVolumeShelveTestJSON-1576967688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09efa07a-77ad-4914-a9c7-a1920353b69b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:09:33 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-3c319201-3a34-4711-8a0b-9812dc8ad774 tempest-AttachVolumeShelveTestJSON-1576967688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09efa07a-77ad-4914-a9c7-a1920353b69b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:09:33 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-3c319201-3a34-4711-8a0b-9812dc8ad774 tempest-AttachVolumeShelveTestJSON-1576967688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53d8c760-a6a9-49ab-a46b-2f15e8850d1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:09:33 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-3c319201-3a34-4711-8a0b-9812dc8ad774 tempest-AttachVolumeShelveTestJSON-1576967688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53d8c760-a6a9-49ab-a46b-2f15e8850d1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f4fa2b4-7f36-4a3e-94c6-3de8ecad679e', 'volume_name': 'volume-2f4fa2b4-7f36-4a3e-94c6-3de8ecad679e', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:09:33 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-3c319201-3a34-4711-8a0b-9812dc8ad774 tempest-AttachVolumeShelveTestJSON-1576967688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1378923f-bc0a-45bd-97e8-380b79d827d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:09:33 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-3c319201-3a34-4711-8a0b-9812dc8ad774 tempest-AttachVolumeShelveTestJSON-1576967688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1378923f-bc0a-45bd-97e8-380b79d827d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:09:33 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-3c319201-3a34-4711-8a0b-9812dc8ad774 tempest-AttachVolumeShelveTestJSON-1576967688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a367b8f-1b26-46c3-bae9-555bcc30ac79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:09:33 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-3c319201-3a34-4711-8a0b-9812dc8ad774 tempest-AttachVolumeShelveTestJSON-1576967688 None] Volume 2f4fa2b4-7f36-4a3e-94c6-3de8ecad679e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f4fa2b4-7f36-4a3e-94c6-3de8ecad679e', 'volume_size': 1} Nov 02 10:09:33 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-3c319201-3a34-4711-8a0b-9812dc8ad774 tempest-AttachVolumeShelveTestJSON-1576967688 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:09:33 devstack sudo[95144]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:33 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-de41ae3e-e2d4-4ec0-96b2-1bcb88990be7 tempest-VolumesServicesTestJSON-2115271167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dc3bdaac-3c59-432d-8d07-901efa5c42a1 1073741824" returned: 0 in 0.754s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:33 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-de41ae3e-e2d4-4ec0-96b2-1bcb88990be7 tempest-VolumesServicesTestJSON-2115271167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dc3bdaac-3c59-432d-8d07-901efa5c42a1 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:33 devstack sudo[95155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dc3bdaac-3c59-432d-8d07-901efa5c42a1 Nov 02 10:09:33 devstack sudo[95155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:34 devstack sudo[95155]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-de41ae3e-e2d4-4ec0-96b2-1bcb88990be7 tempest-VolumesServicesTestJSON-2115271167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dc3bdaac-3c59-432d-8d07-901efa5c42a1" returned: 0 in 0.453s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:34 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-de41ae3e-e2d4-4ec0-96b2-1bcb88990be7 tempest-VolumesServicesTestJSON-2115271167 None] <== create_volume: return (1291ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:09:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-de41ae3e-e2d4-4ec0-96b2-1bcb88990be7 tempest-VolumesServicesTestJSON-2115271167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.294s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:09:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-3c319201-3a34-4711-8a0b-9812dc8ad774 tempest-AttachVolumeShelveTestJSON-1576967688 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.846s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:09:34 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-3c319201-3a34-4711-8a0b-9812dc8ad774 tempest-AttachVolumeShelveTestJSON-1576967688 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:09:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1539164297',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f4fa2b4-7f36-4a3e-94c6-3de8ecad679e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4620333538734026bd8a191cd104ccc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:09:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:09:33Z,use_quota=True,user_id='b6c59a69389f4de1b5fec7a6e9b06ba4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:09:34 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-3c319201-3a34-4711-8a0b-9812dc8ad774 tempest-AttachVolumeShelveTestJSON-1576967688 None] Creating volume 2f4fa2b4-7f36-4a3e-94c6-3de8ecad679e {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:09:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-3c319201-3a34-4711-8a0b-9812dc8ad774 tempest-AttachVolumeShelveTestJSON-1576967688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:09:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-3c319201-3a34-4711-8a0b-9812dc8ad774 tempest-AttachVolumeShelveTestJSON-1576967688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:09:34 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-3c319201-3a34-4711-8a0b-9812dc8ad774 tempest-AttachVolumeShelveTestJSON-1576967688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:09:34 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-3c319201-3a34-4711-8a0b-9812dc8ad774 tempest-AttachVolumeShelveTestJSON-1576967688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:09:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-3c319201-3a34-4711-8a0b-9812dc8ad774 tempest-AttachVolumeShelveTestJSON-1576967688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:09:34 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-3c319201-3a34-4711-8a0b-9812dc8ad774 tempest-AttachVolumeShelveTestJSON-1576967688 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:09:34 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-3c319201-3a34-4711-8a0b-9812dc8ad774 tempest-AttachVolumeShelveTestJSON-1576967688 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:09:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-3c319201-3a34-4711-8a0b-9812dc8ad774 tempest-AttachVolumeShelveTestJSON-1576967688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-2f4fa2b4-7f36-4a3e-94c6-3de8ecad679e 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:34 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-de41ae3e-e2d4-4ec0-96b2-1bcb88990be7 tempest-VolumesServicesTestJSON-2115271167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1503897-df3a-4555-83a7-2d1b064fb19a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc3bdaac-3c59-432d-8d07-901efa5c42a1', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:09:34 devstack sudo[95167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-2f4fa2b4-7f36-4a3e-94c6-3de8ecad679e 1073741824 Nov 02 10:09:34 devstack sudo[95167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:34 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-de41ae3e-e2d4-4ec0-96b2-1bcb88990be7 tempest-VolumesServicesTestJSON-2115271167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99f168f6-7b26-484e-ba78-aab76257e842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:09:34 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-de41ae3e-e2d4-4ec0-96b2-1bcb88990be7 tempest-VolumesServicesTestJSON-2115271167 None] Volume volume-dc3bdaac-3c59-432d-8d07-901efa5c42a1 (dc3bdaac-3c59-432d-8d07-901efa5c42a1): created successfully Nov 02 10:09:34 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-de41ae3e-e2d4-4ec0-96b2-1bcb88990be7 tempest-VolumesServicesTestJSON-2115271167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99f168f6-7b26-484e-ba78-aab76257e842) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:09:34 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-de41ae3e-e2d4-4ec0-96b2-1bcb88990be7 tempest-VolumesServicesTestJSON-2115271167 None] Flow 'volume_create_manager' (99b35545-df82-4eae-98f5-dc476b305e5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:09:34 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-de41ae3e-e2d4-4ec0-96b2-1bcb88990be7 tempest-VolumesServicesTestJSON-2115271167 None] Created volume successfully. Nov 02 10:09:34 devstack cinder-volume[86890]: DEBUG oslo_service.periodic_task [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86890) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:09:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:09:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:09:34 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:09:34 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:09:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:09:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:34 devstack sudo[95175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:09:34 devstack sudo[95175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:34 devstack sudo[95167]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-3c319201-3a34-4711-8a0b-9812dc8ad774 tempest-AttachVolumeShelveTestJSON-1576967688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-2f4fa2b4-7f36-4a3e-94c6-3de8ecad679e 1073741824" returned: 0 in 0.702s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:34 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-b0efd642-5a56-4bab-8718-a330a2619a78 tempest-VolumesServicesTestJSON-2115271167 None] Acquiring lock "cinder-dc3bdaac-3c59-432d-8d07-901efa5c42a1-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:09:35 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-b0efd642-5a56-4bab-8718-a330a2619a78 tempest-VolumesServicesTestJSON-2115271167 None] Lock "cinder-dc3bdaac-3c59-432d-8d07-901efa5c42a1-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:09:35 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-3c319201-3a34-4711-8a0b-9812dc8ad774 tempest-AttachVolumeShelveTestJSON-1576967688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-2f4fa2b4-7f36-4a3e-94c6-3de8ecad679e {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:35 devstack sudo[95177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-2f4fa2b4-7f36-4a3e-94c6-3de8ecad679e Nov 02 10:09:35 devstack sudo[95177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:35 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-b0efd642-5a56-4bab-8718-a330a2619a78 tempest-VolumesServicesTestJSON-2115271167 None] Acquiring lock "cinder-quobyte-dc3bdaac-3c59-432d-8d07-901efa5c42a1" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:09:35 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-b0efd642-5a56-4bab-8718-a330a2619a78 tempest-VolumesServicesTestJSON-2115271167 None] Lock "cinder-quobyte-dc3bdaac-3c59-432d-8d07-901efa5c42a1" acquired by "delete_volume" :: waited 0.040s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:09:35 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[9601389a-71e7-46b6-b361-1896df1dfadf]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:09:35 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-b0efd642-5a56-4bab-8718-a330a2619a78 tempest-VolumesServicesTestJSON-2115271167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dc3bdaac-3c59-432d-8d07-901efa5c42a1 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:35 devstack sudo[95175]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:35 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.463s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:35 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:09:35 devstack sudo[95180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dc3bdaac-3c59-432d-8d07-901efa5c42a1 Nov 02 10:09:35 devstack sudo[95180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:35 devstack sudo[95177]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:35 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-3c319201-3a34-4711-8a0b-9812dc8ad774 tempest-AttachVolumeShelveTestJSON-1576967688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-2f4fa2b4-7f36-4a3e-94c6-3de8ecad679e" returned: 0 in 0.438s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:35 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-3c319201-3a34-4711-8a0b-9812dc8ad774 tempest-AttachVolumeShelveTestJSON-1576967688 None] <== create_volume: return (1241ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:09:35 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-3c319201-3a34-4711-8a0b-9812dc8ad774 tempest-AttachVolumeShelveTestJSON-1576967688 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.246s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:09:35 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-3c319201-3a34-4711-8a0b-9812dc8ad774 tempest-AttachVolumeShelveTestJSON-1576967688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a367b8f-1b26-46c3-bae9-555bcc30ac79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f4fa2b4-7f36-4a3e-94c6-3de8ecad679e', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:09:35 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-3c319201-3a34-4711-8a0b-9812dc8ad774 tempest-AttachVolumeShelveTestJSON-1576967688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7065470c-c1d3-4439-b230-e4bc59da5b79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:09:35 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-3c319201-3a34-4711-8a0b-9812dc8ad774 tempest-AttachVolumeShelveTestJSON-1576967688 None] Volume volume-2f4fa2b4-7f36-4a3e-94c6-3de8ecad679e (2f4fa2b4-7f36-4a3e-94c6-3de8ecad679e): created successfully Nov 02 10:09:35 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-3c319201-3a34-4711-8a0b-9812dc8ad774 tempest-AttachVolumeShelveTestJSON-1576967688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7065470c-c1d3-4439-b230-e4bc59da5b79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:09:35 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-3c319201-3a34-4711-8a0b-9812dc8ad774 tempest-AttachVolumeShelveTestJSON-1576967688 None] Flow 'volume_create_manager' (be6f8cc3-7d69-4bc1-8b61-70459deba78e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:09:35 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-3c319201-3a34-4711-8a0b-9812dc8ad774 tempest-AttachVolumeShelveTestJSON-1576967688 None] Created volume successfully. Nov 02 10:09:35 devstack sudo[95180]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:35 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-b0efd642-5a56-4bab-8718-a330a2619a78 tempest-VolumesServicesTestJSON-2115271167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dc3bdaac-3c59-432d-8d07-901efa5c42a1" returned: 0 in 0.527s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:35 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-b0efd642-5a56-4bab-8718-a330a2619a78 tempest-VolumesServicesTestJSON-2115271167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dc3bdaac-3c59-432d-8d07-901efa5c42a1 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:35 devstack sudo[95187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dc3bdaac-3c59-432d-8d07-901efa5c42a1 Nov 02 10:09:35 devstack sudo[95187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:36 devstack sudo[95187]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:36 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-b0efd642-5a56-4bab-8718-a330a2619a78 tempest-VolumesServicesTestJSON-2115271167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dc3bdaac-3c59-432d-8d07-901efa5c42a1" returned: 0 in 0.298s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:36 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-b0efd642-5a56-4bab-8718-a330a2619a78 tempest-VolumesServicesTestJSON-2115271167 None] Lock "cinder-quobyte-dc3bdaac-3c59-432d-8d07-901efa5c42a1" released by "delete_volume" :: held 0.905s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:09:36 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-b0efd642-5a56-4bab-8718-a330a2619a78 tempest-VolumesServicesTestJSON-2115271167 None] Created reservations ['80f4b5b7-9775-4f04-9c93-34707ed90c08', '58bae608-dbe9-4430-b009-80b3e447505d', '0775abd7-9595-4273-a16a-3cc10a8d2124', 'e68638a7-490f-4896-b59e-b1eee5897404'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:09:36 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-b0efd642-5a56-4bab-8718-a330a2619a78 tempest-VolumesServicesTestJSON-2115271167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:09:36 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-b0efd642-5a56-4bab-8718-a330a2619a78 tempest-VolumesServicesTestJSON-2115271167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:09:36 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-b0efd642-5a56-4bab-8718-a330a2619a78 tempest-VolumesServicesTestJSON-2115271167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:09:36 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-b0efd642-5a56-4bab-8718-a330a2619a78 tempest-VolumesServicesTestJSON-2115271167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:09:36 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-b0efd642-5a56-4bab-8718-a330a2619a78 tempest-VolumesServicesTestJSON-2115271167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:09:36 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-b0efd642-5a56-4bab-8718-a330a2619a78 tempest-VolumesServicesTestJSON-2115271167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:36 devstack sudo[95191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:09:36 devstack sudo[95191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:36 devstack sudo[95191]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:36 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-b0efd642-5a56-4bab-8718-a330a2619a78 tempest-VolumesServicesTestJSON-2115271167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.317s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:36 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-b0efd642-5a56-4bab-8718-a330a2619a78 tempest-VolumesServicesTestJSON-2115271167 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:09:36 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-b0efd642-5a56-4bab-8718-a330a2619a78 tempest-VolumesServicesTestJSON-2115271167 None] Deleted volume successfully. Nov 02 10:09:36 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-b0efd642-5a56-4bab-8718-a330a2619a78 tempest-VolumesServicesTestJSON-2115271167 None] Lock "cinder-dc3bdaac-3c59-432d-8d07-901efa5c42a1-delete_volume" released by "delete_volume" :: held 1.651s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:09:46 devstack cinder-volume[86890]: DEBUG dbcounter [-] [86890] Writing DB stats cinder:UPDATE=30,cinder:SELECT=23,cinder:INSERT=5,cinder:DELETE=2 {{(pid=86890) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:09:46 devstack cinder-volume[86890]: DEBUG dbcounter [-] [86890] Writing DB stats cinder:SELECT=22,cinder:UPDATE=23,cinder:INSERT=6,cinder:DELETE=3 {{(pid=86890) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:09:49 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ab7edc6-0ab3-42cd-ae91-260de9b576f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-523833793 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:09:49 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-2ab7edc6-0ab3-42cd-ae91-260de9b576f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-523833793 None] Flow 'volume_create_manager' (48a51c70-fa1b-4dd2-b37b-bc63feabd4c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:09:49 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-2ab7edc6-0ab3-42cd-ae91-260de9b576f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-523833793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (982768c9-5666-4137-afd0-2cda8fee9015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:09:49 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-2ab7edc6-0ab3-42cd-ae91-260de9b576f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-523833793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (982768c9-5666-4137-afd0-2cda8fee9015) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:09:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1020037783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4ec66c6-8926-4e8a-83be-94b482aef160,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3061c02be474626b4467d2c506beee8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:09:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:09:49Z,use_quota=True,user_id='bd0e9c1a15cd407c9f1c9ef0ab3b9605',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:09:49 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-2ab7edc6-0ab3-42cd-ae91-260de9b576f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-523833793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80517cd7-23f1-4166-8bd8-3b986b86d218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:09:49 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-2ab7edc6-0ab3-42cd-ae91-260de9b576f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-523833793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80517cd7-23f1-4166-8bd8-3b986b86d218) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:09:49 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-2ab7edc6-0ab3-42cd-ae91-260de9b576f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-523833793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6ea3ccb-a0bf-4bff-b419-51afbb485897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:09:49 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-2ab7edc6-0ab3-42cd-ae91-260de9b576f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-523833793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6ea3ccb-a0bf-4bff-b419-51afbb485897) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4ec66c6-8926-4e8a-83be-94b482aef160', 'volume_name': 'volume-e4ec66c6-8926-4e8a-83be-94b482aef160', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:09:49 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-2ab7edc6-0ab3-42cd-ae91-260de9b576f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-523833793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b691b672-703f-4dbb-9265-825f5a7a7760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:09:49 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-2ab7edc6-0ab3-42cd-ae91-260de9b576f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-523833793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b691b672-703f-4dbb-9265-825f5a7a7760) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:09:49 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-2ab7edc6-0ab3-42cd-ae91-260de9b576f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-523833793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72dcbfa4-761d-4eec-b079-7460cd161a14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:09:49 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-2ab7edc6-0ab3-42cd-ae91-260de9b576f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-523833793 None] Volume e4ec66c6-8926-4e8a-83be-94b482aef160: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4ec66c6-8926-4e8a-83be-94b482aef160', 'volume_size': 1} Nov 02 10:09:49 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-2ab7edc6-0ab3-42cd-ae91-260de9b576f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-523833793 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:09:49 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-2ab7edc6-0ab3-42cd-ae91-260de9b576f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-523833793 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:09:49 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-2ab7edc6-0ab3-42cd-ae91-260de9b576f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-523833793 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:09:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1020037783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4ec66c6-8926-4e8a-83be-94b482aef160,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3061c02be474626b4467d2c506beee8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:09:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:09:49Z,use_quota=True,user_id='bd0e9c1a15cd407c9f1c9ef0ab3b9605',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:09:49 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-2ab7edc6-0ab3-42cd-ae91-260de9b576f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-523833793 None] Creating volume e4ec66c6-8926-4e8a-83be-94b482aef160 {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:09:49 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-2ab7edc6-0ab3-42cd-ae91-260de9b576f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-523833793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:09:49 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-2ab7edc6-0ab3-42cd-ae91-260de9b576f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-523833793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:09:49 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-2ab7edc6-0ab3-42cd-ae91-260de9b576f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-523833793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:09:49 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-2ab7edc6-0ab3-42cd-ae91-260de9b576f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-523833793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:09:49 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-2ab7edc6-0ab3-42cd-ae91-260de9b576f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-523833793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:09:49 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-2ab7edc6-0ab3-42cd-ae91-260de9b576f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-523833793 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:09:49 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-2ab7edc6-0ab3-42cd-ae91-260de9b576f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-523833793 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:09:49 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-2ab7edc6-0ab3-42cd-ae91-260de9b576f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-523833793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e4ec66c6-8926-4e8a-83be-94b482aef160 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:50 devstack sudo[95297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e4ec66c6-8926-4e8a-83be-94b482aef160 1073741824 Nov 02 10:09:50 devstack sudo[95297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:50 devstack sudo[95297]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:50 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-2ab7edc6-0ab3-42cd-ae91-260de9b576f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-523833793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e4ec66c6-8926-4e8a-83be-94b482aef160 1073741824" returned: 0 in 0.880s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:50 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-2ab7edc6-0ab3-42cd-ae91-260de9b576f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-523833793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e4ec66c6-8926-4e8a-83be-94b482aef160 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:50 devstack sudo[95308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e4ec66c6-8926-4e8a-83be-94b482aef160 Nov 02 10:09:50 devstack sudo[95308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:51 devstack sudo[95308]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:51 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-2ab7edc6-0ab3-42cd-ae91-260de9b576f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-523833793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e4ec66c6-8926-4e8a-83be-94b482aef160" returned: 0 in 0.481s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:51 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-2ab7edc6-0ab3-42cd-ae91-260de9b576f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-523833793 None] <== create_volume: return (1441ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:09:51 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-2ab7edc6-0ab3-42cd-ae91-260de9b576f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-523833793 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.459s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:09:51 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-2ab7edc6-0ab3-42cd-ae91-260de9b576f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-523833793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72dcbfa4-761d-4eec-b079-7460cd161a14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4ec66c6-8926-4e8a-83be-94b482aef160', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:09:51 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-2ab7edc6-0ab3-42cd-ae91-260de9b576f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-523833793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48337585-0211-4fd1-98ca-6b42f4823b39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:09:51 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-2ab7edc6-0ab3-42cd-ae91-260de9b576f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-523833793 None] Volume volume-e4ec66c6-8926-4e8a-83be-94b482aef160 (e4ec66c6-8926-4e8a-83be-94b482aef160): created successfully Nov 02 10:09:51 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-2ab7edc6-0ab3-42cd-ae91-260de9b576f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-523833793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48337585-0211-4fd1-98ca-6b42f4823b39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:09:51 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-2ab7edc6-0ab3-42cd-ae91-260de9b576f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-523833793 None] Flow 'volume_create_manager' (48a51c70-fa1b-4dd2-b37b-bc63feabd4c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:09:51 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-2ab7edc6-0ab3-42cd-ae91-260de9b576f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-523833793 None] Created volume successfully. Nov 02 10:09:52 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-5f03a4c0-2426-4e59-ad68-16a35c0b303d tempest-VolumeSnapshotQuotasNegativeTestJSON-523833793 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:09:52 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-5f03a4c0-2426-4e59-ad68-16a35c0b303d tempest-VolumeSnapshotQuotasNegativeTestJSON-523833793 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:09:52 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-5f03a4c0-2426-4e59-ad68-16a35c0b303d tempest-VolumeSnapshotQuotasNegativeTestJSON-523833793 None] Creating offline snapshot 317a887f-63c2-4922-b572-f4e15a9a88ec of volume e4ec66c6-8926-4e8a-83be-94b482aef160 {{(pid=86890) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:09:52 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce801d7f-8964-4ecc-97be-6fbd360ddb9f]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:09:52 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-5f03a4c0-2426-4e59-ad68-16a35c0b303d tempest-VolumeSnapshotQuotasNegativeTestJSON-523833793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e4ec66c6-8926-4e8a-83be-94b482aef160 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:52 devstack sudo[95311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e4ec66c6-8926-4e8a-83be-94b482aef160 Nov 02 10:09:52 devstack sudo[95311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:52 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [req-573b09b0-9fc3-4b5a-8ce3-de78a25788d5 req-d14933d8-28cb-4339-9117-08ca290ecc6e tempest-AttachVolumeShelveTestJSON-1576967688 None] No connector for attachment 36938041-cd3b-4b99-8f9c-75690eeddf5c; skipping storage backend terminate_connection call. {{(pid=86890) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Nov 02 10:09:52 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [req-573b09b0-9fc3-4b5a-8ce3-de78a25788d5 req-d14933d8-28cb-4339-9117-08ca290ecc6e tempest-AttachVolumeShelveTestJSON-1576967688 None] Deleting attachment 36938041-cd3b-4b99-8f9c-75690eeddf5c. {{(pid=86890) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:09:52 devstack sudo[95311]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:52 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-5f03a4c0-2426-4e59-ad68-16a35c0b303d tempest-VolumeSnapshotQuotasNegativeTestJSON-523833793 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e4ec66c6-8926-4e8a-83be-94b482aef160" returned: 0 in 0.613s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:52 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-5f03a4c0-2426-4e59-ad68-16a35c0b303d tempest-VolumeSnapshotQuotasNegativeTestJSON-523833793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e4ec66c6-8926-4e8a-83be-94b482aef160,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e4ec66c6-8926-4e8a-83be-94b482aef160.317a887f-63c2-4922-b572-f4e15a9a88ec 1G {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:52 devstack sudo[95340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e4ec66c6-8926-4e8a-83be-94b482aef160,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e4ec66c6-8926-4e8a-83be-94b482aef160.317a887f-63c2-4922-b572-f4e15a9a88ec 1G Nov 02 10:09:52 devstack sudo[95340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:53 devstack sudo[95340]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:53 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-5f03a4c0-2426-4e59-ad68-16a35c0b303d tempest-VolumeSnapshotQuotasNegativeTestJSON-523833793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e4ec66c6-8926-4e8a-83be-94b482aef160,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e4ec66c6-8926-4e8a-83be-94b482aef160.317a887f-63c2-4922-b572-f4e15a9a88ec 1G" returned: 0 in 0.640s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:53 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-5f03a4c0-2426-4e59-ad68-16a35c0b303d tempest-VolumeSnapshotQuotasNegativeTestJSON-523833793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4ec66c6-8926-4e8a-83be-94b482aef160 -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e4ec66c6-8926-4e8a-83be-94b482aef160.317a887f-63c2-4922-b572-f4e15a9a88ec {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:53 devstack sudo[95348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4ec66c6-8926-4e8a-83be-94b482aef160 -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e4ec66c6-8926-4e8a-83be-94b482aef160.317a887f-63c2-4922-b572-f4e15a9a88ec Nov 02 10:09:53 devstack sudo[95348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:53 devstack sudo[95348]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:53 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-5f03a4c0-2426-4e59-ad68-16a35c0b303d tempest-VolumeSnapshotQuotasNegativeTestJSON-523833793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4ec66c6-8926-4e8a-83be-94b482aef160 -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e4ec66c6-8926-4e8a-83be-94b482aef160.317a887f-63c2-4922-b572-f4e15a9a88ec" returned: 0 in 0.399s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:53 devstack cinder-volume[86890]: WARNING cinder.volume.drivers.remotefs [None req-5f03a4c0-2426-4e59-ad68-16a35c0b303d tempest-VolumeSnapshotQuotasNegativeTestJSON-523833793 None] /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e4ec66c6-8926-4e8a-83be-94b482aef160.317a887f-63c2-4922-b572-f4e15a9a88ec is being set with open permissions: ugo+rw Nov 02 10:09:53 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-5f03a4c0-2426-4e59-ad68-16a35c0b303d tempest-VolumeSnapshotQuotasNegativeTestJSON-523833793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e4ec66c6-8926-4e8a-83be-94b482aef160.317a887f-63c2-4922-b572-f4e15a9a88ec {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:53 devstack sudo[95355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e4ec66c6-8926-4e8a-83be-94b482aef160.317a887f-63c2-4922-b572-f4e15a9a88ec Nov 02 10:09:53 devstack sudo[95355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:54 devstack sudo[95355]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:54 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-5f03a4c0-2426-4e59-ad68-16a35c0b303d tempest-VolumeSnapshotQuotasNegativeTestJSON-523833793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e4ec66c6-8926-4e8a-83be-94b482aef160.317a887f-63c2-4922-b572-f4e15a9a88ec" returned: 0 in 0.312s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:54 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-5f03a4c0-2426-4e59-ad68-16a35c0b303d tempest-VolumeSnapshotQuotasNegativeTestJSON-523833793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e4ec66c6-8926-4e8a-83be-94b482aef160.info {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:54 devstack sudo[95358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e4ec66c6-8926-4e8a-83be-94b482aef160.info Nov 02 10:09:54 devstack sudo[95358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:54 devstack sudo[95358]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:54 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-5f03a4c0-2426-4e59-ad68-16a35c0b303d tempest-VolumeSnapshotQuotasNegativeTestJSON-523833793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e4ec66c6-8926-4e8a-83be-94b482aef160.info" returned: 0 in 0.425s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:54 devstack cinder-volume[86890]: WARNING cinder.volume.drivers.remotefs [None req-5f03a4c0-2426-4e59-ad68-16a35c0b303d tempest-VolumeSnapshotQuotasNegativeTestJSON-523833793 None] /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e4ec66c6-8926-4e8a-83be-94b482aef160.info is being set with open permissions: ugo+rw Nov 02 10:09:54 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-5f03a4c0-2426-4e59-ad68-16a35c0b303d tempest-VolumeSnapshotQuotasNegativeTestJSON-523833793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e4ec66c6-8926-4e8a-83be-94b482aef160.info {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:54 devstack sudo[95361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e4ec66c6-8926-4e8a-83be-94b482aef160.info Nov 02 10:09:54 devstack sudo[95361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:55 devstack sudo[95361]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:55 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-5f03a4c0-2426-4e59-ad68-16a35c0b303d tempest-VolumeSnapshotQuotasNegativeTestJSON-523833793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e4ec66c6-8926-4e8a-83be-94b482aef160.info" returned: 0 in 0.466s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:55 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-5f03a4c0-2426-4e59-ad68-16a35c0b303d tempest-VolumeSnapshotQuotasNegativeTestJSON-523833793 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.986s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:09:55 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-5f03a4c0-2426-4e59-ad68-16a35c0b303d tempest-VolumeSnapshotQuotasNegativeTestJSON-523833793 None] Create snapshot completed successfully Nov 02 10:09:56 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-7a8e0395-2736-47e2-adce-9180967cb013 tempest-VolumeSnapshotQuotasNegativeTestJSON-523833793 None] Acquiring lock "cinder-317a887f-63c2-4922-b572-f4e15a9a88ec-delete_snapshot" by "delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:09:56 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-7a8e0395-2736-47e2-adce-9180967cb013 tempest-VolumeSnapshotQuotasNegativeTestJSON-523833793 None] Lock "cinder-317a887f-63c2-4922-b572-f4e15a9a88ec-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:09:56 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-7a8e0395-2736-47e2-adce-9180967cb013 tempest-VolumeSnapshotQuotasNegativeTestJSON-523833793 None] Acquiring lock "cinder-quobyte-e4ec66c6-8926-4e8a-83be-94b482aef160" by "delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:09:56 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-7a8e0395-2736-47e2-adce-9180967cb013 tempest-VolumeSnapshotQuotasNegativeTestJSON-523833793 None] Lock "cinder-quobyte-e4ec66c6-8926-4e8a-83be-94b482aef160" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:09:56 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-7a8e0395-2736-47e2-adce-9180967cb013 tempest-VolumeSnapshotQuotasNegativeTestJSON-523833793 None] Acquiring lock "cinder-quobyte-317a887f-63c2-4922-b572-f4e15a9a88ec" by "_delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:09:56 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-7a8e0395-2736-47e2-adce-9180967cb013 tempest-VolumeSnapshotQuotasNegativeTestJSON-523833793 None] Lock "cinder-quobyte-317a887f-63c2-4922-b572-f4e15a9a88ec" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:09:56 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-7a8e0395-2736-47e2-adce-9180967cb013 tempest-VolumeSnapshotQuotasNegativeTestJSON-523833793 None] Deleting offline snapshot 317a887f-63c2-4922-b572-f4e15a9a88ec of volume e4ec66c6-8926-4e8a-83be-94b482aef160 {{(pid=86890) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:09:56 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-7a8e0395-2736-47e2-adce-9180967cb013 tempest-VolumeSnapshotQuotasNegativeTestJSON-523833793 None] snapshot_file for this snap is: volume-e4ec66c6-8926-4e8a-83be-94b482aef160.317a887f-63c2-4922-b572-f4e15a9a88ec {{(pid=86890) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:09:56 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[372f27e9-d8c9-4176-af34-381e33b3b422]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:09:56 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-7a8e0395-2736-47e2-adce-9180967cb013 tempest-VolumeSnapshotQuotasNegativeTestJSON-523833793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e4ec66c6-8926-4e8a-83be-94b482aef160.317a887f-63c2-4922-b572-f4e15a9a88ec {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:56 devstack sudo[95364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e4ec66c6-8926-4e8a-83be-94b482aef160.317a887f-63c2-4922-b572-f4e15a9a88ec Nov 02 10:09:56 devstack sudo[95364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:56 devstack sudo[95364]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:56 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-7a8e0395-2736-47e2-adce-9180967cb013 tempest-VolumeSnapshotQuotasNegativeTestJSON-523833793 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e4ec66c6-8926-4e8a-83be-94b482aef160.317a887f-63c2-4922-b572-f4e15a9a88ec" returned: 0 in 0.526s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:56 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-7a8e0395-2736-47e2-adce-9180967cb013 tempest-VolumeSnapshotQuotasNegativeTestJSON-523833793 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e4ec66c6-8926-4e8a-83be-94b482aef160(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86890) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:09:56 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd48bb5a-c2bf-43dd-b5c4-5e476d1e0dca]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:09:56 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-7a8e0395-2736-47e2-adce-9180967cb013 tempest-VolumeSnapshotQuotasNegativeTestJSON-523833793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e4ec66c6-8926-4e8a-83be-94b482aef160 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:56 devstack sudo[95369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e4ec66c6-8926-4e8a-83be-94b482aef160 Nov 02 10:09:56 devstack sudo[95369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:57 devstack sudo[95369]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:57 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-7a8e0395-2736-47e2-adce-9180967cb013 tempest-VolumeSnapshotQuotasNegativeTestJSON-523833793 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e4ec66c6-8926-4e8a-83be-94b482aef160" returned: 0 in 0.485s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:57 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-7a8e0395-2736-47e2-adce-9180967cb013 tempest-VolumeSnapshotQuotasNegativeTestJSON-523833793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e4ec66c6-8926-4e8a-83be-94b482aef160.317a887f-63c2-4922-b572-f4e15a9a88ec {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:57 devstack sudo[95375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e4ec66c6-8926-4e8a-83be-94b482aef160.317a887f-63c2-4922-b572-f4e15a9a88ec Nov 02 10:09:57 devstack sudo[95375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:57 devstack sudo[95375]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:57 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-7a8e0395-2736-47e2-adce-9180967cb013 tempest-VolumeSnapshotQuotasNegativeTestJSON-523833793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e4ec66c6-8926-4e8a-83be-94b482aef160.317a887f-63c2-4922-b572-f4e15a9a88ec" returned: 0 in 0.453s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:57 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-7a8e0395-2736-47e2-adce-9180967cb013 tempest-VolumeSnapshotQuotasNegativeTestJSON-523833793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e4ec66c6-8926-4e8a-83be-94b482aef160.317a887f-63c2-4922-b572-f4e15a9a88ec {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:57 devstack sudo[95381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e4ec66c6-8926-4e8a-83be-94b482aef160.317a887f-63c2-4922-b572-f4e15a9a88ec Nov 02 10:09:57 devstack sudo[95381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:58 devstack sudo[95381]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:58 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-7a8e0395-2736-47e2-adce-9180967cb013 tempest-VolumeSnapshotQuotasNegativeTestJSON-523833793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e4ec66c6-8926-4e8a-83be-94b482aef160.317a887f-63c2-4922-b572-f4e15a9a88ec" returned: 0 in 0.382s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:58 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-7a8e0395-2736-47e2-adce-9180967cb013 tempest-VolumeSnapshotQuotasNegativeTestJSON-523833793 None] Lock "cinder-quobyte-317a887f-63c2-4922-b572-f4e15a9a88ec" released by "_delete_snapshot" :: held 2.028s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:09:58 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-7a8e0395-2736-47e2-adce-9180967cb013 tempest-VolumeSnapshotQuotasNegativeTestJSON-523833793 None] Lock "cinder-quobyte-e4ec66c6-8926-4e8a-83be-94b482aef160" released by "delete_snapshot" :: held 2.075s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:09:58 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-7a8e0395-2736-47e2-adce-9180967cb013 tempest-VolumeSnapshotQuotasNegativeTestJSON-523833793 None] Created reservations ['44d37fd1-8cd6-4d98-9e90-c82361ac574d', 'a773d770-956b-4950-b538-070e3da37dea', 'c2295a3e-06c0-4d14-84df-0e6cc791c578', '5129af1e-6208-43fe-aedb-105b384d3c8d'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:09:58 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-7a8e0395-2736-47e2-adce-9180967cb013 tempest-VolumeSnapshotQuotasNegativeTestJSON-523833793 None] Delete snapshot completed successfully. Nov 02 10:09:58 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-7a8e0395-2736-47e2-adce-9180967cb013 tempest-VolumeSnapshotQuotasNegativeTestJSON-523833793 None] Lock "cinder-317a887f-63c2-4922-b572-f4e15a9a88ec-delete_snapshot" released by "delete_snapshot" :: held 2.308s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:09:59 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-ce003945-563d-428b-b796-6c19de6db8f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-523833793 None] Acquiring lock "cinder-e4ec66c6-8926-4e8a-83be-94b482aef160-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:09:59 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-ce003945-563d-428b-b796-6c19de6db8f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-523833793 None] Lock "cinder-e4ec66c6-8926-4e8a-83be-94b482aef160-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:09:59 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-ce003945-563d-428b-b796-6c19de6db8f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-523833793 None] Acquiring lock "cinder-quobyte-e4ec66c6-8926-4e8a-83be-94b482aef160" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:09:59 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-ce003945-563d-428b-b796-6c19de6db8f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-523833793 None] Lock "cinder-quobyte-e4ec66c6-8926-4e8a-83be-94b482aef160" acquired by "delete_volume" :: waited 0.019s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:09:59 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[f57f449a-2f30-4d5d-9215-acf0410bc8a3]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:09:59 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ce003945-563d-428b-b796-6c19de6db8f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-523833793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e4ec66c6-8926-4e8a-83be-94b482aef160 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:59 devstack sudo[95384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e4ec66c6-8926-4e8a-83be-94b482aef160 Nov 02 10:09:59 devstack sudo[95384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:00 devstack sudo[95384]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:00 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ce003945-563d-428b-b796-6c19de6db8f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-523833793 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e4ec66c6-8926-4e8a-83be-94b482aef160" returned: 0 in 0.615s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:00 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ce003945-563d-428b-b796-6c19de6db8f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-523833793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e4ec66c6-8926-4e8a-83be-94b482aef160 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:00 devstack sudo[95399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e4ec66c6-8926-4e8a-83be-94b482aef160 Nov 02 10:10:00 devstack sudo[95399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:00 devstack sudo[95399]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:00 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ce003945-563d-428b-b796-6c19de6db8f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-523833793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e4ec66c6-8926-4e8a-83be-94b482aef160" returned: 0 in 0.331s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:00 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-ce003945-563d-428b-b796-6c19de6db8f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-523833793 None] Lock "cinder-quobyte-e4ec66c6-8926-4e8a-83be-94b482aef160" released by "delete_volume" :: held 1.061s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:10:00 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-ce003945-563d-428b-b796-6c19de6db8f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-523833793 None] Created reservations ['eef6a63c-a673-4171-9add-09a3e18553ff', '03bf45f0-8961-41a9-9a3c-ee5a86172c24', '79732901-0ee8-474d-819f-1f1cd735e75a', '1288e2e8-5346-4a26-aecc-4a10811ea36d'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:10:00 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-ce003945-563d-428b-b796-6c19de6db8f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-523833793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:10:00 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-ce003945-563d-428b-b796-6c19de6db8f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-523833793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:10:00 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-ce003945-563d-428b-b796-6c19de6db8f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-523833793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:10:00 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-ce003945-563d-428b-b796-6c19de6db8f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-523833793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:10:00 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-ce003945-563d-428b-b796-6c19de6db8f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-523833793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:10:00 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ce003945-563d-428b-b796-6c19de6db8f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-523833793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:00 devstack sudo[95409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:10:00 devstack sudo[95409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:01 devstack sudo[95409]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:01 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ce003945-563d-428b-b796-6c19de6db8f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-523833793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.317s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:01 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-ce003945-563d-428b-b796-6c19de6db8f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-523833793 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:10:01 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-ce003945-563d-428b-b796-6c19de6db8f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-523833793 None] Deleted volume successfully. Nov 02 10:10:01 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-ce003945-563d-428b-b796-6c19de6db8f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-523833793 None] Lock "cinder-e4ec66c6-8926-4e8a-83be-94b482aef160-delete_volume" released by "delete_volume" :: held 1.739s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:10:10 devstack cinder-volume[86890]: DEBUG dbcounter [-] [86890] Writing DB stats cinder:SELECT=18,cinder:UPDATE=16,cinder:INSERT=5,cinder:DELETE=1 {{(pid=86890) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:10:11 devstack cinder-volume[86890]: DEBUG dbcounter [-] [86890] Writing DB stats cinder:UPDATE=20,cinder:SELECT=16,cinder:DELETE=2,cinder:INSERT=5 {{(pid=86890) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:10:15 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0d2590c-19b0-4987-90c9-6e666210683e tempest-VolumesListAdminTestJSON-117195144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:10:15 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c0d2590c-19b0-4987-90c9-6e666210683e tempest-VolumesListAdminTestJSON-117195144 None] Flow 'volume_create_manager' (230862af-4ec3-4d19-b565-48f72c590795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:10:15 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c0d2590c-19b0-4987-90c9-6e666210683e tempest-VolumesListAdminTestJSON-117195144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00e614cd-807f-40bd-90ff-80328ecbd91e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:10:15 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c0d2590c-19b0-4987-90c9-6e666210683e tempest-VolumesListAdminTestJSON-117195144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00e614cd-807f-40bd-90ff-80328ecbd91e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:10:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-991733171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66b416ec-a967-47cb-82ae-f018725c15aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ef7b114fb7a441987dac549736557cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:10:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:10:16Z,use_quota=True,user_id='a7b3f9b058824d198d1df482746a3a36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:10:15 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c0d2590c-19b0-4987-90c9-6e666210683e tempest-VolumesListAdminTestJSON-117195144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cb5c13a-2b8f-4314-a8af-bd1b94aff7e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:10:15 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c0d2590c-19b0-4987-90c9-6e666210683e tempest-VolumesListAdminTestJSON-117195144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cb5c13a-2b8f-4314-a8af-bd1b94aff7e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:10:15 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c0d2590c-19b0-4987-90c9-6e666210683e tempest-VolumesListAdminTestJSON-117195144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (824dd2ed-a799-4eeb-8439-49e61902f318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:10:15 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c0d2590c-19b0-4987-90c9-6e666210683e tempest-VolumesListAdminTestJSON-117195144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (824dd2ed-a799-4eeb-8439-49e61902f318) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66b416ec-a967-47cb-82ae-f018725c15aa', 'volume_name': 'volume-66b416ec-a967-47cb-82ae-f018725c15aa', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:10:15 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c0d2590c-19b0-4987-90c9-6e666210683e tempest-VolumesListAdminTestJSON-117195144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f872a5bf-1f08-4570-9583-67338352fcad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:10:15 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c0d2590c-19b0-4987-90c9-6e666210683e tempest-VolumesListAdminTestJSON-117195144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f872a5bf-1f08-4570-9583-67338352fcad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:10:15 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c0d2590c-19b0-4987-90c9-6e666210683e tempest-VolumesListAdminTestJSON-117195144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71ed0520-4459-46ef-942b-f5085d424a0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:10:15 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-c0d2590c-19b0-4987-90c9-6e666210683e tempest-VolumesListAdminTestJSON-117195144 None] Volume 66b416ec-a967-47cb-82ae-f018725c15aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66b416ec-a967-47cb-82ae-f018725c15aa', 'volume_size': 1} Nov 02 10:10:15 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c0d2590c-19b0-4987-90c9-6e666210683e tempest-VolumesListAdminTestJSON-117195144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:10:15 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c0d2590c-19b0-4987-90c9-6e666210683e tempest-VolumesListAdminTestJSON-117195144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:10:15 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c0d2590c-19b0-4987-90c9-6e666210683e tempest-VolumesListAdminTestJSON-117195144 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:10:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-991733171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66b416ec-a967-47cb-82ae-f018725c15aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ef7b114fb7a441987dac549736557cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:10:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:10:16Z,use_quota=True,user_id='a7b3f9b058824d198d1df482746a3a36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:10:15 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-c0d2590c-19b0-4987-90c9-6e666210683e tempest-VolumesListAdminTestJSON-117195144 None] Creating volume 66b416ec-a967-47cb-82ae-f018725c15aa {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:10:15 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c0d2590c-19b0-4987-90c9-6e666210683e tempest-VolumesListAdminTestJSON-117195144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:10:15 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c0d2590c-19b0-4987-90c9-6e666210683e tempest-VolumesListAdminTestJSON-117195144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:10:15 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c0d2590c-19b0-4987-90c9-6e666210683e tempest-VolumesListAdminTestJSON-117195144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:10:15 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c0d2590c-19b0-4987-90c9-6e666210683e tempest-VolumesListAdminTestJSON-117195144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:10:15 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c0d2590c-19b0-4987-90c9-6e666210683e tempest-VolumesListAdminTestJSON-117195144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:10:15 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c0d2590c-19b0-4987-90c9-6e666210683e tempest-VolumesListAdminTestJSON-117195144 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:10:15 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-c0d2590c-19b0-4987-90c9-6e666210683e tempest-VolumesListAdminTestJSON-117195144 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:10:15 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c0d2590c-19b0-4987-90c9-6e666210683e tempest-VolumesListAdminTestJSON-117195144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-66b416ec-a967-47cb-82ae-f018725c15aa 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:15 devstack sudo[95585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-66b416ec-a967-47cb-82ae-f018725c15aa 1073741824 Nov 02 10:10:15 devstack sudo[95585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:16 devstack sudo[95585]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:16 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c0d2590c-19b0-4987-90c9-6e666210683e tempest-VolumesListAdminTestJSON-117195144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-66b416ec-a967-47cb-82ae-f018725c15aa 1073741824" returned: 0 in 0.716s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:16 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c0d2590c-19b0-4987-90c9-6e666210683e tempest-VolumesListAdminTestJSON-117195144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-66b416ec-a967-47cb-82ae-f018725c15aa {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:16 devstack sudo[95594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-66b416ec-a967-47cb-82ae-f018725c15aa Nov 02 10:10:16 devstack sudo[95594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:16 devstack sudo[95594]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:16 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c0d2590c-19b0-4987-90c9-6e666210683e tempest-VolumesListAdminTestJSON-117195144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-66b416ec-a967-47cb-82ae-f018725c15aa" returned: 0 in 0.377s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:16 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c0d2590c-19b0-4987-90c9-6e666210683e tempest-VolumesListAdminTestJSON-117195144 None] <== create_volume: return (1170ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:10:16 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c0d2590c-19b0-4987-90c9-6e666210683e tempest-VolumesListAdminTestJSON-117195144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.176s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:10:16 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c0d2590c-19b0-4987-90c9-6e666210683e tempest-VolumesListAdminTestJSON-117195144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71ed0520-4459-46ef-942b-f5085d424a0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66b416ec-a967-47cb-82ae-f018725c15aa', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:10:16 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c0d2590c-19b0-4987-90c9-6e666210683e tempest-VolumesListAdminTestJSON-117195144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e757941-c32f-4dfe-a22f-15ec9317ed8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:10:16 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-c0d2590c-19b0-4987-90c9-6e666210683e tempest-VolumesListAdminTestJSON-117195144 None] Volume volume-66b416ec-a967-47cb-82ae-f018725c15aa (66b416ec-a967-47cb-82ae-f018725c15aa): created successfully Nov 02 10:10:17 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c0d2590c-19b0-4987-90c9-6e666210683e tempest-VolumesListAdminTestJSON-117195144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e757941-c32f-4dfe-a22f-15ec9317ed8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:10:17 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c0d2590c-19b0-4987-90c9-6e666210683e tempest-VolumesListAdminTestJSON-117195144 None] Flow 'volume_create_manager' (230862af-4ec3-4d19-b565-48f72c590795) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:10:17 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-c0d2590c-19b0-4987-90c9-6e666210683e tempest-VolumesListAdminTestJSON-117195144 None] Created volume successfully. Nov 02 10:10:17 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-f47f8d1c-633e-42ba-9313-5629127dbea7 tempest-TestShelveInstance-1130720155 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:10:17 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-f47f8d1c-633e-42ba-9313-5629127dbea7 tempest-TestShelveInstance-1130720155 None] Flow 'volume_create_manager' (9897e8cc-f643-4f90-9948-a477631d1620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:10:17 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-f47f8d1c-633e-42ba-9313-5629127dbea7 tempest-TestShelveInstance-1130720155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c709099e-c407-475e-aa05-04ae9b71dd20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:10:17 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-f47f8d1c-633e-42ba-9313-5629127dbea7 tempest-TestShelveInstance-1130720155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c709099e-c407-475e-aa05-04ae9b71dd20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:10:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1105716845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c56933d-ce9c-41c2-aa45-efe5fd9f9cb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00259fc34efc41aab9e11e9b39450a4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:10:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:10:17Z,use_quota=True,user_id='7915e0b7c7c74b42a4187611302aef88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:10:17 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-f47f8d1c-633e-42ba-9313-5629127dbea7 tempest-TestShelveInstance-1130720155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc482eaf-8ebc-4d67-9aa2-5ce8c8535cde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:10:17 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-f47f8d1c-633e-42ba-9313-5629127dbea7 tempest-TestShelveInstance-1130720155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc482eaf-8ebc-4d67-9aa2-5ce8c8535cde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:10:17 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-f47f8d1c-633e-42ba-9313-5629127dbea7 tempest-TestShelveInstance-1130720155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d9bccb6-ac99-43ef-bcd0-ea8f3f969a7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:10:17 devstack cinder-volume[86890]: DEBUG cinder.image.glance [None req-f47f8d1c-633e-42ba-9313-5629127dbea7 tempest-TestShelveInstance-1130720155 None] Creating Keystone auth plugin from conf {{(pid=86890) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 10:10:17 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-f47f8d1c-633e-42ba-9313-5629127dbea7 tempest-TestShelveInstance-1130720155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d9bccb6-ac99-43ef-bcd0-ea8f3f969a7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4c56933d-ce9c-41c2-aa45-efe5fd9f9cb5', 'volume_name': 'volume-4c56933d-ce9c-41c2-aa45-efe5fd9f9cb5', 'volume_size': 1, 'image_id': '7a393fa7-4879-486c-8216-4d35448485cf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7a393fa7-4879-486c-8216-4d35448485cf', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '606cf27a36794aa3805ebe6d987aa1a4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7a393fa7-4879-486c-8216-4d35448485cf', 'created_at': datetime.datetime(2026, 11, 2, 8, 55, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 8, 55, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7a393fa7-4879-486c-8216-4d35448485cf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:10:17 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-f47f8d1c-633e-42ba-9313-5629127dbea7 tempest-TestShelveInstance-1130720155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (093d452c-92b2-462b-924c-f7fdceacad49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:10:17 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-f47f8d1c-633e-42ba-9313-5629127dbea7 tempest-TestShelveInstance-1130720155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (093d452c-92b2-462b-924c-f7fdceacad49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:10:17 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-f47f8d1c-633e-42ba-9313-5629127dbea7 tempest-TestShelveInstance-1130720155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2812855d-6cef-4a47-a305-d244e6d1cb32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:10:17 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-f47f8d1c-633e-42ba-9313-5629127dbea7 tempest-TestShelveInstance-1130720155 None] Volume 4c56933d-ce9c-41c2-aa45-efe5fd9f9cb5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4c56933d-ce9c-41c2-aa45-efe5fd9f9cb5', 'volume_size': 1, 'image_id': '7a393fa7-4879-486c-8216-4d35448485cf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7a393fa7-4879-486c-8216-4d35448485cf', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '606cf27a36794aa3805ebe6d987aa1a4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7a393fa7-4879-486c-8216-4d35448485cf', 'created_at': datetime.datetime(2026, 11, 2, 8, 55, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 8, 55, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7a393fa7-4879-486c-8216-4d35448485cf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 02 10:10:17 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-f47f8d1c-633e-42ba-9313-5629127dbea7 tempest-TestShelveInstance-1130720155 None] Trying to clone 4c56933d-ce9c-41c2-aa45-efe5fd9f9cb5 from image 7a393fa7-4879-486c-8216-4d35448485cf at location (None, [{'url': 'file:///opt/stack/data/glance/images/7a393fa7-4879-486c-8216-4d35448485cf', 'metadata': {}}]). {{(pid=86890) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 02 10:10:18 devstack cinder-volume[86890]: INFO cinder.volume.manager [req-67665e0d-fb0e-47d8-ad16-8e38fdc538e7 req-110ea5ae-91d6-47c6-9bec-a6f3950b56fc tempest-AttachVolumeNegativeTest-1700545160 None] Terminate volume connection completed successfully. Nov 02 10:10:18 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [req-67665e0d-fb0e-47d8-ad16-8e38fdc538e7 req-110ea5ae-91d6-47c6-9bec-a6f3950b56fc tempest-AttachVolumeNegativeTest-1700545160 None] Deleting attachment e2a01ccf-5828-4bbc-8c52-17cafa67b77d. {{(pid=86890) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:10:18 devstack cinder-volume[86890]: DEBUG cinder.image.image_utils [None req-f47f8d1c-633e-42ba-9313-5629127dbea7 tempest-TestShelveInstance-1130720155 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7a393fa7-4879-486c-8216-4d35448485cf_7ond33q5devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86890) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 02 10:10:18 devstack cinder-volume[86890]: INFO cinder.image.image_utils [None req-f47f8d1c-633e-42ba-9313-5629127dbea7 tempest-TestShelveInstance-1130720155 None] Image download 20.69 MB at 20.69 MB/s Nov 02 10:10:18 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[967ed281-5f07-4a07-a9b4-8d13403ba8e3]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:10:18 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-f47f8d1c-633e-42ba-9313-5629127dbea7 tempest-TestShelveInstance-1130720155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7a393fa7-4879-486c-8216-4d35448485cf_7ond33q5devstack@QuobyteHD {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:18 devstack sudo[95602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7a393fa7-4879-486c-8216-4d35448485cf_7ond33q5devstack@QuobyteHD Nov 02 10:10:18 devstack sudo[95602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:18 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f76a1f2-bc9b-49db-9076-15a89c6f3946 tempest-VolumesListAdminTestJSON-117195144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:10:18 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-3f76a1f2-bc9b-49db-9076-15a89c6f3946 tempest-VolumesListAdminTestJSON-117195144 None] Flow 'volume_create_manager' (2b783a68-d468-4de0-b464-f4b008765e49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:10:18 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-3f76a1f2-bc9b-49db-9076-15a89c6f3946 tempest-VolumesListAdminTestJSON-117195144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e7772e7-50eb-4e25-b203-438c6d4fb0b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:10:18 devstack sudo[95602]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:18 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-3f76a1f2-bc9b-49db-9076-15a89c6f3946 tempest-VolumesListAdminTestJSON-117195144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e7772e7-50eb-4e25-b203-438c6d4fb0b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:10:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-829860500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e3b9700-2000-4b07-b412-be8c9afd1ad0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ef7b114fb7a441987dac549736557cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:10:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:10:19Z,use_quota=True,user_id='a7b3f9b058824d198d1df482746a3a36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:10:18 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-3f76a1f2-bc9b-49db-9076-15a89c6f3946 tempest-VolumesListAdminTestJSON-117195144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82ba58e2-bb46-4363-bd0c-39caf185ae86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:10:18 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-3f76a1f2-bc9b-49db-9076-15a89c6f3946 tempest-VolumesListAdminTestJSON-117195144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82ba58e2-bb46-4363-bd0c-39caf185ae86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:10:18 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-3f76a1f2-bc9b-49db-9076-15a89c6f3946 tempest-VolumesListAdminTestJSON-117195144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e159a46-3bfb-433d-b30d-7449169c3838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:10:18 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-3f76a1f2-bc9b-49db-9076-15a89c6f3946 tempest-VolumesListAdminTestJSON-117195144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e159a46-3bfb-433d-b30d-7449169c3838) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e3b9700-2000-4b07-b412-be8c9afd1ad0', 'volume_name': 'volume-3e3b9700-2000-4b07-b412-be8c9afd1ad0', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:10:18 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-3f76a1f2-bc9b-49db-9076-15a89c6f3946 tempest-VolumesListAdminTestJSON-117195144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1353f880-ab65-4f33-b5ad-14e23d91c9f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:10:18 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-3f76a1f2-bc9b-49db-9076-15a89c6f3946 tempest-VolumesListAdminTestJSON-117195144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1353f880-ab65-4f33-b5ad-14e23d91c9f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:10:18 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-3f76a1f2-bc9b-49db-9076-15a89c6f3946 tempest-VolumesListAdminTestJSON-117195144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3c7dacb-4a7f-4a10-9afe-d4bd40484d26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:10:18 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-3f76a1f2-bc9b-49db-9076-15a89c6f3946 tempest-VolumesListAdminTestJSON-117195144 None] Volume 3e3b9700-2000-4b07-b412-be8c9afd1ad0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e3b9700-2000-4b07-b412-be8c9afd1ad0', 'volume_size': 1} Nov 02 10:10:18 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-3f76a1f2-bc9b-49db-9076-15a89c6f3946 tempest-VolumesListAdminTestJSON-117195144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:10:18 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-3f76a1f2-bc9b-49db-9076-15a89c6f3946 tempest-VolumesListAdminTestJSON-117195144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:10:18 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-3f76a1f2-bc9b-49db-9076-15a89c6f3946 tempest-VolumesListAdminTestJSON-117195144 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:10:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-829860500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e3b9700-2000-4b07-b412-be8c9afd1ad0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ef7b114fb7a441987dac549736557cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:10:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:10:19Z,use_quota=True,user_id='a7b3f9b058824d198d1df482746a3a36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:10:18 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-3f76a1f2-bc9b-49db-9076-15a89c6f3946 tempest-VolumesListAdminTestJSON-117195144 None] Creating volume 3e3b9700-2000-4b07-b412-be8c9afd1ad0 {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:10:18 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-3f76a1f2-bc9b-49db-9076-15a89c6f3946 tempest-VolumesListAdminTestJSON-117195144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:10:18 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-3f76a1f2-bc9b-49db-9076-15a89c6f3946 tempest-VolumesListAdminTestJSON-117195144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:10:18 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-3f76a1f2-bc9b-49db-9076-15a89c6f3946 tempest-VolumesListAdminTestJSON-117195144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:10:18 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-3f76a1f2-bc9b-49db-9076-15a89c6f3946 tempest-VolumesListAdminTestJSON-117195144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:10:18 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-3f76a1f2-bc9b-49db-9076-15a89c6f3946 tempest-VolumesListAdminTestJSON-117195144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:10:18 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-3f76a1f2-bc9b-49db-9076-15a89c6f3946 tempest-VolumesListAdminTestJSON-117195144 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:10:18 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-3f76a1f2-bc9b-49db-9076-15a89c6f3946 tempest-VolumesListAdminTestJSON-117195144 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:10:18 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-3f76a1f2-bc9b-49db-9076-15a89c6f3946 tempest-VolumesListAdminTestJSON-117195144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3e3b9700-2000-4b07-b412-be8c9afd1ad0 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:18 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-f47f8d1c-633e-42ba-9313-5629127dbea7 tempest-TestShelveInstance-1130720155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7a393fa7-4879-486c-8216-4d35448485cf_7ond33q5devstack@QuobyteHD" returned: 0 in 0.575s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:18 devstack cinder-volume[86890]: DEBUG cinder.image.image_utils [None req-f47f8d1c-633e-42ba-9313-5629127dbea7 tempest-TestShelveInstance-1130720155 None] Temporary image 7a393fa7-4879-486c-8216-4d35448485cf is fetched for user 7915e0b7c7c74b42a4187611302aef88. {{(pid=86890) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 02 10:10:18 devstack sudo[95607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3e3b9700-2000-4b07-b412-be8c9afd1ad0 1073741824 Nov 02 10:10:18 devstack sudo[95607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:18 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[a99b5057-dbc3-435a-8c18-a02a7bbbff22]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:10:18 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-f47f8d1c-633e-42ba-9313-5629127dbea7 tempest-TestShelveInstance-1130720155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7a393fa7-4879-486c-8216-4d35448485cf_7ond33q5devstack@QuobyteHD {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:19 devstack sudo[95609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7a393fa7-4879-486c-8216-4d35448485cf_7ond33q5devstack@QuobyteHD Nov 02 10:10:19 devstack sudo[95609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:19 devstack sudo[95607]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:19 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-3f76a1f2-bc9b-49db-9076-15a89c6f3946 tempest-VolumesListAdminTestJSON-117195144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3e3b9700-2000-4b07-b412-be8c9afd1ad0 1073741824" returned: 0 in 0.749s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:19 devstack sudo[95609]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:19 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-f47f8d1c-633e-42ba-9313-5629127dbea7 tempest-TestShelveInstance-1130720155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7a393fa7-4879-486c-8216-4d35448485cf_7ond33q5devstack@QuobyteHD" returned: 0 in 0.661s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:19 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-f47f8d1c-633e-42ba-9313-5629127dbea7 tempest-TestShelveInstance-1130720155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:10:19 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-3f76a1f2-bc9b-49db-9076-15a89c6f3946 tempest-VolumesListAdminTestJSON-117195144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3e3b9700-2000-4b07-b412-be8c9afd1ad0 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:19 devstack sudo[95633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3e3b9700-2000-4b07-b412-be8c9afd1ad0 Nov 02 10:10:19 devstack sudo[95633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:19 devstack sudo[95633]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:19 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-3f76a1f2-bc9b-49db-9076-15a89c6f3946 tempest-VolumesListAdminTestJSON-117195144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3e3b9700-2000-4b07-b412-be8c9afd1ad0" returned: 0 in 0.324s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:19 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-3f76a1f2-bc9b-49db-9076-15a89c6f3946 tempest-VolumesListAdminTestJSON-117195144 None] <== create_volume: return (1194ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:10:19 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-3f76a1f2-bc9b-49db-9076-15a89c6f3946 tempest-VolumesListAdminTestJSON-117195144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.198s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:10:19 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-f47f8d1c-633e-42ba-9313-5629127dbea7 tempest-TestShelveInstance-1130720155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.381s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:10:19 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-f47f8d1c-633e-42ba-9313-5629127dbea7 tempest-TestShelveInstance-1130720155 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:10:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1105716845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c56933d-ce9c-41c2-aa45-efe5fd9f9cb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00259fc34efc41aab9e11e9b39450a4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:10:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:10:17Z,use_quota=True,user_id='7915e0b7c7c74b42a4187611302aef88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:10:19 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-f47f8d1c-633e-42ba-9313-5629127dbea7 tempest-TestShelveInstance-1130720155 None] Creating volume 4c56933d-ce9c-41c2-aa45-efe5fd9f9cb5 {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:10:19 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-f47f8d1c-633e-42ba-9313-5629127dbea7 tempest-TestShelveInstance-1130720155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:10:19 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-f47f8d1c-633e-42ba-9313-5629127dbea7 tempest-TestShelveInstance-1130720155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:10:19 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-f47f8d1c-633e-42ba-9313-5629127dbea7 tempest-TestShelveInstance-1130720155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:10:19 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-f47f8d1c-633e-42ba-9313-5629127dbea7 tempest-TestShelveInstance-1130720155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:10:19 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-f47f8d1c-633e-42ba-9313-5629127dbea7 tempest-TestShelveInstance-1130720155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:10:19 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-f47f8d1c-633e-42ba-9313-5629127dbea7 tempest-TestShelveInstance-1130720155 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:10:19 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-f47f8d1c-633e-42ba-9313-5629127dbea7 tempest-TestShelveInstance-1130720155 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:10:19 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-f47f8d1c-633e-42ba-9313-5629127dbea7 tempest-TestShelveInstance-1130720155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-4c56933d-ce9c-41c2-aa45-efe5fd9f9cb5 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:19 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-3f76a1f2-bc9b-49db-9076-15a89c6f3946 tempest-VolumesListAdminTestJSON-117195144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3c7dacb-4a7f-4a10-9afe-d4bd40484d26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e3b9700-2000-4b07-b412-be8c9afd1ad0', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:10:19 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-3f76a1f2-bc9b-49db-9076-15a89c6f3946 tempest-VolumesListAdminTestJSON-117195144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53ef4011-2c47-4ed1-b84d-65c29d6fae7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:10:19 devstack sudo[95641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-4c56933d-ce9c-41c2-aa45-efe5fd9f9cb5 1073741824 Nov 02 10:10:20 devstack sudo[95641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:20 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-3f76a1f2-bc9b-49db-9076-15a89c6f3946 tempest-VolumesListAdminTestJSON-117195144 None] Volume volume-3e3b9700-2000-4b07-b412-be8c9afd1ad0 (3e3b9700-2000-4b07-b412-be8c9afd1ad0): created successfully Nov 02 10:10:20 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-3f76a1f2-bc9b-49db-9076-15a89c6f3946 tempest-VolumesListAdminTestJSON-117195144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53ef4011-2c47-4ed1-b84d-65c29d6fae7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:10:20 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-3f76a1f2-bc9b-49db-9076-15a89c6f3946 tempest-VolumesListAdminTestJSON-117195144 None] Flow 'volume_create_manager' (2b783a68-d468-4de0-b464-f4b008765e49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:10:20 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-3f76a1f2-bc9b-49db-9076-15a89c6f3946 tempest-VolumesListAdminTestJSON-117195144 None] Created volume successfully. Nov 02 10:10:20 devstack sudo[95641]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:20 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-f47f8d1c-633e-42ba-9313-5629127dbea7 tempest-TestShelveInstance-1130720155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-4c56933d-ce9c-41c2-aa45-efe5fd9f9cb5 1073741824" returned: 0 in 0.630s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:20 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-f47f8d1c-633e-42ba-9313-5629127dbea7 tempest-TestShelveInstance-1130720155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-4c56933d-ce9c-41c2-aa45-efe5fd9f9cb5 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:20 devstack sudo[95648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-4c56933d-ce9c-41c2-aa45-efe5fd9f9cb5 Nov 02 10:10:20 devstack sudo[95648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:21 devstack sudo[95648]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:21 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-f47f8d1c-633e-42ba-9313-5629127dbea7 tempest-TestShelveInstance-1130720155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-4c56933d-ce9c-41c2-aa45-efe5fd9f9cb5" returned: 0 in 0.659s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:21 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-f47f8d1c-633e-42ba-9313-5629127dbea7 tempest-TestShelveInstance-1130720155 None] <== create_volume: return (1352ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:10:21 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-f47f8d1c-633e-42ba-9313-5629127dbea7 tempest-TestShelveInstance-1130720155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.358s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:10:21 devstack cinder-volume[86890]: DEBUG cinder.volume.volume_utils [None req-f47f8d1c-633e-42ba-9313-5629127dbea7 tempest-TestShelveInstance-1130720155 None] Attempting download of 7a393fa7-4879-486c-8216-4d35448485cf ((None, [{'url': 'file:///opt/stack/data/glance/images/7a393fa7-4879-486c-8216-4d35448485cf', 'metadata': {}}])) to volume 4c56933d-ce9c-41c2-aa45-efe5fd9f9cb5. {{(pid=86890) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 02 10:10:21 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[db0bcf15-e8d1-4bf4-9043-f06359b8508d]: (4, 'raw') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:10:21 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-f47f8d1c-633e-42ba-9313-5629127dbea7 tempest-TestShelveInstance-1130720155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7a393fa7-4879-486c-8216-4d35448485cf_kwkp1c1o {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:21 devstack sudo[95654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7a393fa7-4879-486c-8216-4d35448485cf_kwkp1c1o Nov 02 10:10:21 devstack sudo[95654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:22 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-934f789f-4fba-45f5-87a0-5c18c8ae4800 tempest-VolumesListAdminTestJSON-117195144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:10:22 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-934f789f-4fba-45f5-87a0-5c18c8ae4800 tempest-VolumesListAdminTestJSON-117195144 None] Flow 'volume_create_manager' (ad54b7ab-6c30-4e0d-9e3a-199229df581b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:10:22 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-934f789f-4fba-45f5-87a0-5c18c8ae4800 tempest-VolumesListAdminTestJSON-117195144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d9ac30d-4b2b-4d13-ac5f-ffddfe8bd5bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:10:22 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-934f789f-4fba-45f5-87a0-5c18c8ae4800 tempest-VolumesListAdminTestJSON-117195144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d9ac30d-4b2b-4d13-ac5f-ffddfe8bd5bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:10:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-965069729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b549172-8f3f-4cf1-82b9-762cd5de6e86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ef7b114fb7a441987dac549736557cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:10:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:10:22Z,use_quota=True,user_id='a7b3f9b058824d198d1df482746a3a36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:10:22 devstack sudo[95654]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:22 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-934f789f-4fba-45f5-87a0-5c18c8ae4800 tempest-VolumesListAdminTestJSON-117195144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5821a640-7298-4cbd-993a-ab595ba53223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:10:22 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-934f789f-4fba-45f5-87a0-5c18c8ae4800 tempest-VolumesListAdminTestJSON-117195144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5821a640-7298-4cbd-993a-ab595ba53223) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:10:22 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-934f789f-4fba-45f5-87a0-5c18c8ae4800 tempest-VolumesListAdminTestJSON-117195144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c005bdd1-074a-4a0a-83c9-55ed6d4737fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:10:22 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-934f789f-4fba-45f5-87a0-5c18c8ae4800 tempest-VolumesListAdminTestJSON-117195144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c005bdd1-074a-4a0a-83c9-55ed6d4737fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b549172-8f3f-4cf1-82b9-762cd5de6e86', 'volume_name': 'volume-5b549172-8f3f-4cf1-82b9-762cd5de6e86', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:10:22 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-934f789f-4fba-45f5-87a0-5c18c8ae4800 tempest-VolumesListAdminTestJSON-117195144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00b00950-568e-463b-8e69-2bfd5fbde401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:10:22 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-934f789f-4fba-45f5-87a0-5c18c8ae4800 tempest-VolumesListAdminTestJSON-117195144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00b00950-568e-463b-8e69-2bfd5fbde401) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:10:22 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-934f789f-4fba-45f5-87a0-5c18c8ae4800 tempest-VolumesListAdminTestJSON-117195144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c7aa12f-60df-4146-bf6f-410e5fc61e72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:10:22 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-934f789f-4fba-45f5-87a0-5c18c8ae4800 tempest-VolumesListAdminTestJSON-117195144 None] Volume 5b549172-8f3f-4cf1-82b9-762cd5de6e86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b549172-8f3f-4cf1-82b9-762cd5de6e86', 'volume_size': 1} Nov 02 10:10:22 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-934f789f-4fba-45f5-87a0-5c18c8ae4800 tempest-VolumesListAdminTestJSON-117195144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:10:22 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-934f789f-4fba-45f5-87a0-5c18c8ae4800 tempest-VolumesListAdminTestJSON-117195144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:10:22 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-934f789f-4fba-45f5-87a0-5c18c8ae4800 tempest-VolumesListAdminTestJSON-117195144 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:10:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-965069729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b549172-8f3f-4cf1-82b9-762cd5de6e86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ef7b114fb7a441987dac549736557cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:10:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:10:22Z,use_quota=True,user_id='a7b3f9b058824d198d1df482746a3a36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:10:22 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-934f789f-4fba-45f5-87a0-5c18c8ae4800 tempest-VolumesListAdminTestJSON-117195144 None] Creating volume 5b549172-8f3f-4cf1-82b9-762cd5de6e86 {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:10:22 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-934f789f-4fba-45f5-87a0-5c18c8ae4800 tempest-VolumesListAdminTestJSON-117195144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:10:22 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-934f789f-4fba-45f5-87a0-5c18c8ae4800 tempest-VolumesListAdminTestJSON-117195144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:10:22 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-934f789f-4fba-45f5-87a0-5c18c8ae4800 tempest-VolumesListAdminTestJSON-117195144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:10:22 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-934f789f-4fba-45f5-87a0-5c18c8ae4800 tempest-VolumesListAdminTestJSON-117195144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:10:22 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-934f789f-4fba-45f5-87a0-5c18c8ae4800 tempest-VolumesListAdminTestJSON-117195144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:10:22 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-934f789f-4fba-45f5-87a0-5c18c8ae4800 tempest-VolumesListAdminTestJSON-117195144 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:10:22 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-934f789f-4fba-45f5-87a0-5c18c8ae4800 tempest-VolumesListAdminTestJSON-117195144 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:10:22 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-934f789f-4fba-45f5-87a0-5c18c8ae4800 tempest-VolumesListAdminTestJSON-117195144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-5b549172-8f3f-4cf1-82b9-762cd5de6e86 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:22 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-f47f8d1c-633e-42ba-9313-5629127dbea7 tempest-TestShelveInstance-1130720155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7a393fa7-4879-486c-8216-4d35448485cf_kwkp1c1o" returned: 0 in 0.787s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:22 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-f47f8d1c-633e-42ba-9313-5629127dbea7 tempest-TestShelveInstance-1130720155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7a393fa7-4879-486c-8216-4d35448485cf_kwkp1c1o {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:22 devstack sudo[95659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-5b549172-8f3f-4cf1-82b9-762cd5de6e86 1073741824 Nov 02 10:10:22 devstack sudo[95659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:22 devstack sudo[95660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7a393fa7-4879-486c-8216-4d35448485cf_kwkp1c1o Nov 02 10:10:22 devstack sudo[95660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:22 devstack sudo[95660]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:22 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-f47f8d1c-633e-42ba-9313-5629127dbea7 tempest-TestShelveInstance-1130720155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7a393fa7-4879-486c-8216-4d35448485cf_kwkp1c1o" returned: 1 in 0.452s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:22 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-f47f8d1c-633e-42ba-9313-5629127dbea7 tempest-TestShelveInstance-1130720155 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7a393fa7-4879-486c-8216-4d35448485cf_kwkp1c1o' failed. Not Retrying. {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 10:10:22 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[88b68745-5d82-4631-9d25-e9832824d9a2]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:10:22 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-f47f8d1c-633e-42ba-9313-5629127dbea7 tempest-TestShelveInstance-1130720155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7a393fa7-4879-486c-8216-4d35448485cf_7ond33q5devstack@QuobyteHD {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:22 devstack sudo[95659]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:22 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-934f789f-4fba-45f5-87a0-5c18c8ae4800 tempest-VolumesListAdminTestJSON-117195144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-5b549172-8f3f-4cf1-82b9-762cd5de6e86 1073741824" returned: 0 in 0.556s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:22 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-934f789f-4fba-45f5-87a0-5c18c8ae4800 tempest-VolumesListAdminTestJSON-117195144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-5b549172-8f3f-4cf1-82b9-762cd5de6e86 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:22 devstack sudo[95669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7a393fa7-4879-486c-8216-4d35448485cf_7ond33q5devstack@QuobyteHD Nov 02 10:10:22 devstack sudo[95669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:22 devstack sudo[95670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-5b549172-8f3f-4cf1-82b9-762cd5de6e86 Nov 02 10:10:22 devstack sudo[95670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:23 devstack sudo[95670]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:23 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-934f789f-4fba-45f5-87a0-5c18c8ae4800 tempest-VolumesListAdminTestJSON-117195144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-5b549172-8f3f-4cf1-82b9-762cd5de6e86" returned: 0 in 0.303s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:23 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-934f789f-4fba-45f5-87a0-5c18c8ae4800 tempest-VolumesListAdminTestJSON-117195144 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:10:23 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-934f789f-4fba-45f5-87a0-5c18c8ae4800 tempest-VolumesListAdminTestJSON-117195144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.920s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:10:23 devstack sudo[95669]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:23 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-f47f8d1c-633e-42ba-9313-5629127dbea7 tempest-TestShelveInstance-1130720155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7a393fa7-4879-486c-8216-4d35448485cf_7ond33q5devstack@QuobyteHD" returned: 0 in 0.441s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:23 devstack cinder-volume[86890]: DEBUG cinder.image.image_utils [None req-f47f8d1c-633e-42ba-9313-5629127dbea7 tempest-TestShelveInstance-1130720155 None] 7a393fa7-4879-486c-8216-4d35448485cf was qcow2, converting to qcow2 {{(pid=86890) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 02 10:10:23 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-f47f8d1c-633e-42ba-9313-5629127dbea7 tempest-TestShelveInstance-1130720155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7a393fa7-4879-486c-8216-4d35448485cf_7ond33q5devstack@QuobyteHD /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-4c56933d-ce9c-41c2-aa45-efe5fd9f9cb5 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:23 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-934f789f-4fba-45f5-87a0-5c18c8ae4800 tempest-VolumesListAdminTestJSON-117195144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c7aa12f-60df-4146-bf6f-410e5fc61e72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b549172-8f3f-4cf1-82b9-762cd5de6e86', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:10:23 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-934f789f-4fba-45f5-87a0-5c18c8ae4800 tempest-VolumesListAdminTestJSON-117195144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed036e56-718e-495c-82b6-18d72fbd3133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:10:23 devstack sudo[95677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7a393fa7-4879-486c-8216-4d35448485cf_7ond33q5devstack@QuobyteHD /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-4c56933d-ce9c-41c2-aa45-efe5fd9f9cb5 Nov 02 10:10:23 devstack sudo[95677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:23 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-934f789f-4fba-45f5-87a0-5c18c8ae4800 tempest-VolumesListAdminTestJSON-117195144 None] Volume volume-5b549172-8f3f-4cf1-82b9-762cd5de6e86 (5b549172-8f3f-4cf1-82b9-762cd5de6e86): created successfully Nov 02 10:10:23 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-934f789f-4fba-45f5-87a0-5c18c8ae4800 tempest-VolumesListAdminTestJSON-117195144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed036e56-718e-495c-82b6-18d72fbd3133) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:10:23 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-934f789f-4fba-45f5-87a0-5c18c8ae4800 tempest-VolumesListAdminTestJSON-117195144 None] Flow 'volume_create_manager' (ad54b7ab-6c30-4e0d-9e3a-199229df581b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:10:23 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-934f789f-4fba-45f5-87a0-5c18c8ae4800 tempest-VolumesListAdminTestJSON-117195144 None] Created volume successfully. Nov 02 10:10:25 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ccdcf66-1a1f-472b-bfc2-c1df094bde17 tempest-VolumesListAdminTestJSON-53347085 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:10:25 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-9ccdcf66-1a1f-472b-bfc2-c1df094bde17 tempest-VolumesListAdminTestJSON-53347085 None] Flow 'volume_create_manager' (d9c39de6-d118-4276-8613-a15852730626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:10:25 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-9ccdcf66-1a1f-472b-bfc2-c1df094bde17 tempest-VolumesListAdminTestJSON-53347085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5154287e-7d8e-4f95-a386-64e50a7050f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:10:25 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-9ccdcf66-1a1f-472b-bfc2-c1df094bde17 tempest-VolumesListAdminTestJSON-53347085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5154287e-7d8e-4f95-a386-64e50a7050f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:10:25Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15511cff-eac5-4136-8ff1-32bdd05c0040,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f27032cd9404430a72fcfbd6e12e817',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:10:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:10:25Z,use_quota=True,user_id='b8d036f571e5414c8c614a09045b6fc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:10:25 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-9ccdcf66-1a1f-472b-bfc2-c1df094bde17 tempest-VolumesListAdminTestJSON-53347085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b203e3e4-c5bf-4f9d-9018-6e56c1846bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:10:25 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-9ccdcf66-1a1f-472b-bfc2-c1df094bde17 tempest-VolumesListAdminTestJSON-53347085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b203e3e4-c5bf-4f9d-9018-6e56c1846bd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:10:25 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-9ccdcf66-1a1f-472b-bfc2-c1df094bde17 tempest-VolumesListAdminTestJSON-53347085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34778d19-bfcf-4033-9687-c63c0c6701e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:10:25 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-9ccdcf66-1a1f-472b-bfc2-c1df094bde17 tempest-VolumesListAdminTestJSON-53347085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34778d19-bfcf-4033-9687-c63c0c6701e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15511cff-eac5-4136-8ff1-32bdd05c0040', 'volume_name': 'volume-15511cff-eac5-4136-8ff1-32bdd05c0040', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:10:25 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-9ccdcf66-1a1f-472b-bfc2-c1df094bde17 tempest-VolumesListAdminTestJSON-53347085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34c6020b-8bc7-4b34-8dcb-dc4802239bb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:10:25 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-9ccdcf66-1a1f-472b-bfc2-c1df094bde17 tempest-VolumesListAdminTestJSON-53347085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34c6020b-8bc7-4b34-8dcb-dc4802239bb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:10:25 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-9ccdcf66-1a1f-472b-bfc2-c1df094bde17 tempest-VolumesListAdminTestJSON-53347085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8f332b3-eef4-4d10-a6bb-dd0d12e4e44f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:10:25 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-9ccdcf66-1a1f-472b-bfc2-c1df094bde17 tempest-VolumesListAdminTestJSON-53347085 None] Volume 15511cff-eac5-4136-8ff1-32bdd05c0040: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15511cff-eac5-4136-8ff1-32bdd05c0040', 'volume_size': 1} Nov 02 10:10:25 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-9ccdcf66-1a1f-472b-bfc2-c1df094bde17 tempest-VolumesListAdminTestJSON-53347085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:10:25 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-9ccdcf66-1a1f-472b-bfc2-c1df094bde17 tempest-VolumesListAdminTestJSON-53347085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:10:25 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-9ccdcf66-1a1f-472b-bfc2-c1df094bde17 tempest-VolumesListAdminTestJSON-53347085 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:10:25Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15511cff-eac5-4136-8ff1-32bdd05c0040,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f27032cd9404430a72fcfbd6e12e817',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:10:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:10:25Z,use_quota=True,user_id='b8d036f571e5414c8c614a09045b6fc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:10:25 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-9ccdcf66-1a1f-472b-bfc2-c1df094bde17 tempest-VolumesListAdminTestJSON-53347085 None] Creating volume 15511cff-eac5-4136-8ff1-32bdd05c0040 {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:10:25 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-9ccdcf66-1a1f-472b-bfc2-c1df094bde17 tempest-VolumesListAdminTestJSON-53347085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:10:25 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-9ccdcf66-1a1f-472b-bfc2-c1df094bde17 tempest-VolumesListAdminTestJSON-53347085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:10:25 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-9ccdcf66-1a1f-472b-bfc2-c1df094bde17 tempest-VolumesListAdminTestJSON-53347085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:10:25 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-9ccdcf66-1a1f-472b-bfc2-c1df094bde17 tempest-VolumesListAdminTestJSON-53347085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:10:25 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-9ccdcf66-1a1f-472b-bfc2-c1df094bde17 tempest-VolumesListAdminTestJSON-53347085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:10:25 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-9ccdcf66-1a1f-472b-bfc2-c1df094bde17 tempest-VolumesListAdminTestJSON-53347085 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:10:25 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-9ccdcf66-1a1f-472b-bfc2-c1df094bde17 tempest-VolumesListAdminTestJSON-53347085 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:10:25 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-9ccdcf66-1a1f-472b-bfc2-c1df094bde17 tempest-VolumesListAdminTestJSON-53347085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-15511cff-eac5-4136-8ff1-32bdd05c0040 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:25 devstack sudo[95686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-15511cff-eac5-4136-8ff1-32bdd05c0040 1073741824 Nov 02 10:10:25 devstack sudo[95686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:25 devstack sudo[95677]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:25 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-f47f8d1c-633e-42ba-9313-5629127dbea7 tempest-TestShelveInstance-1130720155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7a393fa7-4879-486c-8216-4d35448485cf_7ond33q5devstack@QuobyteHD /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-4c56933d-ce9c-41c2-aa45-efe5fd9f9cb5" returned: 0 in 2.498s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:25 devstack cinder-volume[86890]: DEBUG cinder.image.image_utils [None req-f47f8d1c-633e-42ba-9313-5629127dbea7 tempest-TestShelveInstance-1130720155 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7a393fa7-4879-486c-8216-4d35448485cf_7ond33q5devstack@QuobyteHD, size 112.00 MB, duration 2.50 sec, destination /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-4c56933d-ce9c-41c2-aa45-efe5fd9f9cb5 {{(pid=86890) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 10:10:25 devstack cinder-volume[86890]: INFO cinder.image.image_utils [None req-f47f8d1c-633e-42ba-9313-5629127dbea7 tempest-TestShelveInstance-1130720155 None] Converted 112.00 MB image at 44.81 MB/s Nov 02 10:10:25 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-f47f8d1c-633e-42ba-9313-5629127dbea7 tempest-TestShelveInstance-1130720155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-4c56933d-ce9c-41c2-aa45-efe5fd9f9cb5 1G {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:25 devstack sudo[95691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-4c56933d-ce9c-41c2-aa45-efe5fd9f9cb5 1G Nov 02 10:10:25 devstack sudo[95691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:25 devstack sudo[95686]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:25 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-9ccdcf66-1a1f-472b-bfc2-c1df094bde17 tempest-VolumesListAdminTestJSON-53347085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-15511cff-eac5-4136-8ff1-32bdd05c0040 1073741824" returned: 0 in 0.665s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:26 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-9ccdcf66-1a1f-472b-bfc2-c1df094bde17 tempest-VolumesListAdminTestJSON-53347085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-15511cff-eac5-4136-8ff1-32bdd05c0040 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:26 devstack sudo[95697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-15511cff-eac5-4136-8ff1-32bdd05c0040 Nov 02 10:10:26 devstack sudo[95697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:26 devstack sudo[95691]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:26 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-f47f8d1c-633e-42ba-9313-5629127dbea7 tempest-TestShelveInstance-1130720155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-4c56933d-ce9c-41c2-aa45-efe5fd9f9cb5 1G" returned: 0 in 0.441s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:26 devstack cinder-volume[86890]: DEBUG cinder.volume.volume_utils [None req-f47f8d1c-633e-42ba-9313-5629127dbea7 tempest-TestShelveInstance-1130720155 None] Downloaded image 7a393fa7-4879-486c-8216-4d35448485cf ((None, [{'url': 'file:///opt/stack/data/glance/images/7a393fa7-4879-486c-8216-4d35448485cf', 'metadata': {}}])) to volume 4c56933d-ce9c-41c2-aa45-efe5fd9f9cb5 successfully. {{(pid=86890) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 02 10:10:26 devstack cinder-volume[86890]: DEBUG cinder.image.image_utils [None req-f47f8d1c-633e-42ba-9313-5629127dbea7 tempest-TestShelveInstance-1130720155 None] Temporary image 7a393fa7-4879-486c-8216-4d35448485cf for user 7915e0b7c7c74b42a4187611302aef88 is deleted. {{(pid=86890) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 02 10:10:26 devstack cinder-volume[86890]: DEBUG cinder.volume.volume_utils [None req-f47f8d1c-633e-42ba-9313-5629127dbea7 tempest-TestShelveInstance-1130720155 None] Marking volume 4c56933d-ce9c-41c2-aa45-efe5fd9f9cb5 as bootable. {{(pid=86890) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 02 10:10:26 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-f47f8d1c-633e-42ba-9313-5629127dbea7 tempest-TestShelveInstance-1130720155 None] Copying metadata from image 7a393fa7-4879-486c-8216-4d35448485cf to 4c56933d-ce9c-41c2-aa45-efe5fd9f9cb5. {{(pid=86890) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 10:10:26 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-f47f8d1c-633e-42ba-9313-5629127dbea7 tempest-TestShelveInstance-1130720155 None] Creating volume glance metadata for volume 4c56933d-ce9c-41c2-aa45-efe5fd9f9cb5 backed by image 7a393fa7-4879-486c-8216-4d35448485cf with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '7a393fa7-4879-486c-8216-4d35448485cf', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86890) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 10:10:26 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-f47f8d1c-633e-42ba-9313-5629127dbea7 tempest-TestShelveInstance-1130720155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2812855d-6cef-4a47-a305-d244e6d1cb32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c56933d-ce9c-41c2-aa45-efe5fd9f9cb5', 'volume_size': 1, 'image_id': '7a393fa7-4879-486c-8216-4d35448485cf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7a393fa7-4879-486c-8216-4d35448485cf', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '606cf27a36794aa3805ebe6d987aa1a4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7a393fa7-4879-486c-8216-4d35448485cf', 'created_at': datetime.datetime(2026, 11, 2, 8, 55, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 8, 55, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7a393fa7-4879-486c-8216-4d35448485cf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:10:26 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-f47f8d1c-633e-42ba-9313-5629127dbea7 tempest-TestShelveInstance-1130720155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (464959ed-f492-4eb7-aec0-6091b5ee4f7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:10:26 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-f47f8d1c-633e-42ba-9313-5629127dbea7 tempest-TestShelveInstance-1130720155 None] Volume volume-4c56933d-ce9c-41c2-aa45-efe5fd9f9cb5 (4c56933d-ce9c-41c2-aa45-efe5fd9f9cb5): created successfully Nov 02 10:10:26 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-f47f8d1c-633e-42ba-9313-5629127dbea7 tempest-TestShelveInstance-1130720155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (464959ed-f492-4eb7-aec0-6091b5ee4f7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:10:26 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-f47f8d1c-633e-42ba-9313-5629127dbea7 tempest-TestShelveInstance-1130720155 None] Flow 'volume_create_manager' (9897e8cc-f643-4f90-9948-a477631d1620) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:10:26 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-f47f8d1c-633e-42ba-9313-5629127dbea7 tempest-TestShelveInstance-1130720155 None] Created volume successfully. Nov 02 10:10:26 devstack sudo[95697]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:26 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-9ccdcf66-1a1f-472b-bfc2-c1df094bde17 tempest-VolumesListAdminTestJSON-53347085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-15511cff-eac5-4136-8ff1-32bdd05c0040" returned: 0 in 0.318s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:26 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-9ccdcf66-1a1f-472b-bfc2-c1df094bde17 tempest-VolumesListAdminTestJSON-53347085 None] <== create_volume: return (1043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:10:26 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-9ccdcf66-1a1f-472b-bfc2-c1df094bde17 tempest-VolumesListAdminTestJSON-53347085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.046s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:10:26 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-9ccdcf66-1a1f-472b-bfc2-c1df094bde17 tempest-VolumesListAdminTestJSON-53347085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8f332b3-eef4-4d10-a6bb-dd0d12e4e44f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15511cff-eac5-4136-8ff1-32bdd05c0040', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:10:26 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-9ccdcf66-1a1f-472b-bfc2-c1df094bde17 tempest-VolumesListAdminTestJSON-53347085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04107ca7-b581-4c3b-9556-dc28e1ee18dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:10:26 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-9ccdcf66-1a1f-472b-bfc2-c1df094bde17 tempest-VolumesListAdminTestJSON-53347085 None] Volume volume-15511cff-eac5-4136-8ff1-32bdd05c0040 (15511cff-eac5-4136-8ff1-32bdd05c0040): created successfully Nov 02 10:10:26 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-9ccdcf66-1a1f-472b-bfc2-c1df094bde17 tempest-VolumesListAdminTestJSON-53347085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04107ca7-b581-4c3b-9556-dc28e1ee18dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:10:26 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-9ccdcf66-1a1f-472b-bfc2-c1df094bde17 tempest-VolumesListAdminTestJSON-53347085 None] Flow 'volume_create_manager' (d9c39de6-d118-4276-8613-a15852730626) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:10:26 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-9ccdcf66-1a1f-472b-bfc2-c1df094bde17 tempest-VolumesListAdminTestJSON-53347085 None] Created volume successfully. Nov 02 10:10:27 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-176470e6-3a40-46e2-b0cf-21be12a6f290 tempest-VolumesListAdminTestJSON-53347085 None] Acquiring lock "cinder-15511cff-eac5-4136-8ff1-32bdd05c0040-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:10:27 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-176470e6-3a40-46e2-b0cf-21be12a6f290 tempest-VolumesListAdminTestJSON-53347085 None] Lock "cinder-15511cff-eac5-4136-8ff1-32bdd05c0040-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:10:27 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-176470e6-3a40-46e2-b0cf-21be12a6f290 tempest-VolumesListAdminTestJSON-53347085 None] Acquiring lock "cinder-quobyte-15511cff-eac5-4136-8ff1-32bdd05c0040" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:10:27 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-176470e6-3a40-46e2-b0cf-21be12a6f290 tempest-VolumesListAdminTestJSON-53347085 None] Lock "cinder-quobyte-15511cff-eac5-4136-8ff1-32bdd05c0040" acquired by "delete_volume" :: waited 0.020s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:10:27 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[e87e3864-5386-42f6-8203-ec8fd554bc69]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:10:27 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-176470e6-3a40-46e2-b0cf-21be12a6f290 tempest-VolumesListAdminTestJSON-53347085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-15511cff-eac5-4136-8ff1-32bdd05c0040 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:27 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-f2872334-6c8f-4b95-8b23-e36522dedc2a tempest-VolumesListAdminTestJSON-117195144 None] Acquiring lock "cinder-5b549172-8f3f-4cf1-82b9-762cd5de6e86-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:10:27 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-f2872334-6c8f-4b95-8b23-e36522dedc2a tempest-VolumesListAdminTestJSON-117195144 None] Lock "cinder-5b549172-8f3f-4cf1-82b9-762cd5de6e86-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:10:27 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-f2872334-6c8f-4b95-8b23-e36522dedc2a tempest-VolumesListAdminTestJSON-117195144 None] Acquiring lock "cinder-quobyte-5b549172-8f3f-4cf1-82b9-762cd5de6e86" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:10:27 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-f2872334-6c8f-4b95-8b23-e36522dedc2a tempest-VolumesListAdminTestJSON-117195144 None] Lock "cinder-quobyte-5b549172-8f3f-4cf1-82b9-762cd5de6e86" acquired by "delete_volume" :: waited 0.024s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:10:27 devstack sudo[95703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-15511cff-eac5-4136-8ff1-32bdd05c0040 Nov 02 10:10:27 devstack sudo[95703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:27 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba62d6aa-0a18-405a-a412-d0f09c0e424e]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:10:27 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-f2872334-6c8f-4b95-8b23-e36522dedc2a tempest-VolumesListAdminTestJSON-117195144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-5b549172-8f3f-4cf1-82b9-762cd5de6e86 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:27 devstack sudo[95705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-5b549172-8f3f-4cf1-82b9-762cd5de6e86 Nov 02 10:10:27 devstack sudo[95705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:28 devstack sudo[95703]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:28 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-176470e6-3a40-46e2-b0cf-21be12a6f290 tempest-VolumesListAdminTestJSON-53347085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-15511cff-eac5-4136-8ff1-32bdd05c0040" returned: 0 in 0.650s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:28 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-176470e6-3a40-46e2-b0cf-21be12a6f290 tempest-VolumesListAdminTestJSON-53347085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-15511cff-eac5-4136-8ff1-32bdd05c0040 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:28 devstack sudo[95710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-15511cff-eac5-4136-8ff1-32bdd05c0040 Nov 02 10:10:28 devstack sudo[95710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:28 devstack sudo[95705]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:28 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-f2872334-6c8f-4b95-8b23-e36522dedc2a tempest-VolumesListAdminTestJSON-117195144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-5b549172-8f3f-4cf1-82b9-762cd5de6e86" returned: 0 in 0.624s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:28 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-f2872334-6c8f-4b95-8b23-e36522dedc2a tempest-VolumesListAdminTestJSON-117195144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-5b549172-8f3f-4cf1-82b9-762cd5de6e86 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:28 devstack sudo[95716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-5b549172-8f3f-4cf1-82b9-762cd5de6e86 Nov 02 10:10:28 devstack sudo[95716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:28 devstack sudo[95710]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:28 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-176470e6-3a40-46e2-b0cf-21be12a6f290 tempest-VolumesListAdminTestJSON-53347085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-15511cff-eac5-4136-8ff1-32bdd05c0040" returned: 0 in 0.447s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:28 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-176470e6-3a40-46e2-b0cf-21be12a6f290 tempest-VolumesListAdminTestJSON-53347085 None] Lock "cinder-quobyte-15511cff-eac5-4136-8ff1-32bdd05c0040" released by "delete_volume" :: held 1.198s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:10:28 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-176470e6-3a40-46e2-b0cf-21be12a6f290 tempest-VolumesListAdminTestJSON-53347085 None] Created reservations ['4f46110f-852f-4edb-930b-a1c5b4f65326', '59bddf86-7428-4592-8746-048bc636943d', 'd9707f5c-6e2e-45b1-9663-b9a22a83dde5', '057588be-936b-43ca-aad8-203c852a19e7'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:10:28 devstack sudo[95716]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:28 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-f2872334-6c8f-4b95-8b23-e36522dedc2a tempest-VolumesListAdminTestJSON-117195144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-5b549172-8f3f-4cf1-82b9-762cd5de6e86" returned: 0 in 0.574s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:28 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-f2872334-6c8f-4b95-8b23-e36522dedc2a tempest-VolumesListAdminTestJSON-117195144 None] Lock "cinder-quobyte-5b549172-8f3f-4cf1-82b9-762cd5de6e86" released by "delete_volume" :: held 1.352s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:10:29 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-176470e6-3a40-46e2-b0cf-21be12a6f290 tempest-VolumesListAdminTestJSON-53347085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:10:29 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-176470e6-3a40-46e2-b0cf-21be12a6f290 tempest-VolumesListAdminTestJSON-53347085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:10:29 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-176470e6-3a40-46e2-b0cf-21be12a6f290 tempest-VolumesListAdminTestJSON-53347085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:10:29 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-176470e6-3a40-46e2-b0cf-21be12a6f290 tempest-VolumesListAdminTestJSON-53347085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:10:29 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-176470e6-3a40-46e2-b0cf-21be12a6f290 tempest-VolumesListAdminTestJSON-53347085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:10:29 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-176470e6-3a40-46e2-b0cf-21be12a6f290 tempest-VolumesListAdminTestJSON-53347085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:29 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-f2872334-6c8f-4b95-8b23-e36522dedc2a tempest-VolumesListAdminTestJSON-117195144 None] Created reservations ['f75bc625-527b-4c29-99cc-2037cb7e2d2c', '11b54c59-3e24-43f5-a10a-ad1216b538c9', '15ef4b1a-cdd3-435a-88b4-297adc2c493f', '4e5fae8b-9804-49ab-8b65-1c9b49db2304'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:10:29 devstack sudo[95723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:10:29 devstack sudo[95723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:29 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-f2872334-6c8f-4b95-8b23-e36522dedc2a tempest-VolumesListAdminTestJSON-117195144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:10:29 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-f2872334-6c8f-4b95-8b23-e36522dedc2a tempest-VolumesListAdminTestJSON-117195144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:10:29 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-f2872334-6c8f-4b95-8b23-e36522dedc2a tempest-VolumesListAdminTestJSON-117195144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:10:29 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-f2872334-6c8f-4b95-8b23-e36522dedc2a tempest-VolumesListAdminTestJSON-117195144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:10:29 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-f2872334-6c8f-4b95-8b23-e36522dedc2a tempest-VolumesListAdminTestJSON-117195144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:10:29 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-f2872334-6c8f-4b95-8b23-e36522dedc2a tempest-VolumesListAdminTestJSON-117195144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:29 devstack sudo[95726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:10:29 devstack sudo[95726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:29 devstack sudo[95723]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:29 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-176470e6-3a40-46e2-b0cf-21be12a6f290 tempest-VolumesListAdminTestJSON-53347085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.578s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:29 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-176470e6-3a40-46e2-b0cf-21be12a6f290 tempest-VolumesListAdminTestJSON-53347085 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:10:29 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-176470e6-3a40-46e2-b0cf-21be12a6f290 tempest-VolumesListAdminTestJSON-53347085 None] Deleted volume successfully. Nov 02 10:10:29 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-176470e6-3a40-46e2-b0cf-21be12a6f290 tempest-VolumesListAdminTestJSON-53347085 None] Lock "cinder-15511cff-eac5-4136-8ff1-32bdd05c0040-delete_volume" released by "delete_volume" :: held 2.413s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:10:29 devstack sudo[95726]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:29 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-f2872334-6c8f-4b95-8b23-e36522dedc2a tempest-VolumesListAdminTestJSON-117195144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.656s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:29 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-f2872334-6c8f-4b95-8b23-e36522dedc2a tempest-VolumesListAdminTestJSON-117195144 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:10:30 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-f2872334-6c8f-4b95-8b23-e36522dedc2a tempest-VolumesListAdminTestJSON-117195144 None] Deleted volume successfully. Nov 02 10:10:30 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-f2872334-6c8f-4b95-8b23-e36522dedc2a tempest-VolumesListAdminTestJSON-117195144 None] Lock "cinder-5b549172-8f3f-4cf1-82b9-762cd5de6e86-delete_volume" released by "delete_volume" :: held 2.519s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:10:30 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-727cac5b-2d50-4550-b969-bbc6a573d8c2 tempest-VolumesListAdminTestJSON-117195144 None] Acquiring lock "cinder-3e3b9700-2000-4b07-b412-be8c9afd1ad0-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:10:30 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-727cac5b-2d50-4550-b969-bbc6a573d8c2 tempest-VolumesListAdminTestJSON-117195144 None] Lock "cinder-3e3b9700-2000-4b07-b412-be8c9afd1ad0-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:10:30 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-727cac5b-2d50-4550-b969-bbc6a573d8c2 tempest-VolumesListAdminTestJSON-117195144 None] Acquiring lock "cinder-quobyte-3e3b9700-2000-4b07-b412-be8c9afd1ad0" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:10:30 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-727cac5b-2d50-4550-b969-bbc6a573d8c2 tempest-VolumesListAdminTestJSON-117195144 None] Lock "cinder-quobyte-3e3b9700-2000-4b07-b412-be8c9afd1ad0" acquired by "delete_volume" :: waited 0.017s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:10:30 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[0095a90f-1784-4e45-9188-449524393c0e]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:10:30 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-727cac5b-2d50-4550-b969-bbc6a573d8c2 tempest-VolumesListAdminTestJSON-117195144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3e3b9700-2000-4b07-b412-be8c9afd1ad0 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:30 devstack sudo[95743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3e3b9700-2000-4b07-b412-be8c9afd1ad0 Nov 02 10:10:30 devstack sudo[95743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:30 devstack sudo[95743]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:30 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-727cac5b-2d50-4550-b969-bbc6a573d8c2 tempest-VolumesListAdminTestJSON-117195144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3e3b9700-2000-4b07-b412-be8c9afd1ad0" returned: 0 in 0.677s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:30 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-727cac5b-2d50-4550-b969-bbc6a573d8c2 tempest-VolumesListAdminTestJSON-117195144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3e3b9700-2000-4b07-b412-be8c9afd1ad0 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:31 devstack sudo[95753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3e3b9700-2000-4b07-b412-be8c9afd1ad0 Nov 02 10:10:31 devstack sudo[95753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:31 devstack sudo[95753]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:31 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-727cac5b-2d50-4550-b969-bbc6a573d8c2 tempest-VolumesListAdminTestJSON-117195144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3e3b9700-2000-4b07-b412-be8c9afd1ad0" returned: 0 in 0.434s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:31 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-727cac5b-2d50-4550-b969-bbc6a573d8c2 tempest-VolumesListAdminTestJSON-117195144 None] Lock "cinder-quobyte-3e3b9700-2000-4b07-b412-be8c9afd1ad0" released by "delete_volume" :: held 1.207s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:10:31 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-727cac5b-2d50-4550-b969-bbc6a573d8c2 tempest-VolumesListAdminTestJSON-117195144 None] Created reservations ['b4382bdd-083d-4844-a716-6f30ed0b865f', 'b24d13f4-1c16-4df8-a836-3d72f25f80c6', 'ff0ba184-06ce-4f03-bc33-d28eda6739f1', '8557bde8-8a4a-460b-9da5-8ac53680a02b'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:10:31 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-727cac5b-2d50-4550-b969-bbc6a573d8c2 tempest-VolumesListAdminTestJSON-117195144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:10:31 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-727cac5b-2d50-4550-b969-bbc6a573d8c2 tempest-VolumesListAdminTestJSON-117195144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:10:31 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-727cac5b-2d50-4550-b969-bbc6a573d8c2 tempest-VolumesListAdminTestJSON-117195144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:10:31 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-727cac5b-2d50-4550-b969-bbc6a573d8c2 tempest-VolumesListAdminTestJSON-117195144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:10:31 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-727cac5b-2d50-4550-b969-bbc6a573d8c2 tempest-VolumesListAdminTestJSON-117195144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:10:31 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-727cac5b-2d50-4550-b969-bbc6a573d8c2 tempest-VolumesListAdminTestJSON-117195144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:31 devstack sudo[95764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:10:31 devstack sudo[95764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:31 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [req-b8ffce66-dddb-4924-831b-c5c26f802614 req-21ea01cd-eb9f-475e-9290-10485f224371 tempest-TestShelveInstance-1130720155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:10:31 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [req-b8ffce66-dddb-4924-831b-c5c26f802614 req-21ea01cd-eb9f-475e-9290-10485f224371 tempest-TestShelveInstance-1130720155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:10:31 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [req-b8ffce66-dddb-4924-831b-c5c26f802614 req-21ea01cd-eb9f-475e-9290-10485f224371 tempest-TestShelveInstance-1130720155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:10:32 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [req-b8ffce66-dddb-4924-831b-c5c26f802614 req-21ea01cd-eb9f-475e-9290-10485f224371 tempest-TestShelveInstance-1130720155 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67', 'name': 'volume-4c56933d-ce9c-41c2-aa45-efe5fd9f9cb5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6a3ff16b-2afa-4da4-ab6f-04e7493b117d', 'enforce_multipath': True} {{(pid=86890) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:10:32 devstack sudo[95764]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:32 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-727cac5b-2d50-4550-b969-bbc6a573d8c2 tempest-VolumesListAdminTestJSON-117195144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.577s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:32 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-727cac5b-2d50-4550-b969-bbc6a573d8c2 tempest-VolumesListAdminTestJSON-117195144 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:10:32 devstack cinder-volume[86890]: INFO cinder.volume.manager [req-b8ffce66-dddb-4924-831b-c5c26f802614 req-21ea01cd-eb9f-475e-9290-10485f224371 tempest-TestShelveInstance-1130720155 None] attachment_update completed successfully. Nov 02 10:10:32 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-727cac5b-2d50-4550-b969-bbc6a573d8c2 tempest-VolumesListAdminTestJSON-117195144 None] Deleted volume successfully. Nov 02 10:10:32 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-727cac5b-2d50-4550-b969-bbc6a573d8c2 tempest-VolumesListAdminTestJSON-117195144 None] Lock "cinder-3e3b9700-2000-4b07-b412-be8c9afd1ad0-delete_volume" released by "delete_volume" :: held 2.159s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:10:32 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-ec737f04-1a62-4031-9220-5f772e87b706 tempest-VolumesListAdminTestJSON-117195144 None] Acquiring lock "cinder-66b416ec-a967-47cb-82ae-f018725c15aa-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:10:32 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-ec737f04-1a62-4031-9220-5f772e87b706 tempest-VolumesListAdminTestJSON-117195144 None] Lock "cinder-66b416ec-a967-47cb-82ae-f018725c15aa-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:10:32 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-ec737f04-1a62-4031-9220-5f772e87b706 tempest-VolumesListAdminTestJSON-117195144 None] Acquiring lock "cinder-quobyte-66b416ec-a967-47cb-82ae-f018725c15aa" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:10:32 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-ec737f04-1a62-4031-9220-5f772e87b706 tempest-VolumesListAdminTestJSON-117195144 None] Lock "cinder-quobyte-66b416ec-a967-47cb-82ae-f018725c15aa" acquired by "delete_volume" :: waited 0.016s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:10:32 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[b28419b6-52e7-41b5-b1eb-3411a5a5895a]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:10:32 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ec737f04-1a62-4031-9220-5f772e87b706 tempest-VolumesListAdminTestJSON-117195144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-66b416ec-a967-47cb-82ae-f018725c15aa {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:32 devstack sudo[95787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-66b416ec-a967-47cb-82ae-f018725c15aa Nov 02 10:10:32 devstack sudo[95787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:33 devstack sudo[95787]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:33 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ec737f04-1a62-4031-9220-5f772e87b706 tempest-VolumesListAdminTestJSON-117195144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-66b416ec-a967-47cb-82ae-f018725c15aa" returned: 0 in 0.441s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:33 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ec737f04-1a62-4031-9220-5f772e87b706 tempest-VolumesListAdminTestJSON-117195144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-66b416ec-a967-47cb-82ae-f018725c15aa {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:33 devstack sudo[95795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-66b416ec-a967-47cb-82ae-f018725c15aa Nov 02 10:10:33 devstack sudo[95795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:33 devstack sudo[95795]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:33 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ec737f04-1a62-4031-9220-5f772e87b706 tempest-VolumesListAdminTestJSON-117195144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-66b416ec-a967-47cb-82ae-f018725c15aa" returned: 0 in 0.350s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:33 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-ec737f04-1a62-4031-9220-5f772e87b706 tempest-VolumesListAdminTestJSON-117195144 None] Lock "cinder-quobyte-66b416ec-a967-47cb-82ae-f018725c15aa" released by "delete_volume" :: held 0.862s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:10:33 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-ec737f04-1a62-4031-9220-5f772e87b706 tempest-VolumesListAdminTestJSON-117195144 None] Created reservations ['7abc826b-bc99-4a5b-b893-a5de6c841783', '1ca5d02b-f131-48c3-92f5-45809834a77e', '3f2d9e28-58ef-42cd-a875-8474e7c24689', 'e3859075-c10c-4416-8e47-d471806ab997'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:10:33 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-ec737f04-1a62-4031-9220-5f772e87b706 tempest-VolumesListAdminTestJSON-117195144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:10:33 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-ec737f04-1a62-4031-9220-5f772e87b706 tempest-VolumesListAdminTestJSON-117195144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:10:33 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-ec737f04-1a62-4031-9220-5f772e87b706 tempest-VolumesListAdminTestJSON-117195144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:10:33 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-ec737f04-1a62-4031-9220-5f772e87b706 tempest-VolumesListAdminTestJSON-117195144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:10:33 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-ec737f04-1a62-4031-9220-5f772e87b706 tempest-VolumesListAdminTestJSON-117195144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:10:33 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ec737f04-1a62-4031-9220-5f772e87b706 tempest-VolumesListAdminTestJSON-117195144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:33 devstack sudo[95798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:10:33 devstack sudo[95798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:34 devstack sudo[95798]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ec737f04-1a62-4031-9220-5f772e87b706 tempest-VolumesListAdminTestJSON-117195144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.323s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:34 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-ec737f04-1a62-4031-9220-5f772e87b706 tempest-VolumesListAdminTestJSON-117195144 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:10:34 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-ec737f04-1a62-4031-9220-5f772e87b706 tempest-VolumesListAdminTestJSON-117195144 None] Deleted volume successfully. Nov 02 10:10:34 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-ec737f04-1a62-4031-9220-5f772e87b706 tempest-VolumesListAdminTestJSON-117195144 None] Lock "cinder-66b416ec-a967-47cb-82ae-f018725c15aa-delete_volume" released by "delete_volume" :: held 1.599s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:10:34 devstack cinder-volume[86890]: DEBUG oslo_service.periodic_task [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86890) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:10:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:10:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:10:34 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:10:34 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:10:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:10:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:34 devstack sudo[95804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:10:34 devstack sudo[95804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:35 devstack sudo[95804]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:35 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.421s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:35 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:10:35 devstack cinder-volume[86890]: DEBUG oslo_service.periodic_task [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Running periodic task VolumeManager._thread_info {{(pid=86890) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:10:35 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] thread count: 29 {{(pid=86890) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:10:35 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] thread info: [<_MainThread(MainThread, started 133913319395456)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86890) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:10:39 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-4f0b09c3-64c3-4570-9448-e26183e0b7e2 tempest-AttachVolumeShelveTestJSON-1576967688 None] Acquiring lock "cinder-2f4fa2b4-7f36-4a3e-94c6-3de8ecad679e-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:10:39 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-4f0b09c3-64c3-4570-9448-e26183e0b7e2 tempest-AttachVolumeShelveTestJSON-1576967688 None] Lock "cinder-2f4fa2b4-7f36-4a3e-94c6-3de8ecad679e-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:10:39 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-4f0b09c3-64c3-4570-9448-e26183e0b7e2 tempest-AttachVolumeShelveTestJSON-1576967688 None] Acquiring lock "cinder-quobyte-2f4fa2b4-7f36-4a3e-94c6-3de8ecad679e" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:10:39 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-4f0b09c3-64c3-4570-9448-e26183e0b7e2 tempest-AttachVolumeShelveTestJSON-1576967688 None] Lock "cinder-quobyte-2f4fa2b4-7f36-4a3e-94c6-3de8ecad679e" acquired by "delete_volume" :: waited 0.020s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:10:39 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[465b9d3b-1cef-493b-8cac-11145e9622f3]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:10:39 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-4f0b09c3-64c3-4570-9448-e26183e0b7e2 tempest-AttachVolumeShelveTestJSON-1576967688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-2f4fa2b4-7f36-4a3e-94c6-3de8ecad679e {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:39 devstack sudo[95877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-2f4fa2b4-7f36-4a3e-94c6-3de8ecad679e Nov 02 10:10:39 devstack sudo[95877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:40 devstack sudo[95877]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:40 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-4f0b09c3-64c3-4570-9448-e26183e0b7e2 tempest-AttachVolumeShelveTestJSON-1576967688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-2f4fa2b4-7f36-4a3e-94c6-3de8ecad679e" returned: 0 in 0.845s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:40 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-4f0b09c3-64c3-4570-9448-e26183e0b7e2 tempest-AttachVolumeShelveTestJSON-1576967688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-2f4fa2b4-7f36-4a3e-94c6-3de8ecad679e {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:40 devstack sudo[95904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-2f4fa2b4-7f36-4a3e-94c6-3de8ecad679e Nov 02 10:10:40 devstack sudo[95904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:40 devstack sudo[95904]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:40 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-4f0b09c3-64c3-4570-9448-e26183e0b7e2 tempest-AttachVolumeShelveTestJSON-1576967688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-2f4fa2b4-7f36-4a3e-94c6-3de8ecad679e" returned: 0 in 0.566s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:40 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-4f0b09c3-64c3-4570-9448-e26183e0b7e2 tempest-AttachVolumeShelveTestJSON-1576967688 None] Lock "cinder-quobyte-2f4fa2b4-7f36-4a3e-94c6-3de8ecad679e" released by "delete_volume" :: held 1.532s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:10:40 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-4f0b09c3-64c3-4570-9448-e26183e0b7e2 tempest-AttachVolumeShelveTestJSON-1576967688 None] Created reservations ['cee46791-d829-4f1e-ada1-6d3a2c095fa3', '5956c59c-ac9e-4a27-916d-83829afa0520', '6e7f3331-de1e-49f0-a057-ab8c83d182e3', 'fb7393ab-5cef-422d-80e8-2257552f091a'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:10:41 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-4f0b09c3-64c3-4570-9448-e26183e0b7e2 tempest-AttachVolumeShelveTestJSON-1576967688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:10:41 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-4f0b09c3-64c3-4570-9448-e26183e0b7e2 tempest-AttachVolumeShelveTestJSON-1576967688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:10:41 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-4f0b09c3-64c3-4570-9448-e26183e0b7e2 tempest-AttachVolumeShelveTestJSON-1576967688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:10:41 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-4f0b09c3-64c3-4570-9448-e26183e0b7e2 tempest-AttachVolumeShelveTestJSON-1576967688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:10:41 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-4f0b09c3-64c3-4570-9448-e26183e0b7e2 tempest-AttachVolumeShelveTestJSON-1576967688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:10:41 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-4f0b09c3-64c3-4570-9448-e26183e0b7e2 tempest-AttachVolumeShelveTestJSON-1576967688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:41 devstack sudo[96000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:10:41 devstack sudo[96000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:42 devstack sudo[96000]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:42 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-4f0b09c3-64c3-4570-9448-e26183e0b7e2 tempest-AttachVolumeShelveTestJSON-1576967688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.834s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:42 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-4f0b09c3-64c3-4570-9448-e26183e0b7e2 tempest-AttachVolumeShelveTestJSON-1576967688 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:10:42 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-4f0b09c3-64c3-4570-9448-e26183e0b7e2 tempest-AttachVolumeShelveTestJSON-1576967688 None] Deleted volume successfully. Nov 02 10:10:42 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-4f0b09c3-64c3-4570-9448-e26183e0b7e2 tempest-AttachVolumeShelveTestJSON-1576967688 None] Lock "cinder-2f4fa2b4-7f36-4a3e-94c6-3de8ecad679e-delete_volume" released by "delete_volume" :: held 3.120s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:10:46 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d1f5a43-af98-4549-8f36-072e4aa30660 tempest-VolumesImageMetadata-284985087 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:10:46 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-8d1f5a43-af98-4549-8f36-072e4aa30660 tempest-VolumesImageMetadata-284985087 None] Flow 'volume_create_manager' (6eb5e516-54d9-4f46-96fb-76c6ca58a7d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:10:46 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-8d1f5a43-af98-4549-8f36-072e4aa30660 tempest-VolumesImageMetadata-284985087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ce403dc-7a5f-4462-ad16-f4c570fffda1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:10:46 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-8d1f5a43-af98-4549-8f36-072e4aa30660 tempest-VolumesImageMetadata-284985087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ce403dc-7a5f-4462-ad16-f4c570fffda1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:10:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1771437855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcf75396-5584-4783-904e-1cbf5dce2684,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='658953225f5749bdbfb17d0969c14653',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:10:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:10:47Z,use_quota=True,user_id='468fb63fc0d7476cbd972e4667427fe6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:10:46 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-8d1f5a43-af98-4549-8f36-072e4aa30660 tempest-VolumesImageMetadata-284985087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe850f55-3eab-4e70-a56b-fdff8210bc2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:10:46 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-8d1f5a43-af98-4549-8f36-072e4aa30660 tempest-VolumesImageMetadata-284985087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe850f55-3eab-4e70-a56b-fdff8210bc2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:10:46 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-8d1f5a43-af98-4549-8f36-072e4aa30660 tempest-VolumesImageMetadata-284985087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8d669a5-2d4b-4ab8-9ce4-ebfe83929887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:10:46 devstack cinder-volume[86890]: DEBUG cinder.image.glance [None req-8d1f5a43-af98-4549-8f36-072e4aa30660 tempest-VolumesImageMetadata-284985087 None] Creating Keystone auth plugin from conf {{(pid=86890) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 10:10:47 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-8d1f5a43-af98-4549-8f36-072e4aa30660 tempest-VolumesImageMetadata-284985087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8d669a5-2d4b-4ab8-9ce4-ebfe83929887) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'fcf75396-5584-4783-904e-1cbf5dce2684', 'volume_name': 'volume-fcf75396-5584-4783-904e-1cbf5dce2684', 'volume_size': 1, 'image_id': '7a393fa7-4879-486c-8216-4d35448485cf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7a393fa7-4879-486c-8216-4d35448485cf', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '606cf27a36794aa3805ebe6d987aa1a4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7a393fa7-4879-486c-8216-4d35448485cf', 'created_at': datetime.datetime(2026, 11, 2, 8, 55, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 8, 55, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7a393fa7-4879-486c-8216-4d35448485cf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:10:47 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-8d1f5a43-af98-4549-8f36-072e4aa30660 tempest-VolumesImageMetadata-284985087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ccf263d-989d-4c20-a342-2c2eec409bb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:10:47 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-8d1f5a43-af98-4549-8f36-072e4aa30660 tempest-VolumesImageMetadata-284985087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ccf263d-989d-4c20-a342-2c2eec409bb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:10:47 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-8d1f5a43-af98-4549-8f36-072e4aa30660 tempest-VolumesImageMetadata-284985087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be2436cf-48db-402a-af3a-7afb0e43821e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:10:47 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-8d1f5a43-af98-4549-8f36-072e4aa30660 tempest-VolumesImageMetadata-284985087 None] Volume fcf75396-5584-4783-904e-1cbf5dce2684: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-fcf75396-5584-4783-904e-1cbf5dce2684', 'volume_size': 1, 'image_id': '7a393fa7-4879-486c-8216-4d35448485cf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7a393fa7-4879-486c-8216-4d35448485cf', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '606cf27a36794aa3805ebe6d987aa1a4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7a393fa7-4879-486c-8216-4d35448485cf', 'created_at': datetime.datetime(2026, 11, 2, 8, 55, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 8, 55, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7a393fa7-4879-486c-8216-4d35448485cf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 02 10:10:47 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d1f5a43-af98-4549-8f36-072e4aa30660 tempest-VolumesImageMetadata-284985087 None] Trying to clone fcf75396-5584-4783-904e-1cbf5dce2684 from image 7a393fa7-4879-486c-8216-4d35448485cf at location (None, [{'url': 'file:///opt/stack/data/glance/images/7a393fa7-4879-486c-8216-4d35448485cf', 'metadata': {}}]). {{(pid=86890) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 02 10:10:48 devstack cinder-volume[86890]: DEBUG cinder.image.image_utils [None req-8d1f5a43-af98-4549-8f36-072e4aa30660 tempest-VolumesImageMetadata-284985087 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7a393fa7-4879-486c-8216-4d35448485cf_miwc18m9devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86890) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 02 10:10:48 devstack cinder-volume[86890]: INFO cinder.image.image_utils [None req-8d1f5a43-af98-4549-8f36-072e4aa30660 tempest-VolumesImageMetadata-284985087 None] Image download 20.69 MB at 20.69 MB/s Nov 02 10:10:48 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac5b92ff-918e-49db-a7e0-2d0a99d9a074]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:10:48 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8d1f5a43-af98-4549-8f36-072e4aa30660 tempest-VolumesImageMetadata-284985087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7a393fa7-4879-486c-8216-4d35448485cf_miwc18m9devstack@QuobyteHD {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:48 devstack sudo[96374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7a393fa7-4879-486c-8216-4d35448485cf_miwc18m9devstack@QuobyteHD Nov 02 10:10:48 devstack sudo[96374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:49 devstack sudo[96374]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:49 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8d1f5a43-af98-4549-8f36-072e4aa30660 tempest-VolumesImageMetadata-284985087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7a393fa7-4879-486c-8216-4d35448485cf_miwc18m9devstack@QuobyteHD" returned: 0 in 0.690s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:49 devstack cinder-volume[86890]: DEBUG cinder.image.image_utils [None req-8d1f5a43-af98-4549-8f36-072e4aa30660 tempest-VolumesImageMetadata-284985087 None] Temporary image 7a393fa7-4879-486c-8216-4d35448485cf is fetched for user 468fb63fc0d7476cbd972e4667427fe6. {{(pid=86890) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 02 10:10:49 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[f38abd04-9f56-4402-b295-e7b5d1a8b1f1]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:10:49 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8d1f5a43-af98-4549-8f36-072e4aa30660 tempest-VolumesImageMetadata-284985087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7a393fa7-4879-486c-8216-4d35448485cf_miwc18m9devstack@QuobyteHD {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:49 devstack sudo[96379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7a393fa7-4879-486c-8216-4d35448485cf_miwc18m9devstack@QuobyteHD Nov 02 10:10:49 devstack sudo[96379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:49 devstack sudo[96379]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:49 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8d1f5a43-af98-4549-8f36-072e4aa30660 tempest-VolumesImageMetadata-284985087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7a393fa7-4879-486c-8216-4d35448485cf_miwc18m9devstack@QuobyteHD" returned: 0 in 0.543s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:49 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-8d1f5a43-af98-4549-8f36-072e4aa30660 tempest-VolumesImageMetadata-284985087 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:10:49 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-8d1f5a43-af98-4549-8f36-072e4aa30660 tempest-VolumesImageMetadata-284985087 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:10:49 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-8d1f5a43-af98-4549-8f36-072e4aa30660 tempest-VolumesImageMetadata-284985087 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:10:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1771437855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcf75396-5584-4783-904e-1cbf5dce2684,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='658953225f5749bdbfb17d0969c14653',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:10:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:10:47Z,use_quota=True,user_id='468fb63fc0d7476cbd972e4667427fe6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:10:49 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-8d1f5a43-af98-4549-8f36-072e4aa30660 tempest-VolumesImageMetadata-284985087 None] Creating volume fcf75396-5584-4783-904e-1cbf5dce2684 {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:10:49 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-8d1f5a43-af98-4549-8f36-072e4aa30660 tempest-VolumesImageMetadata-284985087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:10:49 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-8d1f5a43-af98-4549-8f36-072e4aa30660 tempest-VolumesImageMetadata-284985087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:10:50 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-8d1f5a43-af98-4549-8f36-072e4aa30660 tempest-VolumesImageMetadata-284985087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:10:50 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-8d1f5a43-af98-4549-8f36-072e4aa30660 tempest-VolumesImageMetadata-284985087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:10:50 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-8d1f5a43-af98-4549-8f36-072e4aa30660 tempest-VolumesImageMetadata-284985087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:10:50 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-8d1f5a43-af98-4549-8f36-072e4aa30660 tempest-VolumesImageMetadata-284985087 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:10:50 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-8d1f5a43-af98-4549-8f36-072e4aa30660 tempest-VolumesImageMetadata-284985087 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:10:50 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8d1f5a43-af98-4549-8f36-072e4aa30660 tempest-VolumesImageMetadata-284985087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-fcf75396-5584-4783-904e-1cbf5dce2684 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:50 devstack sudo[96385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-fcf75396-5584-4783-904e-1cbf5dce2684 1073741824 Nov 02 10:10:50 devstack sudo[96385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:51 devstack sudo[96385]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:51 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8d1f5a43-af98-4549-8f36-072e4aa30660 tempest-VolumesImageMetadata-284985087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-fcf75396-5584-4783-904e-1cbf5dce2684 1073741824" returned: 0 in 1.070s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:51 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8d1f5a43-af98-4549-8f36-072e4aa30660 tempest-VolumesImageMetadata-284985087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-fcf75396-5584-4783-904e-1cbf5dce2684 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:51 devstack sudo[96390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-fcf75396-5584-4783-904e-1cbf5dce2684 Nov 02 10:10:51 devstack sudo[96390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:51 devstack sudo[96390]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:51 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8d1f5a43-af98-4549-8f36-072e4aa30660 tempest-VolumesImageMetadata-284985087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-fcf75396-5584-4783-904e-1cbf5dce2684" returned: 0 in 0.340s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:51 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-8d1f5a43-af98-4549-8f36-072e4aa30660 tempest-VolumesImageMetadata-284985087 None] <== create_volume: return (1497ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:10:51 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-8d1f5a43-af98-4549-8f36-072e4aa30660 tempest-VolumesImageMetadata-284985087 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.502s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:10:51 devstack cinder-volume[86890]: DEBUG cinder.volume.volume_utils [None req-8d1f5a43-af98-4549-8f36-072e4aa30660 tempest-VolumesImageMetadata-284985087 None] Attempting download of 7a393fa7-4879-486c-8216-4d35448485cf ((None, [{'url': 'file:///opt/stack/data/glance/images/7a393fa7-4879-486c-8216-4d35448485cf', 'metadata': {}}])) to volume fcf75396-5584-4783-904e-1cbf5dce2684. {{(pid=86890) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 02 10:10:51 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d962249-372c-41ce-9829-90aaa8ceb8f0]: (4, 'raw') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:10:51 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8d1f5a43-af98-4549-8f36-072e4aa30660 tempest-VolumesImageMetadata-284985087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7a393fa7-4879-486c-8216-4d35448485cf_t_voevx5 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:51 devstack sudo[96393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7a393fa7-4879-486c-8216-4d35448485cf_t_voevx5 Nov 02 10:10:51 devstack sudo[96393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:52 devstack sudo[96393]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:52 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8d1f5a43-af98-4549-8f36-072e4aa30660 tempest-VolumesImageMetadata-284985087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7a393fa7-4879-486c-8216-4d35448485cf_t_voevx5" returned: 0 in 0.583s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:52 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8d1f5a43-af98-4549-8f36-072e4aa30660 tempest-VolumesImageMetadata-284985087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7a393fa7-4879-486c-8216-4d35448485cf_t_voevx5 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:52 devstack sudo[96397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7a393fa7-4879-486c-8216-4d35448485cf_t_voevx5 Nov 02 10:10:52 devstack sudo[96397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:53 devstack sudo[96397]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:53 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8d1f5a43-af98-4549-8f36-072e4aa30660 tempest-VolumesImageMetadata-284985087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7a393fa7-4879-486c-8216-4d35448485cf_t_voevx5" returned: 1 in 0.855s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:53 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8d1f5a43-af98-4549-8f36-072e4aa30660 tempest-VolumesImageMetadata-284985087 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7a393fa7-4879-486c-8216-4d35448485cf_t_voevx5' failed. Not Retrying. {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 10:10:53 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfaf8e84-45e8-4add-a98b-fe709874a862]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:10:53 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8d1f5a43-af98-4549-8f36-072e4aa30660 tempest-VolumesImageMetadata-284985087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7a393fa7-4879-486c-8216-4d35448485cf_miwc18m9devstack@QuobyteHD {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:53 devstack sudo[96422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7a393fa7-4879-486c-8216-4d35448485cf_miwc18m9devstack@QuobyteHD Nov 02 10:10:53 devstack sudo[96422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:53 devstack sudo[96422]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:53 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8d1f5a43-af98-4549-8f36-072e4aa30660 tempest-VolumesImageMetadata-284985087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7a393fa7-4879-486c-8216-4d35448485cf_miwc18m9devstack@QuobyteHD" returned: 0 in 0.468s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:53 devstack cinder-volume[86890]: DEBUG cinder.image.image_utils [None req-8d1f5a43-af98-4549-8f36-072e4aa30660 tempest-VolumesImageMetadata-284985087 None] 7a393fa7-4879-486c-8216-4d35448485cf was qcow2, converting to qcow2 {{(pid=86890) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 02 10:10:53 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8d1f5a43-af98-4549-8f36-072e4aa30660 tempest-VolumesImageMetadata-284985087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7a393fa7-4879-486c-8216-4d35448485cf_miwc18m9devstack@QuobyteHD /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-fcf75396-5584-4783-904e-1cbf5dce2684 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:53 devstack sudo[96428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7a393fa7-4879-486c-8216-4d35448485cf_miwc18m9devstack@QuobyteHD /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-fcf75396-5584-4783-904e-1cbf5dce2684 Nov 02 10:10:53 devstack sudo[96428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:56 devstack sudo[96428]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:56 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8d1f5a43-af98-4549-8f36-072e4aa30660 tempest-VolumesImageMetadata-284985087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7a393fa7-4879-486c-8216-4d35448485cf_miwc18m9devstack@QuobyteHD /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-fcf75396-5584-4783-904e-1cbf5dce2684" returned: 0 in 2.560s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:56 devstack cinder-volume[86890]: DEBUG cinder.image.image_utils [None req-8d1f5a43-af98-4549-8f36-072e4aa30660 tempest-VolumesImageMetadata-284985087 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7a393fa7-4879-486c-8216-4d35448485cf_miwc18m9devstack@QuobyteHD, size 112.00 MB, duration 2.56 sec, destination /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-fcf75396-5584-4783-904e-1cbf5dce2684 {{(pid=86890) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 10:10:56 devstack cinder-volume[86890]: INFO cinder.image.image_utils [None req-8d1f5a43-af98-4549-8f36-072e4aa30660 tempest-VolumesImageMetadata-284985087 None] Converted 112.00 MB image at 43.72 MB/s Nov 02 10:10:56 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8d1f5a43-af98-4549-8f36-072e4aa30660 tempest-VolumesImageMetadata-284985087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-fcf75396-5584-4783-904e-1cbf5dce2684 1G {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:56 devstack sudo[96451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-fcf75396-5584-4783-904e-1cbf5dce2684 1G Nov 02 10:10:56 devstack sudo[96451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:56 devstack sudo[96451]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:56 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8d1f5a43-af98-4549-8f36-072e4aa30660 tempest-VolumesImageMetadata-284985087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-fcf75396-5584-4783-904e-1cbf5dce2684 1G" returned: 0 in 0.384s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:56 devstack cinder-volume[86890]: DEBUG cinder.volume.volume_utils [None req-8d1f5a43-af98-4549-8f36-072e4aa30660 tempest-VolumesImageMetadata-284985087 None] Downloaded image 7a393fa7-4879-486c-8216-4d35448485cf ((None, [{'url': 'file:///opt/stack/data/glance/images/7a393fa7-4879-486c-8216-4d35448485cf', 'metadata': {}}])) to volume fcf75396-5584-4783-904e-1cbf5dce2684 successfully. {{(pid=86890) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 02 10:10:56 devstack cinder-volume[86890]: DEBUG cinder.image.image_utils [None req-8d1f5a43-af98-4549-8f36-072e4aa30660 tempest-VolumesImageMetadata-284985087 None] Temporary image 7a393fa7-4879-486c-8216-4d35448485cf for user 468fb63fc0d7476cbd972e4667427fe6 is deleted. {{(pid=86890) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 02 10:10:56 devstack cinder-volume[86890]: DEBUG cinder.volume.volume_utils [None req-8d1f5a43-af98-4549-8f36-072e4aa30660 tempest-VolumesImageMetadata-284985087 None] Marking volume fcf75396-5584-4783-904e-1cbf5dce2684 as bootable. {{(pid=86890) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 02 10:10:56 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d1f5a43-af98-4549-8f36-072e4aa30660 tempest-VolumesImageMetadata-284985087 None] Copying metadata from image 7a393fa7-4879-486c-8216-4d35448485cf to fcf75396-5584-4783-904e-1cbf5dce2684. {{(pid=86890) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 10:10:56 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d1f5a43-af98-4549-8f36-072e4aa30660 tempest-VolumesImageMetadata-284985087 None] Creating volume glance metadata for volume fcf75396-5584-4783-904e-1cbf5dce2684 backed by image 7a393fa7-4879-486c-8216-4d35448485cf with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '7a393fa7-4879-486c-8216-4d35448485cf', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86890) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 10:10:56 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-8d1f5a43-af98-4549-8f36-072e4aa30660 tempest-VolumesImageMetadata-284985087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be2436cf-48db-402a-af3a-7afb0e43821e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fcf75396-5584-4783-904e-1cbf5dce2684', 'volume_size': 1, 'image_id': '7a393fa7-4879-486c-8216-4d35448485cf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7a393fa7-4879-486c-8216-4d35448485cf', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '606cf27a36794aa3805ebe6d987aa1a4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7a393fa7-4879-486c-8216-4d35448485cf', 'created_at': datetime.datetime(2026, 11, 2, 8, 55, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 8, 55, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7a393fa7-4879-486c-8216-4d35448485cf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:10:56 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-8d1f5a43-af98-4549-8f36-072e4aa30660 tempest-VolumesImageMetadata-284985087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6d47a27-d1ff-4e4e-a45b-ddef41a97a64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:10:56 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-8d1f5a43-af98-4549-8f36-072e4aa30660 tempest-VolumesImageMetadata-284985087 None] Volume volume-fcf75396-5584-4783-904e-1cbf5dce2684 (fcf75396-5584-4783-904e-1cbf5dce2684): created successfully Nov 02 10:10:56 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-8d1f5a43-af98-4549-8f36-072e4aa30660 tempest-VolumesImageMetadata-284985087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6d47a27-d1ff-4e4e-a45b-ddef41a97a64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:10:56 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-8d1f5a43-af98-4549-8f36-072e4aa30660 tempest-VolumesImageMetadata-284985087 None] Flow 'volume_create_manager' (6eb5e516-54d9-4f46-96fb-76c6ca58a7d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:10:56 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-8d1f5a43-af98-4549-8f36-072e4aa30660 tempest-VolumesImageMetadata-284985087 None] Created volume successfully. Nov 02 10:10:58 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-de907a2f-90ba-4fb0-aef4-4b08653c5b5c tempest-VolumesImageMetadata-284985087 None] Acquiring lock "cinder-fcf75396-5584-4783-904e-1cbf5dce2684-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:10:58 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-de907a2f-90ba-4fb0-aef4-4b08653c5b5c tempest-VolumesImageMetadata-284985087 None] Lock "cinder-fcf75396-5584-4783-904e-1cbf5dce2684-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:10:58 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-de907a2f-90ba-4fb0-aef4-4b08653c5b5c tempest-VolumesImageMetadata-284985087 None] Acquiring lock "cinder-quobyte-fcf75396-5584-4783-904e-1cbf5dce2684" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:10:58 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-de907a2f-90ba-4fb0-aef4-4b08653c5b5c tempest-VolumesImageMetadata-284985087 None] Lock "cinder-quobyte-fcf75396-5584-4783-904e-1cbf5dce2684" acquired by "delete_volume" :: waited 0.037s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:10:58 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[48a7c539-1410-4e21-a21c-f76ecda9eea3]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:10:58 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-de907a2f-90ba-4fb0-aef4-4b08653c5b5c tempest-VolumesImageMetadata-284985087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-fcf75396-5584-4783-904e-1cbf5dce2684 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:58 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdca8083-646d-4d1d-b3ca-636092ce3f6f tempest-VolumesTestJSON-1851420636 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:10:58 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-cdca8083-646d-4d1d-b3ca-636092ce3f6f tempest-VolumesTestJSON-1851420636 None] Flow 'volume_create_manager' (76ca2180-fb65-4d9f-9ba2-4b26f0203d60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:10:58 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-cdca8083-646d-4d1d-b3ca-636092ce3f6f tempest-VolumesTestJSON-1851420636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42569f6f-fb50-4f71-bbb3-82e351fd11a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:10:58 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-cdca8083-646d-4d1d-b3ca-636092ce3f6f tempest-VolumesTestJSON-1851420636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42569f6f-fb50-4f71-bbb3-82e351fd11a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:10:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1733416513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bea2779-2f38-4269-a983-69f15d35ffd4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='05bf9f3fc9284ecfaa5f1bd3352d59f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:10:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:10:59Z,use_quota=True,user_id='9baa7b03a87c484c94fd90b1b6caa01d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:10:58 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-cdca8083-646d-4d1d-b3ca-636092ce3f6f tempest-VolumesTestJSON-1851420636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d84ed479-faa8-4485-bd47-e61524e38ae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:10:58 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-cdca8083-646d-4d1d-b3ca-636092ce3f6f tempest-VolumesTestJSON-1851420636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d84ed479-faa8-4485-bd47-e61524e38ae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:10:58 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-cdca8083-646d-4d1d-b3ca-636092ce3f6f tempest-VolumesTestJSON-1851420636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85da7882-eb4d-4ab5-a343-a56a8ef1672d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:10:58 devstack sudo[96456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-fcf75396-5584-4783-904e-1cbf5dce2684 Nov 02 10:10:58 devstack sudo[96456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:58 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-cdca8083-646d-4d1d-b3ca-636092ce3f6f tempest-VolumesTestJSON-1851420636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85da7882-eb4d-4ab5-a343-a56a8ef1672d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8bea2779-2f38-4269-a983-69f15d35ffd4', 'volume_name': 'volume-8bea2779-2f38-4269-a983-69f15d35ffd4', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:10:58 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-cdca8083-646d-4d1d-b3ca-636092ce3f6f tempest-VolumesTestJSON-1851420636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e70208cf-de18-477d-8edd-378ef31cb8ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:10:58 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-cdca8083-646d-4d1d-b3ca-636092ce3f6f tempest-VolumesTestJSON-1851420636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e70208cf-de18-477d-8edd-378ef31cb8ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:10:58 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-cdca8083-646d-4d1d-b3ca-636092ce3f6f tempest-VolumesTestJSON-1851420636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa368bb3-35a7-4a8c-8e24-468639f1e040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:10:58 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-cdca8083-646d-4d1d-b3ca-636092ce3f6f tempest-VolumesTestJSON-1851420636 None] Volume 8bea2779-2f38-4269-a983-69f15d35ffd4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8bea2779-2f38-4269-a983-69f15d35ffd4', 'volume_size': 1} Nov 02 10:10:58 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-cdca8083-646d-4d1d-b3ca-636092ce3f6f tempest-VolumesTestJSON-1851420636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:10:58 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-cdca8083-646d-4d1d-b3ca-636092ce3f6f tempest-VolumesTestJSON-1851420636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:10:58 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-cdca8083-646d-4d1d-b3ca-636092ce3f6f tempest-VolumesTestJSON-1851420636 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:10:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1733416513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bea2779-2f38-4269-a983-69f15d35ffd4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='05bf9f3fc9284ecfaa5f1bd3352d59f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:10:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:10:59Z,use_quota=True,user_id='9baa7b03a87c484c94fd90b1b6caa01d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:10:58 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-cdca8083-646d-4d1d-b3ca-636092ce3f6f tempest-VolumesTestJSON-1851420636 None] Creating volume 8bea2779-2f38-4269-a983-69f15d35ffd4 {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:10:58 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-cdca8083-646d-4d1d-b3ca-636092ce3f6f tempest-VolumesTestJSON-1851420636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:10:58 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-cdca8083-646d-4d1d-b3ca-636092ce3f6f tempest-VolumesTestJSON-1851420636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:10:58 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-cdca8083-646d-4d1d-b3ca-636092ce3f6f tempest-VolumesTestJSON-1851420636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:10:58 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-cdca8083-646d-4d1d-b3ca-636092ce3f6f tempest-VolumesTestJSON-1851420636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:10:58 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-cdca8083-646d-4d1d-b3ca-636092ce3f6f tempest-VolumesTestJSON-1851420636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:10:58 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-cdca8083-646d-4d1d-b3ca-636092ce3f6f tempest-VolumesTestJSON-1851420636 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:10:58 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-cdca8083-646d-4d1d-b3ca-636092ce3f6f tempest-VolumesTestJSON-1851420636 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:10:58 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-cdca8083-646d-4d1d-b3ca-636092ce3f6f tempest-VolumesTestJSON-1851420636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-8bea2779-2f38-4269-a983-69f15d35ffd4 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:58 devstack sudo[96458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-8bea2779-2f38-4269-a983-69f15d35ffd4 1073741824 Nov 02 10:10:58 devstack sudo[96458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:59 devstack sudo[96456]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:59 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-de907a2f-90ba-4fb0-aef4-4b08653c5b5c tempest-VolumesImageMetadata-284985087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-fcf75396-5584-4783-904e-1cbf5dce2684" returned: 0 in 0.457s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:59 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-de907a2f-90ba-4fb0-aef4-4b08653c5b5c tempest-VolumesImageMetadata-284985087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-fcf75396-5584-4783-904e-1cbf5dce2684 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:59 devstack sudo[96464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-fcf75396-5584-4783-904e-1cbf5dce2684 Nov 02 10:10:59 devstack sudo[96464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:59 devstack sudo[96464]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:59 devstack sudo[96458]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:59 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-de907a2f-90ba-4fb0-aef4-4b08653c5b5c tempest-VolumesImageMetadata-284985087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-fcf75396-5584-4783-904e-1cbf5dce2684" returned: 0 in 0.375s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:59 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-cdca8083-646d-4d1d-b3ca-636092ce3f6f tempest-VolumesTestJSON-1851420636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-8bea2779-2f38-4269-a983-69f15d35ffd4 1073741824" returned: 0 in 0.680s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:59 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-de907a2f-90ba-4fb0-aef4-4b08653c5b5c tempest-VolumesImageMetadata-284985087 None] Lock "cinder-quobyte-fcf75396-5584-4783-904e-1cbf5dce2684" released by "delete_volume" :: held 0.937s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:10:59 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-cdca8083-646d-4d1d-b3ca-636092ce3f6f tempest-VolumesTestJSON-1851420636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-8bea2779-2f38-4269-a983-69f15d35ffd4 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:59 devstack sudo[96471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-8bea2779-2f38-4269-a983-69f15d35ffd4 Nov 02 10:10:59 devstack sudo[96471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:59 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-de907a2f-90ba-4fb0-aef4-4b08653c5b5c tempest-VolumesImageMetadata-284985087 None] Created reservations ['e882d057-6c4c-462e-b992-1cf3bb10db20', 'a3eb2dc3-1707-4619-9bcd-04618609c928', '76904047-4030-4b8f-8280-fecf9c3395d7', '26b6fd57-aca4-4500-af81-cd196243abfb'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:10:59 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-de907a2f-90ba-4fb0-aef4-4b08653c5b5c tempest-VolumesImageMetadata-284985087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:10:59 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-de907a2f-90ba-4fb0-aef4-4b08653c5b5c tempest-VolumesImageMetadata-284985087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:10:59 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-de907a2f-90ba-4fb0-aef4-4b08653c5b5c tempest-VolumesImageMetadata-284985087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:10:59 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-de907a2f-90ba-4fb0-aef4-4b08653c5b5c tempest-VolumesImageMetadata-284985087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:10:59 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-de907a2f-90ba-4fb0-aef4-4b08653c5b5c tempest-VolumesImageMetadata-284985087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:10:59 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-de907a2f-90ba-4fb0-aef4-4b08653c5b5c tempest-VolumesImageMetadata-284985087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:59 devstack sudo[96473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:10:59 devstack sudo[96473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:59 devstack sudo[96471]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:59 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-cdca8083-646d-4d1d-b3ca-636092ce3f6f tempest-VolumesTestJSON-1851420636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-8bea2779-2f38-4269-a983-69f15d35ffd4" returned: 0 in 0.412s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:59 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-cdca8083-646d-4d1d-b3ca-636092ce3f6f tempest-VolumesTestJSON-1851420636 None] <== create_volume: return (1161ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:10:59 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-cdca8083-646d-4d1d-b3ca-636092ce3f6f tempest-VolumesTestJSON-1851420636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.168s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:10:59 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-cdca8083-646d-4d1d-b3ca-636092ce3f6f tempest-VolumesTestJSON-1851420636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa368bb3-35a7-4a8c-8e24-468639f1e040) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bea2779-2f38-4269-a983-69f15d35ffd4', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:10:59 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-cdca8083-646d-4d1d-b3ca-636092ce3f6f tempest-VolumesTestJSON-1851420636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1142408a-6cb5-4b5b-9cbc-995a172fbc0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:11:00 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-cdca8083-646d-4d1d-b3ca-636092ce3f6f tempest-VolumesTestJSON-1851420636 None] Volume volume-8bea2779-2f38-4269-a983-69f15d35ffd4 (8bea2779-2f38-4269-a983-69f15d35ffd4): created successfully Nov 02 10:11:00 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-cdca8083-646d-4d1d-b3ca-636092ce3f6f tempest-VolumesTestJSON-1851420636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1142408a-6cb5-4b5b-9cbc-995a172fbc0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:11:00 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-cdca8083-646d-4d1d-b3ca-636092ce3f6f tempest-VolumesTestJSON-1851420636 None] Flow 'volume_create_manager' (76ca2180-fb65-4d9f-9ba2-4b26f0203d60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:11:00 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-cdca8083-646d-4d1d-b3ca-636092ce3f6f tempest-VolumesTestJSON-1851420636 None] Created volume successfully. Nov 02 10:11:00 devstack sudo[96473]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:00 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-de907a2f-90ba-4fb0-aef4-4b08653c5b5c tempest-VolumesImageMetadata-284985087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.370s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:00 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-de907a2f-90ba-4fb0-aef4-4b08653c5b5c tempest-VolumesImageMetadata-284985087 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:11:00 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-de907a2f-90ba-4fb0-aef4-4b08653c5b5c tempest-VolumesImageMetadata-284985087 None] Deleted volume successfully. Nov 02 10:11:00 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-de907a2f-90ba-4fb0-aef4-4b08653c5b5c tempest-VolumesImageMetadata-284985087 None] Lock "cinder-fcf75396-5584-4783-904e-1cbf5dce2684-delete_volume" released by "delete_volume" :: held 1.701s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:11:01 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7b283e6-fde8-419a-9d44-62c5b2fadcff tempest-VolumesTestJSON-1851420636 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:11:01 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-b7b283e6-fde8-419a-9d44-62c5b2fadcff tempest-VolumesTestJSON-1851420636 None] Flow 'volume_create_manager' (419d9ec6-7872-4700-b253-f74f56156f85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:11:01 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-b7b283e6-fde8-419a-9d44-62c5b2fadcff tempest-VolumesTestJSON-1851420636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a32bd093-c59d-4617-b7a6-8b8f834a082a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:11:01 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-b7b283e6-fde8-419a-9d44-62c5b2fadcff tempest-VolumesTestJSON-1851420636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a32bd093-c59d-4617-b7a6-8b8f834a082a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:11:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-749041623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36b6a3d9-f8d9-4253-b830-a61d829f4ac3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='05bf9f3fc9284ecfaa5f1bd3352d59f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:11:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:11:01Z,use_quota=True,user_id='9baa7b03a87c484c94fd90b1b6caa01d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:11:01 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-b7b283e6-fde8-419a-9d44-62c5b2fadcff tempest-VolumesTestJSON-1851420636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1095b43-364a-49f1-a373-a31fdd79a657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:11:01 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-b7b283e6-fde8-419a-9d44-62c5b2fadcff tempest-VolumesTestJSON-1851420636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1095b43-364a-49f1-a373-a31fdd79a657) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:11:01 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-b7b283e6-fde8-419a-9d44-62c5b2fadcff tempest-VolumesTestJSON-1851420636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f0ff0d0-fa28-4ff8-a6ca-bc986abf8e1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:11:01 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-b7b283e6-fde8-419a-9d44-62c5b2fadcff tempest-VolumesTestJSON-1851420636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f0ff0d0-fa28-4ff8-a6ca-bc986abf8e1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36b6a3d9-f8d9-4253-b830-a61d829f4ac3', 'volume_name': 'volume-36b6a3d9-f8d9-4253-b830-a61d829f4ac3', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:11:01 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-b7b283e6-fde8-419a-9d44-62c5b2fadcff tempest-VolumesTestJSON-1851420636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f421a040-ff52-4301-b5c6-1fc136def469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:11:01 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-b7b283e6-fde8-419a-9d44-62c5b2fadcff tempest-VolumesTestJSON-1851420636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f421a040-ff52-4301-b5c6-1fc136def469) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:11:01 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-b7b283e6-fde8-419a-9d44-62c5b2fadcff tempest-VolumesTestJSON-1851420636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c2fd21f-b390-483f-838f-c625506a973d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:11:01 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-b7b283e6-fde8-419a-9d44-62c5b2fadcff tempest-VolumesTestJSON-1851420636 None] Volume 36b6a3d9-f8d9-4253-b830-a61d829f4ac3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36b6a3d9-f8d9-4253-b830-a61d829f4ac3', 'volume_size': 1} Nov 02 10:11:01 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-b7b283e6-fde8-419a-9d44-62c5b2fadcff tempest-VolumesTestJSON-1851420636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:11:01 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-b7b283e6-fde8-419a-9d44-62c5b2fadcff tempest-VolumesTestJSON-1851420636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:11:01 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-b7b283e6-fde8-419a-9d44-62c5b2fadcff tempest-VolumesTestJSON-1851420636 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:11:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-749041623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36b6a3d9-f8d9-4253-b830-a61d829f4ac3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='05bf9f3fc9284ecfaa5f1bd3352d59f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:11:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:11:01Z,use_quota=True,user_id='9baa7b03a87c484c94fd90b1b6caa01d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:11:01 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-b7b283e6-fde8-419a-9d44-62c5b2fadcff tempest-VolumesTestJSON-1851420636 None] Creating volume 36b6a3d9-f8d9-4253-b830-a61d829f4ac3 {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:11:01 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-b7b283e6-fde8-419a-9d44-62c5b2fadcff tempest-VolumesTestJSON-1851420636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:11:01 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-b7b283e6-fde8-419a-9d44-62c5b2fadcff tempest-VolumesTestJSON-1851420636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:11:01 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-b7b283e6-fde8-419a-9d44-62c5b2fadcff tempest-VolumesTestJSON-1851420636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:11:01 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-b7b283e6-fde8-419a-9d44-62c5b2fadcff tempest-VolumesTestJSON-1851420636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:11:01 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-b7b283e6-fde8-419a-9d44-62c5b2fadcff tempest-VolumesTestJSON-1851420636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:11:01 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-b7b283e6-fde8-419a-9d44-62c5b2fadcff tempest-VolumesTestJSON-1851420636 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:11:01 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-b7b283e6-fde8-419a-9d44-62c5b2fadcff tempest-VolumesTestJSON-1851420636 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:11:01 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-b7b283e6-fde8-419a-9d44-62c5b2fadcff tempest-VolumesTestJSON-1851420636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-36b6a3d9-f8d9-4253-b830-a61d829f4ac3 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:01 devstack sudo[96501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-36b6a3d9-f8d9-4253-b830-a61d829f4ac3 1073741824 Nov 02 10:11:01 devstack sudo[96501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:02 devstack sudo[96501]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:02 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-b7b283e6-fde8-419a-9d44-62c5b2fadcff tempest-VolumesTestJSON-1851420636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-36b6a3d9-f8d9-4253-b830-a61d829f4ac3 1073741824" returned: 0 in 0.624s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:02 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-b7b283e6-fde8-419a-9d44-62c5b2fadcff tempest-VolumesTestJSON-1851420636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-36b6a3d9-f8d9-4253-b830-a61d829f4ac3 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:02 devstack sudo[96512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-36b6a3d9-f8d9-4253-b830-a61d829f4ac3 Nov 02 10:11:02 devstack sudo[96512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:02 devstack sudo[96512]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:02 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-b7b283e6-fde8-419a-9d44-62c5b2fadcff tempest-VolumesTestJSON-1851420636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-36b6a3d9-f8d9-4253-b830-a61d829f4ac3" returned: 0 in 0.449s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:02 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-b7b283e6-fde8-419a-9d44-62c5b2fadcff tempest-VolumesTestJSON-1851420636 None] <== create_volume: return (1141ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:11:02 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-b7b283e6-fde8-419a-9d44-62c5b2fadcff tempest-VolumesTestJSON-1851420636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.145s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:11:02 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-b7b283e6-fde8-419a-9d44-62c5b2fadcff tempest-VolumesTestJSON-1851420636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c2fd21f-b390-483f-838f-c625506a973d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36b6a3d9-f8d9-4253-b830-a61d829f4ac3', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:11:02 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-b7b283e6-fde8-419a-9d44-62c5b2fadcff tempest-VolumesTestJSON-1851420636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd863cd3-796e-4851-aa2d-68aaa77527d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:11:02 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-b7b283e6-fde8-419a-9d44-62c5b2fadcff tempest-VolumesTestJSON-1851420636 None] Volume volume-36b6a3d9-f8d9-4253-b830-a61d829f4ac3 (36b6a3d9-f8d9-4253-b830-a61d829f4ac3): created successfully Nov 02 10:11:02 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-b7b283e6-fde8-419a-9d44-62c5b2fadcff tempest-VolumesTestJSON-1851420636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd863cd3-796e-4851-aa2d-68aaa77527d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:11:02 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-b7b283e6-fde8-419a-9d44-62c5b2fadcff tempest-VolumesTestJSON-1851420636 None] Flow 'volume_create_manager' (419d9ec6-7872-4700-b253-f74f56156f85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:11:02 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-b7b283e6-fde8-419a-9d44-62c5b2fadcff tempest-VolumesTestJSON-1851420636 None] Created volume successfully. Nov 02 10:11:04 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6b99e8a-dd83-4da0-b5b3-ae1fcb172739 tempest-VolumesTestJSON-1851420636 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:11:04 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-d6b99e8a-dd83-4da0-b5b3-ae1fcb172739 tempest-VolumesTestJSON-1851420636 None] Flow 'volume_create_manager' (7346b6b8-ecba-47ad-9fc4-9861098f7edf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:11:04 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-d6b99e8a-dd83-4da0-b5b3-ae1fcb172739 tempest-VolumesTestJSON-1851420636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad55e5d3-26f0-4e0a-afdf-e2520b14b490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:11:04 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-d6b99e8a-dd83-4da0-b5b3-ae1fcb172739 tempest-VolumesTestJSON-1851420636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad55e5d3-26f0-4e0a-afdf-e2520b14b490) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:11:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-562338610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68edec8f-0248-4bd6-bf01-58774fdd0677,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='05bf9f3fc9284ecfaa5f1bd3352d59f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:11:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:11:04Z,use_quota=True,user_id='9baa7b03a87c484c94fd90b1b6caa01d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:11:04 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-d6b99e8a-dd83-4da0-b5b3-ae1fcb172739 tempest-VolumesTestJSON-1851420636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16bc8b3d-2428-4847-b682-f8bc150f7070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:11:04 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-d6b99e8a-dd83-4da0-b5b3-ae1fcb172739 tempest-VolumesTestJSON-1851420636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16bc8b3d-2428-4847-b682-f8bc150f7070) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:11:04 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-d6b99e8a-dd83-4da0-b5b3-ae1fcb172739 tempest-VolumesTestJSON-1851420636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15c67d0c-afff-4737-b8a5-3a8e54dcff05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:11:04 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-d6b99e8a-dd83-4da0-b5b3-ae1fcb172739 tempest-VolumesTestJSON-1851420636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15c67d0c-afff-4737-b8a5-3a8e54dcff05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68edec8f-0248-4bd6-bf01-58774fdd0677', 'volume_name': 'volume-68edec8f-0248-4bd6-bf01-58774fdd0677', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:11:04 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-d6b99e8a-dd83-4da0-b5b3-ae1fcb172739 tempest-VolumesTestJSON-1851420636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0b35dc6-5467-46e4-aafa-00edc193b8d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:11:04 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-d6b99e8a-dd83-4da0-b5b3-ae1fcb172739 tempest-VolumesTestJSON-1851420636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0b35dc6-5467-46e4-aafa-00edc193b8d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:11:04 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-d6b99e8a-dd83-4da0-b5b3-ae1fcb172739 tempest-VolumesTestJSON-1851420636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (539781bd-3538-40cc-a3a2-6ea454ff0477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:11:04 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-d6b99e8a-dd83-4da0-b5b3-ae1fcb172739 tempest-VolumesTestJSON-1851420636 None] Volume 68edec8f-0248-4bd6-bf01-58774fdd0677: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68edec8f-0248-4bd6-bf01-58774fdd0677', 'volume_size': 1} Nov 02 10:11:04 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-d6b99e8a-dd83-4da0-b5b3-ae1fcb172739 tempest-VolumesTestJSON-1851420636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:11:04 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-d6b99e8a-dd83-4da0-b5b3-ae1fcb172739 tempest-VolumesTestJSON-1851420636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:11:04 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-d6b99e8a-dd83-4da0-b5b3-ae1fcb172739 tempest-VolumesTestJSON-1851420636 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:11:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-562338610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68edec8f-0248-4bd6-bf01-58774fdd0677,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='05bf9f3fc9284ecfaa5f1bd3352d59f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:11:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:11:04Z,use_quota=True,user_id='9baa7b03a87c484c94fd90b1b6caa01d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:11:04 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-d6b99e8a-dd83-4da0-b5b3-ae1fcb172739 tempest-VolumesTestJSON-1851420636 None] Creating volume 68edec8f-0248-4bd6-bf01-58774fdd0677 {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:11:04 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-d6b99e8a-dd83-4da0-b5b3-ae1fcb172739 tempest-VolumesTestJSON-1851420636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:11:04 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-d6b99e8a-dd83-4da0-b5b3-ae1fcb172739 tempest-VolumesTestJSON-1851420636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:11:04 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-d6b99e8a-dd83-4da0-b5b3-ae1fcb172739 tempest-VolumesTestJSON-1851420636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:11:04 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-d6b99e8a-dd83-4da0-b5b3-ae1fcb172739 tempest-VolumesTestJSON-1851420636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:11:04 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-d6b99e8a-dd83-4da0-b5b3-ae1fcb172739 tempest-VolumesTestJSON-1851420636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:11:04 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-d6b99e8a-dd83-4da0-b5b3-ae1fcb172739 tempest-VolumesTestJSON-1851420636 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:11:04 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-d6b99e8a-dd83-4da0-b5b3-ae1fcb172739 tempest-VolumesTestJSON-1851420636 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:11:04 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-d6b99e8a-dd83-4da0-b5b3-ae1fcb172739 tempest-VolumesTestJSON-1851420636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-68edec8f-0248-4bd6-bf01-58774fdd0677 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:04 devstack sudo[96526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-68edec8f-0248-4bd6-bf01-58774fdd0677 1073741824 Nov 02 10:11:04 devstack sudo[96526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:05 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-5287a35b-2a87-415e-9708-c347cd71cc08 tempest-AttachVolumeNegativeTest-1700545160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:11:05 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-5287a35b-2a87-415e-9708-c347cd71cc08 tempest-AttachVolumeNegativeTest-1700545160 None] Flow 'volume_create_manager' (59438f41-9037-4d17-884e-15e2c0b4104d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:11:05 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-5287a35b-2a87-415e-9708-c347cd71cc08 tempest-AttachVolumeNegativeTest-1700545160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9593db2b-27d7-449e-b4d2-068c50ce8aad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:11:05 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-5287a35b-2a87-415e-9708-c347cd71cc08 tempest-AttachVolumeNegativeTest-1700545160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9593db2b-27d7-449e-b4d2-068c50ce8aad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:11:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1349604922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e64231a9-fda7-472a-b6e8-d2f2863bc4b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='253ee95a4446482e922e1729e2adb6c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:11:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:11:05Z,use_quota=True,user_id='ea709b481078418fad7a82c87c527935',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:11:05 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-5287a35b-2a87-415e-9708-c347cd71cc08 tempest-AttachVolumeNegativeTest-1700545160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f54d68de-f8d8-4645-98f4-edca841da4cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:11:05 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-5287a35b-2a87-415e-9708-c347cd71cc08 tempest-AttachVolumeNegativeTest-1700545160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f54d68de-f8d8-4645-98f4-edca841da4cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:11:05 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-5287a35b-2a87-415e-9708-c347cd71cc08 tempest-AttachVolumeNegativeTest-1700545160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b54fc81-eed2-4e94-a2c2-2fb0fcfaca5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:11:05 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-5287a35b-2a87-415e-9708-c347cd71cc08 tempest-AttachVolumeNegativeTest-1700545160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b54fc81-eed2-4e94-a2c2-2fb0fcfaca5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e64231a9-fda7-472a-b6e8-d2f2863bc4b7', 'volume_name': 'volume-e64231a9-fda7-472a-b6e8-d2f2863bc4b7', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:11:05 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-5287a35b-2a87-415e-9708-c347cd71cc08 tempest-AttachVolumeNegativeTest-1700545160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8eacf03-59e5-4166-90e5-42a6781a96db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:11:05 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-5287a35b-2a87-415e-9708-c347cd71cc08 tempest-AttachVolumeNegativeTest-1700545160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8eacf03-59e5-4166-90e5-42a6781a96db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:11:05 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-5287a35b-2a87-415e-9708-c347cd71cc08 tempest-AttachVolumeNegativeTest-1700545160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e40db6d3-931b-4f6a-b8da-518e3359d4f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:11:05 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-5287a35b-2a87-415e-9708-c347cd71cc08 tempest-AttachVolumeNegativeTest-1700545160 None] Volume e64231a9-fda7-472a-b6e8-d2f2863bc4b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e64231a9-fda7-472a-b6e8-d2f2863bc4b7', 'volume_size': 1} Nov 02 10:11:05 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-5287a35b-2a87-415e-9708-c347cd71cc08 tempest-AttachVolumeNegativeTest-1700545160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:11:05 devstack sudo[96526]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:05 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-d6b99e8a-dd83-4da0-b5b3-ae1fcb172739 tempest-VolumesTestJSON-1851420636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-68edec8f-0248-4bd6-bf01-58774fdd0677 1073741824" returned: 0 in 0.783s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:05 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-d6b99e8a-dd83-4da0-b5b3-ae1fcb172739 tempest-VolumesTestJSON-1851420636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-68edec8f-0248-4bd6-bf01-58774fdd0677 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:05 devstack sudo[96540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-68edec8f-0248-4bd6-bf01-58774fdd0677 Nov 02 10:11:05 devstack sudo[96540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:05 devstack sudo[96540]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:05 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-d6b99e8a-dd83-4da0-b5b3-ae1fcb172739 tempest-VolumesTestJSON-1851420636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-68edec8f-0248-4bd6-bf01-58774fdd0677" returned: 0 in 0.293s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:05 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-d6b99e8a-dd83-4da0-b5b3-ae1fcb172739 tempest-VolumesTestJSON-1851420636 None] <== create_volume: return (1132ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:11:05 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-d6b99e8a-dd83-4da0-b5b3-ae1fcb172739 tempest-VolumesTestJSON-1851420636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.138s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:11:05 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-5287a35b-2a87-415e-9708-c347cd71cc08 tempest-AttachVolumeNegativeTest-1700545160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.462s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:11:05 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-5287a35b-2a87-415e-9708-c347cd71cc08 tempest-AttachVolumeNegativeTest-1700545160 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:11:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1349604922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e64231a9-fda7-472a-b6e8-d2f2863bc4b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='253ee95a4446482e922e1729e2adb6c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:11:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:11:05Z,use_quota=True,user_id='ea709b481078418fad7a82c87c527935',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:11:05 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-5287a35b-2a87-415e-9708-c347cd71cc08 tempest-AttachVolumeNegativeTest-1700545160 None] Creating volume e64231a9-fda7-472a-b6e8-d2f2863bc4b7 {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:11:05 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-5287a35b-2a87-415e-9708-c347cd71cc08 tempest-AttachVolumeNegativeTest-1700545160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:11:05 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-5287a35b-2a87-415e-9708-c347cd71cc08 tempest-AttachVolumeNegativeTest-1700545160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:11:05 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-5287a35b-2a87-415e-9708-c347cd71cc08 tempest-AttachVolumeNegativeTest-1700545160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:11:05 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-5287a35b-2a87-415e-9708-c347cd71cc08 tempest-AttachVolumeNegativeTest-1700545160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:11:05 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-5287a35b-2a87-415e-9708-c347cd71cc08 tempest-AttachVolumeNegativeTest-1700545160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:11:05 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-5287a35b-2a87-415e-9708-c347cd71cc08 tempest-AttachVolumeNegativeTest-1700545160 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:11:05 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-5287a35b-2a87-415e-9708-c347cd71cc08 tempest-AttachVolumeNegativeTest-1700545160 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:11:05 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-5287a35b-2a87-415e-9708-c347cd71cc08 tempest-AttachVolumeNegativeTest-1700545160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e64231a9-fda7-472a-b6e8-d2f2863bc4b7 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:05 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-d6b99e8a-dd83-4da0-b5b3-ae1fcb172739 tempest-VolumesTestJSON-1851420636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (539781bd-3538-40cc-a3a2-6ea454ff0477) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68edec8f-0248-4bd6-bf01-58774fdd0677', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:11:05 devstack sudo[96548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e64231a9-fda7-472a-b6e8-d2f2863bc4b7 1073741824 Nov 02 10:11:05 devstack sudo[96548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:05 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-d6b99e8a-dd83-4da0-b5b3-ae1fcb172739 tempest-VolumesTestJSON-1851420636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46cdca3a-92fd-4e0d-a808-616a30de8850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:11:05 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-d6b99e8a-dd83-4da0-b5b3-ae1fcb172739 tempest-VolumesTestJSON-1851420636 None] Volume volume-68edec8f-0248-4bd6-bf01-58774fdd0677 (68edec8f-0248-4bd6-bf01-58774fdd0677): created successfully Nov 02 10:11:05 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-d6b99e8a-dd83-4da0-b5b3-ae1fcb172739 tempest-VolumesTestJSON-1851420636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46cdca3a-92fd-4e0d-a808-616a30de8850) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:11:05 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-d6b99e8a-dd83-4da0-b5b3-ae1fcb172739 tempest-VolumesTestJSON-1851420636 None] Flow 'volume_create_manager' (7346b6b8-ecba-47ad-9fc4-9861098f7edf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:11:05 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-d6b99e8a-dd83-4da0-b5b3-ae1fcb172739 tempest-VolumesTestJSON-1851420636 None] Created volume successfully. Nov 02 10:11:06 devstack sudo[96548]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:06 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-5287a35b-2a87-415e-9708-c347cd71cc08 tempest-AttachVolumeNegativeTest-1700545160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e64231a9-fda7-472a-b6e8-d2f2863bc4b7 1073741824" returned: 0 in 0.588s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:06 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-5287a35b-2a87-415e-9708-c347cd71cc08 tempest-AttachVolumeNegativeTest-1700545160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e64231a9-fda7-472a-b6e8-d2f2863bc4b7 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:06 devstack sudo[96554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e64231a9-fda7-472a-b6e8-d2f2863bc4b7 Nov 02 10:11:06 devstack sudo[96554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:06 devstack sudo[96554]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:06 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-5287a35b-2a87-415e-9708-c347cd71cc08 tempest-AttachVolumeNegativeTest-1700545160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e64231a9-fda7-472a-b6e8-d2f2863bc4b7" returned: 0 in 0.267s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:06 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-5287a35b-2a87-415e-9708-c347cd71cc08 tempest-AttachVolumeNegativeTest-1700545160 None] <== create_volume: return (912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:11:06 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-5287a35b-2a87-415e-9708-c347cd71cc08 tempest-AttachVolumeNegativeTest-1700545160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:11:06 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-5287a35b-2a87-415e-9708-c347cd71cc08 tempest-AttachVolumeNegativeTest-1700545160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e40db6d3-931b-4f6a-b8da-518e3359d4f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e64231a9-fda7-472a-b6e8-d2f2863bc4b7', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:11:06 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-5287a35b-2a87-415e-9708-c347cd71cc08 tempest-AttachVolumeNegativeTest-1700545160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (912171bb-563d-4b59-b1bc-b78b0949d1c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:11:06 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-5287a35b-2a87-415e-9708-c347cd71cc08 tempest-AttachVolumeNegativeTest-1700545160 None] Volume volume-e64231a9-fda7-472a-b6e8-d2f2863bc4b7 (e64231a9-fda7-472a-b6e8-d2f2863bc4b7): created successfully Nov 02 10:11:06 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-5287a35b-2a87-415e-9708-c347cd71cc08 tempest-AttachVolumeNegativeTest-1700545160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (912171bb-563d-4b59-b1bc-b78b0949d1c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:11:06 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-5287a35b-2a87-415e-9708-c347cd71cc08 tempest-AttachVolumeNegativeTest-1700545160 None] Flow 'volume_create_manager' (59438f41-9037-4d17-884e-15e2c0b4104d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:11:06 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-5287a35b-2a87-415e-9708-c347cd71cc08 tempest-AttachVolumeNegativeTest-1700545160 None] Created volume successfully. Nov 02 10:11:07 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-933e561c-03ea-4705-82d1-73549f8e8f6a tempest-VolumesTestJSON-1851420636 None] Acquiring lock "cinder-68edec8f-0248-4bd6-bf01-58774fdd0677-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:11:07 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-933e561c-03ea-4705-82d1-73549f8e8f6a tempest-VolumesTestJSON-1851420636 None] Lock "cinder-68edec8f-0248-4bd6-bf01-58774fdd0677-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:11:07 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-933e561c-03ea-4705-82d1-73549f8e8f6a tempest-VolumesTestJSON-1851420636 None] Acquiring lock "cinder-quobyte-68edec8f-0248-4bd6-bf01-58774fdd0677" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:11:07 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-933e561c-03ea-4705-82d1-73549f8e8f6a tempest-VolumesTestJSON-1851420636 None] Lock "cinder-quobyte-68edec8f-0248-4bd6-bf01-58774fdd0677" acquired by "delete_volume" :: waited 0.020s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:11:07 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[d542ed77-907e-4d83-81ea-d53438af8d63]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:11:07 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-933e561c-03ea-4705-82d1-73549f8e8f6a tempest-VolumesTestJSON-1851420636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-68edec8f-0248-4bd6-bf01-58774fdd0677 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:08 devstack sudo[96566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-68edec8f-0248-4bd6-bf01-58774fdd0677 Nov 02 10:11:08 devstack sudo[96566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:08 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [req-d4715b9e-dfe2-458a-a7c4-11805b29dbc2 req-d7cb4cad-f558-4c28-8d9f-d1a50426786d tempest-AttachVolumeNegativeTest-1700545160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:11:08 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [req-d4715b9e-dfe2-458a-a7c4-11805b29dbc2 req-d7cb4cad-f558-4c28-8d9f-d1a50426786d tempest-AttachVolumeNegativeTest-1700545160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:11:08 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [req-d4715b9e-dfe2-458a-a7c4-11805b29dbc2 req-d7cb4cad-f558-4c28-8d9f-d1a50426786d tempest-AttachVolumeNegativeTest-1700545160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:11:08 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [req-d4715b9e-dfe2-458a-a7c4-11805b29dbc2 req-d7cb4cad-f558-4c28-8d9f-d1a50426786d tempest-AttachVolumeNegativeTest-1700545160 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67', 'name': 'volume-e64231a9-fda7-472a-b6e8-d2f2863bc4b7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7641de0a-c574-46c7-8c2c-73436fcab332', 'enforce_multipath': True} {{(pid=86890) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:11:08 devstack cinder-volume[86890]: INFO cinder.volume.manager [req-d4715b9e-dfe2-458a-a7c4-11805b29dbc2 req-d7cb4cad-f558-4c28-8d9f-d1a50426786d tempest-AttachVolumeNegativeTest-1700545160 None] attachment_update completed successfully. Nov 02 10:11:08 devstack sudo[96566]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:08 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-933e561c-03ea-4705-82d1-73549f8e8f6a tempest-VolumesTestJSON-1851420636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-68edec8f-0248-4bd6-bf01-58774fdd0677" returned: 0 in 0.459s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:08 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-933e561c-03ea-4705-82d1-73549f8e8f6a tempest-VolumesTestJSON-1851420636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-68edec8f-0248-4bd6-bf01-58774fdd0677 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:08 devstack sudo[96575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-68edec8f-0248-4bd6-bf01-58774fdd0677 Nov 02 10:11:08 devstack sudo[96575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:08 devstack sudo[96575]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:08 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-933e561c-03ea-4705-82d1-73549f8e8f6a tempest-VolumesTestJSON-1851420636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-68edec8f-0248-4bd6-bf01-58774fdd0677" returned: 0 in 0.328s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:08 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-933e561c-03ea-4705-82d1-73549f8e8f6a tempest-VolumesTestJSON-1851420636 None] Lock "cinder-quobyte-68edec8f-0248-4bd6-bf01-58774fdd0677" released by "delete_volume" :: held 0.851s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:11:08 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-933e561c-03ea-4705-82d1-73549f8e8f6a tempest-VolumesTestJSON-1851420636 None] Created reservations ['3f2d77a3-659e-46dc-832c-7d489ea95989', '8500c0d4-8622-41cf-a83a-7cf29545973c', 'e7841050-9e54-436b-b5d0-3a9596602af2', '2dc3c71c-3902-4435-8250-45311d158b82'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:11:08 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-933e561c-03ea-4705-82d1-73549f8e8f6a tempest-VolumesTestJSON-1851420636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:11:08 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-933e561c-03ea-4705-82d1-73549f8e8f6a tempest-VolumesTestJSON-1851420636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:11:08 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-933e561c-03ea-4705-82d1-73549f8e8f6a tempest-VolumesTestJSON-1851420636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:11:08 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-933e561c-03ea-4705-82d1-73549f8e8f6a tempest-VolumesTestJSON-1851420636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:11:08 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-933e561c-03ea-4705-82d1-73549f8e8f6a tempest-VolumesTestJSON-1851420636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:11:08 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-933e561c-03ea-4705-82d1-73549f8e8f6a tempest-VolumesTestJSON-1851420636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:08 devstack sudo[96578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:11:08 devstack sudo[96578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:09 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-d2401219-7cd0-4f0b-8ae4-0aef7fc46113 tempest-VolumesTestJSON-1851420636 None] Acquiring lock "cinder-36b6a3d9-f8d9-4253-b830-a61d829f4ac3-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:11:09 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-d2401219-7cd0-4f0b-8ae4-0aef7fc46113 tempest-VolumesTestJSON-1851420636 None] Lock "cinder-36b6a3d9-f8d9-4253-b830-a61d829f4ac3-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:11:09 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-d2401219-7cd0-4f0b-8ae4-0aef7fc46113 tempest-VolumesTestJSON-1851420636 None] Acquiring lock "cinder-quobyte-36b6a3d9-f8d9-4253-b830-a61d829f4ac3" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:11:09 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-d2401219-7cd0-4f0b-8ae4-0aef7fc46113 tempest-VolumesTestJSON-1851420636 None] Lock "cinder-quobyte-36b6a3d9-f8d9-4253-b830-a61d829f4ac3" acquired by "delete_volume" :: waited 0.018s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:11:09 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[643b3b27-df2a-4119-98e4-0f4db348f9df]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:11:09 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-d2401219-7cd0-4f0b-8ae4-0aef7fc46113 tempest-VolumesTestJSON-1851420636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-36b6a3d9-f8d9-4253-b830-a61d829f4ac3 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:09 devstack sudo[96578]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:09 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-933e561c-03ea-4705-82d1-73549f8e8f6a tempest-VolumesTestJSON-1851420636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.334s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:09 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-933e561c-03ea-4705-82d1-73549f8e8f6a tempest-VolumesTestJSON-1851420636 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:11:09 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-933e561c-03ea-4705-82d1-73549f8e8f6a tempest-VolumesTestJSON-1851420636 None] Deleted volume successfully. Nov 02 10:11:09 devstack sudo[96580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-36b6a3d9-f8d9-4253-b830-a61d829f4ac3 Nov 02 10:11:09 devstack sudo[96580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:09 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-933e561c-03ea-4705-82d1-73549f8e8f6a tempest-VolumesTestJSON-1851420636 None] Lock "cinder-68edec8f-0248-4bd6-bf01-58774fdd0677-delete_volume" released by "delete_volume" :: held 1.560s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:11:09 devstack sudo[96580]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:09 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-d2401219-7cd0-4f0b-8ae4-0aef7fc46113 tempest-VolumesTestJSON-1851420636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-36b6a3d9-f8d9-4253-b830-a61d829f4ac3" returned: 0 in 0.441s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:09 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-d2401219-7cd0-4f0b-8ae4-0aef7fc46113 tempest-VolumesTestJSON-1851420636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-36b6a3d9-f8d9-4253-b830-a61d829f4ac3 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:09 devstack sudo[96586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-36b6a3d9-f8d9-4253-b830-a61d829f4ac3 Nov 02 10:11:09 devstack sudo[96586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:09 devstack sudo[96586]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:09 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-d2401219-7cd0-4f0b-8ae4-0aef7fc46113 tempest-VolumesTestJSON-1851420636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-36b6a3d9-f8d9-4253-b830-a61d829f4ac3" returned: 0 in 0.277s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:09 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-d2401219-7cd0-4f0b-8ae4-0aef7fc46113 tempest-VolumesTestJSON-1851420636 None] Lock "cinder-quobyte-36b6a3d9-f8d9-4253-b830-a61d829f4ac3" released by "delete_volume" :: held 0.781s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:11:10 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-d2401219-7cd0-4f0b-8ae4-0aef7fc46113 tempest-VolumesTestJSON-1851420636 None] Created reservations ['441f7e27-cc52-45bc-923c-701133690264', '3be1d60e-3343-418e-8c4f-2089e3dbc10d', '8861912e-e58b-4755-8409-87354f5d9152', 'ee162272-ed66-436c-b948-06190266af0f'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:11:10 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-d2401219-7cd0-4f0b-8ae4-0aef7fc46113 tempest-VolumesTestJSON-1851420636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:11:10 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-d2401219-7cd0-4f0b-8ae4-0aef7fc46113 tempest-VolumesTestJSON-1851420636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:11:10 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-d2401219-7cd0-4f0b-8ae4-0aef7fc46113 tempest-VolumesTestJSON-1851420636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:11:10 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-d2401219-7cd0-4f0b-8ae4-0aef7fc46113 tempest-VolumesTestJSON-1851420636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:11:10 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-d2401219-7cd0-4f0b-8ae4-0aef7fc46113 tempest-VolumesTestJSON-1851420636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:11:10 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-d2401219-7cd0-4f0b-8ae4-0aef7fc46113 tempest-VolumesTestJSON-1851420636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:10 devstack sudo[96589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:11:10 devstack sudo[96589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:10 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-bd7b65f7-ce79-45f1-8b41-d201fb217daa tempest-VolumesTestJSON-1851420636 None] Acquiring lock "cinder-8bea2779-2f38-4269-a983-69f15d35ffd4-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:11:10 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-bd7b65f7-ce79-45f1-8b41-d201fb217daa tempest-VolumesTestJSON-1851420636 None] Lock "cinder-8bea2779-2f38-4269-a983-69f15d35ffd4-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:11:10 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-bd7b65f7-ce79-45f1-8b41-d201fb217daa tempest-VolumesTestJSON-1851420636 None] Acquiring lock "cinder-quobyte-8bea2779-2f38-4269-a983-69f15d35ffd4" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:11:10 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-bd7b65f7-ce79-45f1-8b41-d201fb217daa tempest-VolumesTestJSON-1851420636 None] Lock "cinder-quobyte-8bea2779-2f38-4269-a983-69f15d35ffd4" acquired by "delete_volume" :: waited 0.019s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:11:10 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c429291-9fa1-41b3-961e-e9cf60055203]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:11:10 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-bd7b65f7-ce79-45f1-8b41-d201fb217daa tempest-VolumesTestJSON-1851420636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-8bea2779-2f38-4269-a983-69f15d35ffd4 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:10 devstack sudo[96589]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:10 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-d2401219-7cd0-4f0b-8ae4-0aef7fc46113 tempest-VolumesTestJSON-1851420636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.431s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:10 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-d2401219-7cd0-4f0b-8ae4-0aef7fc46113 tempest-VolumesTestJSON-1851420636 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:11:10 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-d2401219-7cd0-4f0b-8ae4-0aef7fc46113 tempest-VolumesTestJSON-1851420636 None] Deleted volume successfully. Nov 02 10:11:10 devstack sudo[96592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-8bea2779-2f38-4269-a983-69f15d35ffd4 Nov 02 10:11:10 devstack sudo[96592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:10 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-cde2a672-1b8d-48b3-b678-a3575062c40a tempest-VolumesDeleteCascade-1379795829 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:11:10 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-cde2a672-1b8d-48b3-b678-a3575062c40a tempest-VolumesDeleteCascade-1379795829 None] Flow 'volume_create_manager' (48600532-9b90-4f8e-8123-dd309dd61e15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:11:10 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-cde2a672-1b8d-48b3-b678-a3575062c40a tempest-VolumesDeleteCascade-1379795829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcf39369-a39c-4c9d-9956-26b4cae6d348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:11:10 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-d2401219-7cd0-4f0b-8ae4-0aef7fc46113 tempest-VolumesTestJSON-1851420636 None] Lock "cinder-36b6a3d9-f8d9-4253-b830-a61d829f4ac3-delete_volume" released by "delete_volume" :: held 1.632s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:11:10 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-cde2a672-1b8d-48b3-b678-a3575062c40a tempest-VolumesDeleteCascade-1379795829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcf39369-a39c-4c9d-9956-26b4cae6d348) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:11:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-997395190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddc5e87a-a042-43bd-9a50-f5b46e3d480d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d7cf55f3c9a46618bbfbfd5a5487d05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:11:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:11:11Z,use_quota=True,user_id='77a1591eaadd49ac92fcb91825363f8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:11:10 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-cde2a672-1b8d-48b3-b678-a3575062c40a tempest-VolumesDeleteCascade-1379795829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f495998f-189b-4cad-b22b-38bc7a0b4bfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:11:10 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-cde2a672-1b8d-48b3-b678-a3575062c40a tempest-VolumesDeleteCascade-1379795829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f495998f-189b-4cad-b22b-38bc7a0b4bfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:11:10 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-cde2a672-1b8d-48b3-b678-a3575062c40a tempest-VolumesDeleteCascade-1379795829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c40dca69-e62e-4b7f-8073-5473631807c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:11:10 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-cde2a672-1b8d-48b3-b678-a3575062c40a tempest-VolumesDeleteCascade-1379795829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c40dca69-e62e-4b7f-8073-5473631807c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ddc5e87a-a042-43bd-9a50-f5b46e3d480d', 'volume_name': 'volume-ddc5e87a-a042-43bd-9a50-f5b46e3d480d', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:11:10 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-cde2a672-1b8d-48b3-b678-a3575062c40a tempest-VolumesDeleteCascade-1379795829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f09e0bb4-5c51-4248-8874-fa80ae5044be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:11:10 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-cde2a672-1b8d-48b3-b678-a3575062c40a tempest-VolumesDeleteCascade-1379795829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f09e0bb4-5c51-4248-8874-fa80ae5044be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:11:10 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-cde2a672-1b8d-48b3-b678-a3575062c40a tempest-VolumesDeleteCascade-1379795829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94ee913b-0768-4e68-adfe-e61bd8127338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:11:10 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-cde2a672-1b8d-48b3-b678-a3575062c40a tempest-VolumesDeleteCascade-1379795829 None] Volume ddc5e87a-a042-43bd-9a50-f5b46e3d480d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ddc5e87a-a042-43bd-9a50-f5b46e3d480d', 'volume_size': 1} Nov 02 10:11:10 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-cde2a672-1b8d-48b3-b678-a3575062c40a tempest-VolumesDeleteCascade-1379795829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:11:10 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-cde2a672-1b8d-48b3-b678-a3575062c40a tempest-VolumesDeleteCascade-1379795829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:11:10 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-cde2a672-1b8d-48b3-b678-a3575062c40a tempest-VolumesDeleteCascade-1379795829 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:11:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-997395190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddc5e87a-a042-43bd-9a50-f5b46e3d480d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d7cf55f3c9a46618bbfbfd5a5487d05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:11:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:11:11Z,use_quota=True,user_id='77a1591eaadd49ac92fcb91825363f8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:11:10 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-cde2a672-1b8d-48b3-b678-a3575062c40a tempest-VolumesDeleteCascade-1379795829 None] Creating volume ddc5e87a-a042-43bd-9a50-f5b46e3d480d {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:11:10 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-cde2a672-1b8d-48b3-b678-a3575062c40a tempest-VolumesDeleteCascade-1379795829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:11:10 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-cde2a672-1b8d-48b3-b678-a3575062c40a tempest-VolumesDeleteCascade-1379795829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:11:10 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-cde2a672-1b8d-48b3-b678-a3575062c40a tempest-VolumesDeleteCascade-1379795829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:11:10 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-cde2a672-1b8d-48b3-b678-a3575062c40a tempest-VolumesDeleteCascade-1379795829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:11:10 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-cde2a672-1b8d-48b3-b678-a3575062c40a tempest-VolumesDeleteCascade-1379795829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:11:10 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-cde2a672-1b8d-48b3-b678-a3575062c40a tempest-VolumesDeleteCascade-1379795829 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:11:10 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-cde2a672-1b8d-48b3-b678-a3575062c40a tempest-VolumesDeleteCascade-1379795829 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:11:10 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-cde2a672-1b8d-48b3-b678-a3575062c40a tempest-VolumesDeleteCascade-1379795829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ddc5e87a-a042-43bd-9a50-f5b46e3d480d 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:10 devstack sudo[96594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ddc5e87a-a042-43bd-9a50-f5b46e3d480d 1073741824 Nov 02 10:11:10 devstack sudo[96594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:10 devstack sudo[96592]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:11 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-bd7b65f7-ce79-45f1-8b41-d201fb217daa tempest-VolumesTestJSON-1851420636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-8bea2779-2f38-4269-a983-69f15d35ffd4" returned: 0 in 0.549s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:11 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-bd7b65f7-ce79-45f1-8b41-d201fb217daa tempest-VolumesTestJSON-1851420636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-8bea2779-2f38-4269-a983-69f15d35ffd4 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:11 devstack sudo[96633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-8bea2779-2f38-4269-a983-69f15d35ffd4 Nov 02 10:11:11 devstack sudo[96633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:11 devstack sudo[96633]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:11 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-bd7b65f7-ce79-45f1-8b41-d201fb217daa tempest-VolumesTestJSON-1851420636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-8bea2779-2f38-4269-a983-69f15d35ffd4" returned: 0 in 0.446s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:11 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-bd7b65f7-ce79-45f1-8b41-d201fb217daa tempest-VolumesTestJSON-1851420636 None] Lock "cinder-quobyte-8bea2779-2f38-4269-a983-69f15d35ffd4" released by "delete_volume" :: held 1.066s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:11:11 devstack cinder-volume[86890]: DEBUG dbcounter [-] [86890] Writing DB stats cinder:SELECT=100,cinder:UPDATE=107,cinder:INSERT=34,cinder:DELETE=6 {{(pid=86890) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:11:11 devstack cinder-volume[86890]: DEBUG dbcounter [-] [86890] Writing DB stats cinder:UPDATE=96,cinder:SELECT=85,cinder:INSERT=34,cinder:DELETE=12 {{(pid=86890) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:11:11 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-bd7b65f7-ce79-45f1-8b41-d201fb217daa tempest-VolumesTestJSON-1851420636 None] Created reservations ['02e1f4f6-fb5c-4f67-be0d-c48b55b80126', '055d250f-ebc0-4981-8aff-bfac929947a0', '6d870865-d34d-4a78-84b0-5efef648442a', '056ce573-8cf3-47b5-8a53-4f3a32982427'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:11:11 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-bd7b65f7-ce79-45f1-8b41-d201fb217daa tempest-VolumesTestJSON-1851420636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:11:11 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-bd7b65f7-ce79-45f1-8b41-d201fb217daa tempest-VolumesTestJSON-1851420636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:11:11 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-bd7b65f7-ce79-45f1-8b41-d201fb217daa tempest-VolumesTestJSON-1851420636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:11:11 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-bd7b65f7-ce79-45f1-8b41-d201fb217daa tempest-VolumesTestJSON-1851420636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:11:11 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-bd7b65f7-ce79-45f1-8b41-d201fb217daa tempest-VolumesTestJSON-1851420636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:11:11 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-bd7b65f7-ce79-45f1-8b41-d201fb217daa tempest-VolumesTestJSON-1851420636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:11 devstack sudo[96594]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:11 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-cde2a672-1b8d-48b3-b678-a3575062c40a tempest-VolumesDeleteCascade-1379795829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ddc5e87a-a042-43bd-9a50-f5b46e3d480d 1073741824" returned: 0 in 0.917s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:11 devstack sudo[96644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:11:11 devstack sudo[96644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:11 devstack cinder-volume[86890]: INFO cinder.volume.manager [req-c4018971-47e7-46b1-82ed-3298d7006595 req-bd4e0935-ea94-43d0-b6c2-abb85c242c59 tempest-AttachVolumeNegativeTest-1700545160 None] Terminate volume connection completed successfully. Nov 02 10:11:11 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [req-c4018971-47e7-46b1-82ed-3298d7006595 req-bd4e0935-ea94-43d0-b6c2-abb85c242c59 tempest-AttachVolumeNegativeTest-1700545160 None] Deleting attachment 7641de0a-c574-46c7-8c2c-73436fcab332. {{(pid=86890) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:11:11 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-cde2a672-1b8d-48b3-b678-a3575062c40a tempest-VolumesDeleteCascade-1379795829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ddc5e87a-a042-43bd-9a50-f5b46e3d480d {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:11 devstack sudo[96646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ddc5e87a-a042-43bd-9a50-f5b46e3d480d Nov 02 10:11:11 devstack sudo[96646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:11 devstack sudo[96644]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:11 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-bd7b65f7-ce79-45f1-8b41-d201fb217daa tempest-VolumesTestJSON-1851420636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.285s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:11 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-bd7b65f7-ce79-45f1-8b41-d201fb217daa tempest-VolumesTestJSON-1851420636 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:11:11 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-bd7b65f7-ce79-45f1-8b41-d201fb217daa tempest-VolumesTestJSON-1851420636 None] Deleted volume successfully. Nov 02 10:11:11 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-bd7b65f7-ce79-45f1-8b41-d201fb217daa tempest-VolumesTestJSON-1851420636 None] Lock "cinder-8bea2779-2f38-4269-a983-69f15d35ffd4-delete_volume" released by "delete_volume" :: held 1.681s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:11:12 devstack sudo[96646]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:12 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-cde2a672-1b8d-48b3-b678-a3575062c40a tempest-VolumesDeleteCascade-1379795829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ddc5e87a-a042-43bd-9a50-f5b46e3d480d" returned: 0 in 0.333s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:12 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-cde2a672-1b8d-48b3-b678-a3575062c40a tempest-VolumesDeleteCascade-1379795829 None] <== create_volume: return (1313ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:11:12 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-cde2a672-1b8d-48b3-b678-a3575062c40a tempest-VolumesDeleteCascade-1379795829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.317s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:11:12 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-cde2a672-1b8d-48b3-b678-a3575062c40a tempest-VolumesDeleteCascade-1379795829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94ee913b-0768-4e68-adfe-e61bd8127338) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ddc5e87a-a042-43bd-9a50-f5b46e3d480d', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:11:12 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-cde2a672-1b8d-48b3-b678-a3575062c40a tempest-VolumesDeleteCascade-1379795829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dc960c0-9b40-4995-888f-2fb040b70469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:11:12 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-cde2a672-1b8d-48b3-b678-a3575062c40a tempest-VolumesDeleteCascade-1379795829 None] Volume volume-ddc5e87a-a042-43bd-9a50-f5b46e3d480d (ddc5e87a-a042-43bd-9a50-f5b46e3d480d): created successfully Nov 02 10:11:12 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-cde2a672-1b8d-48b3-b678-a3575062c40a tempest-VolumesDeleteCascade-1379795829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dc960c0-9b40-4995-888f-2fb040b70469) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:11:12 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-cde2a672-1b8d-48b3-b678-a3575062c40a tempest-VolumesDeleteCascade-1379795829 None] Flow 'volume_create_manager' (48600532-9b90-4f8e-8123-dd309dd61e15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:11:12 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-cde2a672-1b8d-48b3-b678-a3575062c40a tempest-VolumesDeleteCascade-1379795829 None] Created volume successfully. Nov 02 10:11:13 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-a6759409-18cc-41f3-a43f-c3c373e94e5e tempest-VolumesDeleteCascade-1379795829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:11:13 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-a6759409-18cc-41f3-a43f-c3c373e94e5e tempest-VolumesDeleteCascade-1379795829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:11:13 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-a6759409-18cc-41f3-a43f-c3c373e94e5e tempest-VolumesDeleteCascade-1379795829 None] Creating offline snapshot 6da2e07b-b910-46d0-a923-a30146342995 of volume ddc5e87a-a042-43bd-9a50-f5b46e3d480d {{(pid=86890) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:11:13 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cf35392-af7d-43f9-8763-222c14e11f6c]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:11:13 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a6759409-18cc-41f3-a43f-c3c373e94e5e tempest-VolumesDeleteCascade-1379795829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ddc5e87a-a042-43bd-9a50-f5b46e3d480d {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:13 devstack sudo[96668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ddc5e87a-a042-43bd-9a50-f5b46e3d480d Nov 02 10:11:13 devstack sudo[96668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:13 devstack sudo[96668]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:13 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a6759409-18cc-41f3-a43f-c3c373e94e5e tempest-VolumesDeleteCascade-1379795829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ddc5e87a-a042-43bd-9a50-f5b46e3d480d" returned: 0 in 0.616s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:13 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a6759409-18cc-41f3-a43f-c3c373e94e5e tempest-VolumesDeleteCascade-1379795829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ddc5e87a-a042-43bd-9a50-f5b46e3d480d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ddc5e87a-a042-43bd-9a50-f5b46e3d480d.6da2e07b-b910-46d0-a923-a30146342995 1G {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:13 devstack sudo[96679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ddc5e87a-a042-43bd-9a50-f5b46e3d480d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ddc5e87a-a042-43bd-9a50-f5b46e3d480d.6da2e07b-b910-46d0-a923-a30146342995 1G Nov 02 10:11:13 devstack sudo[96679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:14 devstack sudo[96679]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:14 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a6759409-18cc-41f3-a43f-c3c373e94e5e tempest-VolumesDeleteCascade-1379795829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ddc5e87a-a042-43bd-9a50-f5b46e3d480d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ddc5e87a-a042-43bd-9a50-f5b46e3d480d.6da2e07b-b910-46d0-a923-a30146342995 1G" returned: 0 in 0.783s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:14 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a6759409-18cc-41f3-a43f-c3c373e94e5e tempest-VolumesDeleteCascade-1379795829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ddc5e87a-a042-43bd-9a50-f5b46e3d480d -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ddc5e87a-a042-43bd-9a50-f5b46e3d480d.6da2e07b-b910-46d0-a923-a30146342995 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:14 devstack sudo[96687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ddc5e87a-a042-43bd-9a50-f5b46e3d480d -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ddc5e87a-a042-43bd-9a50-f5b46e3d480d.6da2e07b-b910-46d0-a923-a30146342995 Nov 02 10:11:14 devstack sudo[96687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:15 devstack sudo[96687]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:15 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a6759409-18cc-41f3-a43f-c3c373e94e5e tempest-VolumesDeleteCascade-1379795829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ddc5e87a-a042-43bd-9a50-f5b46e3d480d -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ddc5e87a-a042-43bd-9a50-f5b46e3d480d.6da2e07b-b910-46d0-a923-a30146342995" returned: 0 in 0.507s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:15 devstack cinder-volume[86890]: WARNING cinder.volume.drivers.remotefs [None req-a6759409-18cc-41f3-a43f-c3c373e94e5e tempest-VolumesDeleteCascade-1379795829 None] /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ddc5e87a-a042-43bd-9a50-f5b46e3d480d.6da2e07b-b910-46d0-a923-a30146342995 is being set with open permissions: ugo+rw Nov 02 10:11:15 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a6759409-18cc-41f3-a43f-c3c373e94e5e tempest-VolumesDeleteCascade-1379795829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ddc5e87a-a042-43bd-9a50-f5b46e3d480d.6da2e07b-b910-46d0-a923-a30146342995 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:15 devstack sudo[96694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ddc5e87a-a042-43bd-9a50-f5b46e3d480d.6da2e07b-b910-46d0-a923-a30146342995 Nov 02 10:11:15 devstack sudo[96694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:15 devstack sudo[96694]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:15 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a6759409-18cc-41f3-a43f-c3c373e94e5e tempest-VolumesDeleteCascade-1379795829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ddc5e87a-a042-43bd-9a50-f5b46e3d480d.6da2e07b-b910-46d0-a923-a30146342995" returned: 0 in 0.441s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:15 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a6759409-18cc-41f3-a43f-c3c373e94e5e tempest-VolumesDeleteCascade-1379795829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ddc5e87a-a042-43bd-9a50-f5b46e3d480d.info {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:15 devstack sudo[96709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ddc5e87a-a042-43bd-9a50-f5b46e3d480d.info Nov 02 10:11:15 devstack sudo[96709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:16 devstack sudo[96709]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:16 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a6759409-18cc-41f3-a43f-c3c373e94e5e tempest-VolumesDeleteCascade-1379795829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ddc5e87a-a042-43bd-9a50-f5b46e3d480d.info" returned: 0 in 0.429s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:16 devstack cinder-volume[86890]: WARNING cinder.volume.drivers.remotefs [None req-a6759409-18cc-41f3-a43f-c3c373e94e5e tempest-VolumesDeleteCascade-1379795829 None] /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ddc5e87a-a042-43bd-9a50-f5b46e3d480d.info is being set with open permissions: ugo+rw Nov 02 10:11:16 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a6759409-18cc-41f3-a43f-c3c373e94e5e tempest-VolumesDeleteCascade-1379795829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ddc5e87a-a042-43bd-9a50-f5b46e3d480d.info {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:16 devstack sudo[96712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ddc5e87a-a042-43bd-9a50-f5b46e3d480d.info Nov 02 10:11:16 devstack sudo[96712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:16 devstack sudo[96712]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:16 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a6759409-18cc-41f3-a43f-c3c373e94e5e tempest-VolumesDeleteCascade-1379795829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ddc5e87a-a042-43bd-9a50-f5b46e3d480d.info" returned: 0 in 0.551s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:16 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-a6759409-18cc-41f3-a43f-c3c373e94e5e tempest-VolumesDeleteCascade-1379795829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.551s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:11:16 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-a6759409-18cc-41f3-a43f-c3c373e94e5e tempest-VolumesDeleteCascade-1379795829 None] Create snapshot completed successfully Nov 02 10:11:17 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-7edcb467-35db-42e1-83e0-4ef621909bbc tempest-VolumesDeleteCascade-1379795829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:11:17 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-7edcb467-35db-42e1-83e0-4ef621909bbc tempest-VolumesDeleteCascade-1379795829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:11:17 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-7edcb467-35db-42e1-83e0-4ef621909bbc tempest-VolumesDeleteCascade-1379795829 None] Creating offline snapshot 425edd51-4f5a-4b58-9923-6edd9eae381e of volume ddc5e87a-a042-43bd-9a50-f5b46e3d480d {{(pid=86890) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:11:17 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[76058a77-d0fe-4c1e-9b14-1c71a79047d0]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:11:17 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-7edcb467-35db-42e1-83e0-4ef621909bbc tempest-VolumesDeleteCascade-1379795829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ddc5e87a-a042-43bd-9a50-f5b46e3d480d.6da2e07b-b910-46d0-a923-a30146342995 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:17 devstack sudo[96724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ddc5e87a-a042-43bd-9a50-f5b46e3d480d.6da2e07b-b910-46d0-a923-a30146342995 Nov 02 10:11:17 devstack sudo[96724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:18 devstack sudo[96724]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:18 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-7edcb467-35db-42e1-83e0-4ef621909bbc tempest-VolumesDeleteCascade-1379795829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ddc5e87a-a042-43bd-9a50-f5b46e3d480d.6da2e07b-b910-46d0-a923-a30146342995" returned: 0 in 0.559s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:18 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-7edcb467-35db-42e1-83e0-4ef621909bbc tempest-VolumesDeleteCascade-1379795829 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ddc5e87a-a042-43bd-9a50-f5b46e3d480d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86890) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:11:18 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-7edcb467-35db-42e1-83e0-4ef621909bbc tempest-VolumesDeleteCascade-1379795829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ddc5e87a-a042-43bd-9a50-f5b46e3d480d.6da2e07b-b910-46d0-a923-a30146342995,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ddc5e87a-a042-43bd-9a50-f5b46e3d480d.425edd51-4f5a-4b58-9923-6edd9eae381e 1G {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:18 devstack sudo[96733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ddc5e87a-a042-43bd-9a50-f5b46e3d480d.6da2e07b-b910-46d0-a923-a30146342995,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ddc5e87a-a042-43bd-9a50-f5b46e3d480d.425edd51-4f5a-4b58-9923-6edd9eae381e 1G Nov 02 10:11:18 devstack sudo[96733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:19 devstack sudo[96733]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:19 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-7edcb467-35db-42e1-83e0-4ef621909bbc tempest-VolumesDeleteCascade-1379795829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ddc5e87a-a042-43bd-9a50-f5b46e3d480d.6da2e07b-b910-46d0-a923-a30146342995,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ddc5e87a-a042-43bd-9a50-f5b46e3d480d.425edd51-4f5a-4b58-9923-6edd9eae381e 1G" returned: 0 in 0.699s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:19 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-7edcb467-35db-42e1-83e0-4ef621909bbc tempest-VolumesDeleteCascade-1379795829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ddc5e87a-a042-43bd-9a50-f5b46e3d480d.6da2e07b-b910-46d0-a923-a30146342995 -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ddc5e87a-a042-43bd-9a50-f5b46e3d480d.425edd51-4f5a-4b58-9923-6edd9eae381e {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:19 devstack sudo[96740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ddc5e87a-a042-43bd-9a50-f5b46e3d480d.6da2e07b-b910-46d0-a923-a30146342995 -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ddc5e87a-a042-43bd-9a50-f5b46e3d480d.425edd51-4f5a-4b58-9923-6edd9eae381e Nov 02 10:11:19 devstack sudo[96740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:19 devstack sudo[96740]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:19 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-7edcb467-35db-42e1-83e0-4ef621909bbc tempest-VolumesDeleteCascade-1379795829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ddc5e87a-a042-43bd-9a50-f5b46e3d480d.6da2e07b-b910-46d0-a923-a30146342995 -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ddc5e87a-a042-43bd-9a50-f5b46e3d480d.425edd51-4f5a-4b58-9923-6edd9eae381e" returned: 0 in 0.450s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:19 devstack cinder-volume[86890]: WARNING cinder.volume.drivers.remotefs [None req-7edcb467-35db-42e1-83e0-4ef621909bbc tempest-VolumesDeleteCascade-1379795829 None] /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ddc5e87a-a042-43bd-9a50-f5b46e3d480d.425edd51-4f5a-4b58-9923-6edd9eae381e is being set with open permissions: ugo+rw Nov 02 10:11:19 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-7edcb467-35db-42e1-83e0-4ef621909bbc tempest-VolumesDeleteCascade-1379795829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ddc5e87a-a042-43bd-9a50-f5b46e3d480d.425edd51-4f5a-4b58-9923-6edd9eae381e {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:19 devstack sudo[96745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ddc5e87a-a042-43bd-9a50-f5b46e3d480d.425edd51-4f5a-4b58-9923-6edd9eae381e Nov 02 10:11:19 devstack sudo[96745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:19 devstack sudo[96745]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:19 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-7edcb467-35db-42e1-83e0-4ef621909bbc tempest-VolumesDeleteCascade-1379795829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ddc5e87a-a042-43bd-9a50-f5b46e3d480d.425edd51-4f5a-4b58-9923-6edd9eae381e" returned: 0 in 0.375s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:19 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-7edcb467-35db-42e1-83e0-4ef621909bbc tempest-VolumesDeleteCascade-1379795829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.278s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:11:19 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-7edcb467-35db-42e1-83e0-4ef621909bbc tempest-VolumesDeleteCascade-1379795829 None] Create snapshot completed successfully Nov 02 10:11:20 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-8275c34d-fecb-482c-9507-c91300d358be tempest-BackendsCapabilitiesAdminTestsJSON-87571849 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.772819519043, 'free_capacity_gb': 1773.772819519043, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86890) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 02 10:11:20 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-b69c16a5-cd76-4b0c-ba04-ab6d63530fd4 tempest-BackendsCapabilitiesAdminTestsJSON-87571849 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.772819519043, 'free_capacity_gb': 1773.772819519043, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86890) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 02 10:11:20 devstack cinder-volume[86890]: INFO cinder.volume.manager [req-6466caf6-5c01-4675-b32d-22acf47612c4 req-5153e49f-4f43-4f30-a6ff-d730e8577028 tempest-TestShelveInstance-1130720155 None] Terminate volume connection completed successfully. Nov 02 10:11:20 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [req-6466caf6-5c01-4675-b32d-22acf47612c4 req-5153e49f-4f43-4f30-a6ff-d730e8577028 tempest-TestShelveInstance-1130720155 None] Deleting attachment 6a3ff16b-2afa-4da4-ab6f-04e7493b117d. {{(pid=86890) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:11:21 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-24503388-1fe9-4264-805e-7ba2ec8700a9 tempest-VolumesDeleteCascade-1379795829 None] Acquiring lock "cinder-ddc5e87a-a042-43bd-9a50-f5b46e3d480d-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:11:21 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-24503388-1fe9-4264-805e-7ba2ec8700a9 tempest-VolumesDeleteCascade-1379795829 None] Lock "cinder-ddc5e87a-a042-43bd-9a50-f5b46e3d480d-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:11:21 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-24503388-1fe9-4264-805e-7ba2ec8700a9 tempest-VolumesDeleteCascade-1379795829 None] Performing cascade delete. {{(pid=86890) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Nov 02 10:11:21 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-24503388-1fe9-4264-805e-7ba2ec8700a9 tempest-VolumesDeleteCascade-1379795829 None] Acquiring lock "cinder-425edd51-4f5a-4b58-9923-6edd9eae381e-delete_snapshot" by "delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:11:21 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-24503388-1fe9-4264-805e-7ba2ec8700a9 tempest-VolumesDeleteCascade-1379795829 None] Lock "cinder-425edd51-4f5a-4b58-9923-6edd9eae381e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:11:21 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-24503388-1fe9-4264-805e-7ba2ec8700a9 tempest-VolumesDeleteCascade-1379795829 None] Acquiring lock "cinder-quobyte-ddc5e87a-a042-43bd-9a50-f5b46e3d480d" by "delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:11:21 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-24503388-1fe9-4264-805e-7ba2ec8700a9 tempest-VolumesDeleteCascade-1379795829 None] Lock "cinder-quobyte-ddc5e87a-a042-43bd-9a50-f5b46e3d480d" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:11:21 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-24503388-1fe9-4264-805e-7ba2ec8700a9 tempest-VolumesDeleteCascade-1379795829 None] Acquiring lock "cinder-quobyte-425edd51-4f5a-4b58-9923-6edd9eae381e" by "_delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:11:21 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-24503388-1fe9-4264-805e-7ba2ec8700a9 tempest-VolumesDeleteCascade-1379795829 None] Lock "cinder-quobyte-425edd51-4f5a-4b58-9923-6edd9eae381e" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:11:21 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-24503388-1fe9-4264-805e-7ba2ec8700a9 tempest-VolumesDeleteCascade-1379795829 None] Deleting offline snapshot 425edd51-4f5a-4b58-9923-6edd9eae381e of volume ddc5e87a-a042-43bd-9a50-f5b46e3d480d {{(pid=86890) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:11:21 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-24503388-1fe9-4264-805e-7ba2ec8700a9 tempest-VolumesDeleteCascade-1379795829 None] snapshot_file for this snap is: volume-ddc5e87a-a042-43bd-9a50-f5b46e3d480d.425edd51-4f5a-4b58-9923-6edd9eae381e {{(pid=86890) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:11:21 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e374291-64a4-4ed7-9102-630d1629fa41]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:11:21 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-24503388-1fe9-4264-805e-7ba2ec8700a9 tempest-VolumesDeleteCascade-1379795829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ddc5e87a-a042-43bd-9a50-f5b46e3d480d.425edd51-4f5a-4b58-9923-6edd9eae381e {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:21 devstack sudo[96767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ddc5e87a-a042-43bd-9a50-f5b46e3d480d.425edd51-4f5a-4b58-9923-6edd9eae381e Nov 02 10:11:21 devstack sudo[96767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:21 devstack sudo[96767]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:21 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-24503388-1fe9-4264-805e-7ba2ec8700a9 tempest-VolumesDeleteCascade-1379795829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ddc5e87a-a042-43bd-9a50-f5b46e3d480d.425edd51-4f5a-4b58-9923-6edd9eae381e" returned: 0 in 0.538s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:21 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-24503388-1fe9-4264-805e-7ba2ec8700a9 tempest-VolumesDeleteCascade-1379795829 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ddc5e87a-a042-43bd-9a50-f5b46e3d480d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86890) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:11:21 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ac089e3-a24f-4013-a295-9b64312778e5]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:11:21 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-24503388-1fe9-4264-805e-7ba2ec8700a9 tempest-VolumesDeleteCascade-1379795829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ddc5e87a-a042-43bd-9a50-f5b46e3d480d.6da2e07b-b910-46d0-a923-a30146342995 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:22 devstack sudo[96772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ddc5e87a-a042-43bd-9a50-f5b46e3d480d.6da2e07b-b910-46d0-a923-a30146342995 Nov 02 10:11:22 devstack sudo[96772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:22 devstack sudo[96772]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:22 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-24503388-1fe9-4264-805e-7ba2ec8700a9 tempest-VolumesDeleteCascade-1379795829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ddc5e87a-a042-43bd-9a50-f5b46e3d480d.6da2e07b-b910-46d0-a923-a30146342995" returned: 0 in 0.581s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:22 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-24503388-1fe9-4264-805e-7ba2ec8700a9 tempest-VolumesDeleteCascade-1379795829 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ddc5e87a-a042-43bd-9a50-f5b46e3d480d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86890) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:11:22 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-24503388-1fe9-4264-805e-7ba2ec8700a9 tempest-VolumesDeleteCascade-1379795829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ddc5e87a-a042-43bd-9a50-f5b46e3d480d.425edd51-4f5a-4b58-9923-6edd9eae381e {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:22 devstack sudo[96781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ddc5e87a-a042-43bd-9a50-f5b46e3d480d.425edd51-4f5a-4b58-9923-6edd9eae381e Nov 02 10:11:22 devstack sudo[96781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:23 devstack sudo[96781]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:23 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-24503388-1fe9-4264-805e-7ba2ec8700a9 tempest-VolumesDeleteCascade-1379795829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ddc5e87a-a042-43bd-9a50-f5b46e3d480d.425edd51-4f5a-4b58-9923-6edd9eae381e" returned: 0 in 0.558s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:23 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-24503388-1fe9-4264-805e-7ba2ec8700a9 tempest-VolumesDeleteCascade-1379795829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ddc5e87a-a042-43bd-9a50-f5b46e3d480d.425edd51-4f5a-4b58-9923-6edd9eae381e {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:23 devstack sudo[96790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ddc5e87a-a042-43bd-9a50-f5b46e3d480d.425edd51-4f5a-4b58-9923-6edd9eae381e Nov 02 10:11:23 devstack sudo[96790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:23 devstack sudo[96790]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:23 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-24503388-1fe9-4264-805e-7ba2ec8700a9 tempest-VolumesDeleteCascade-1379795829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ddc5e87a-a042-43bd-9a50-f5b46e3d480d.425edd51-4f5a-4b58-9923-6edd9eae381e" returned: 0 in 0.367s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:23 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-24503388-1fe9-4264-805e-7ba2ec8700a9 tempest-VolumesDeleteCascade-1379795829 None] Lock "cinder-quobyte-425edd51-4f5a-4b58-9923-6edd9eae381e" released by "_delete_snapshot" :: held 2.238s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:11:23 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-24503388-1fe9-4264-805e-7ba2ec8700a9 tempest-VolumesDeleteCascade-1379795829 None] Lock "cinder-quobyte-ddc5e87a-a042-43bd-9a50-f5b46e3d480d" released by "delete_snapshot" :: held 2.268s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:11:23 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-24503388-1fe9-4264-805e-7ba2ec8700a9 tempest-VolumesDeleteCascade-1379795829 None] Created reservations ['ddba03ad-a4d1-4efa-97b5-cc28503f6c40', 'fde9672a-6dd7-4a9a-87f6-b2998eab9603', '295d7ebd-fa98-467a-9ac3-2f4399e87d2a', '78c0ee4d-a37e-4881-9461-17d97269070c'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:11:23 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-24503388-1fe9-4264-805e-7ba2ec8700a9 tempest-VolumesDeleteCascade-1379795829 None] Delete snapshot completed successfully. Nov 02 10:11:23 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-24503388-1fe9-4264-805e-7ba2ec8700a9 tempest-VolumesDeleteCascade-1379795829 None] Lock "cinder-425edd51-4f5a-4b58-9923-6edd9eae381e-delete_snapshot" released by "delete_snapshot" :: held 2.511s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:11:23 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-24503388-1fe9-4264-805e-7ba2ec8700a9 tempest-VolumesDeleteCascade-1379795829 None] Acquiring lock "cinder-6da2e07b-b910-46d0-a923-a30146342995-delete_snapshot" by "delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:11:23 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-24503388-1fe9-4264-805e-7ba2ec8700a9 tempest-VolumesDeleteCascade-1379795829 None] Lock "cinder-6da2e07b-b910-46d0-a923-a30146342995-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:11:23 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-24503388-1fe9-4264-805e-7ba2ec8700a9 tempest-VolumesDeleteCascade-1379795829 None] Acquiring lock "cinder-quobyte-ddc5e87a-a042-43bd-9a50-f5b46e3d480d" by "delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:11:23 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-24503388-1fe9-4264-805e-7ba2ec8700a9 tempest-VolumesDeleteCascade-1379795829 None] Lock "cinder-quobyte-ddc5e87a-a042-43bd-9a50-f5b46e3d480d" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:11:23 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-24503388-1fe9-4264-805e-7ba2ec8700a9 tempest-VolumesDeleteCascade-1379795829 None] Acquiring lock "cinder-quobyte-6da2e07b-b910-46d0-a923-a30146342995" by "_delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:11:23 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-24503388-1fe9-4264-805e-7ba2ec8700a9 tempest-VolumesDeleteCascade-1379795829 None] Lock "cinder-quobyte-6da2e07b-b910-46d0-a923-a30146342995" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:11:23 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-24503388-1fe9-4264-805e-7ba2ec8700a9 tempest-VolumesDeleteCascade-1379795829 None] Deleting offline snapshot 6da2e07b-b910-46d0-a923-a30146342995 of volume ddc5e87a-a042-43bd-9a50-f5b46e3d480d {{(pid=86890) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:11:23 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-24503388-1fe9-4264-805e-7ba2ec8700a9 tempest-VolumesDeleteCascade-1379795829 None] snapshot_file for this snap is: volume-ddc5e87a-a042-43bd-9a50-f5b46e3d480d.6da2e07b-b910-46d0-a923-a30146342995 {{(pid=86890) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:11:23 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[40bdfe99-7215-451f-a6d3-e9ef70ae763a]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:11:23 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-24503388-1fe9-4264-805e-7ba2ec8700a9 tempest-VolumesDeleteCascade-1379795829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ddc5e87a-a042-43bd-9a50-f5b46e3d480d.6da2e07b-b910-46d0-a923-a30146342995 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:24 devstack sudo[96794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ddc5e87a-a042-43bd-9a50-f5b46e3d480d.6da2e07b-b910-46d0-a923-a30146342995 Nov 02 10:11:24 devstack sudo[96794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:24 devstack sudo[96794]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:24 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-24503388-1fe9-4264-805e-7ba2ec8700a9 tempest-VolumesDeleteCascade-1379795829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ddc5e87a-a042-43bd-9a50-f5b46e3d480d.6da2e07b-b910-46d0-a923-a30146342995" returned: 0 in 0.632s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:24 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-24503388-1fe9-4264-805e-7ba2ec8700a9 tempest-VolumesDeleteCascade-1379795829 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ddc5e87a-a042-43bd-9a50-f5b46e3d480d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86890) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:11:24 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cc549be-b97b-477c-83f3-7e5e93e2eecf]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:11:24 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-24503388-1fe9-4264-805e-7ba2ec8700a9 tempest-VolumesDeleteCascade-1379795829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ddc5e87a-a042-43bd-9a50-f5b46e3d480d {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:24 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [req-a56c8ea1-1416-481a-88c2-c40895425f89 req-3d8b317c-20b7-4b59-a56b-1f01ac08a29a tempest-TestShelveInstance-1130720155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:11:24 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [req-a56c8ea1-1416-481a-88c2-c40895425f89 req-3d8b317c-20b7-4b59-a56b-1f01ac08a29a tempest-TestShelveInstance-1130720155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:11:24 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [req-a56c8ea1-1416-481a-88c2-c40895425f89 req-3d8b317c-20b7-4b59-a56b-1f01ac08a29a tempest-TestShelveInstance-1130720155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:11:24 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [req-a56c8ea1-1416-481a-88c2-c40895425f89 req-3d8b317c-20b7-4b59-a56b-1f01ac08a29a tempest-TestShelveInstance-1130720155 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67', 'name': 'volume-4c56933d-ce9c-41c2-aa45-efe5fd9f9cb5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '821201a5-ed61-4205-be03-0cf85261f437', 'enforce_multipath': True} {{(pid=86890) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:11:24 devstack sudo[96807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ddc5e87a-a042-43bd-9a50-f5b46e3d480d Nov 02 10:11:24 devstack sudo[96807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:24 devstack cinder-volume[86890]: INFO cinder.volume.manager [req-a56c8ea1-1416-481a-88c2-c40895425f89 req-3d8b317c-20b7-4b59-a56b-1f01ac08a29a tempest-TestShelveInstance-1130720155 None] attachment_update completed successfully. Nov 02 10:11:25 devstack sudo[96807]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:25 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-24503388-1fe9-4264-805e-7ba2ec8700a9 tempest-VolumesDeleteCascade-1379795829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ddc5e87a-a042-43bd-9a50-f5b46e3d480d" returned: 0 in 0.704s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:25 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-24503388-1fe9-4264-805e-7ba2ec8700a9 tempest-VolumesDeleteCascade-1379795829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ddc5e87a-a042-43bd-9a50-f5b46e3d480d.6da2e07b-b910-46d0-a923-a30146342995 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:25 devstack sudo[96825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ddc5e87a-a042-43bd-9a50-f5b46e3d480d.6da2e07b-b910-46d0-a923-a30146342995 Nov 02 10:11:25 devstack sudo[96825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:26 devstack sudo[96825]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:26 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-24503388-1fe9-4264-805e-7ba2ec8700a9 tempest-VolumesDeleteCascade-1379795829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ddc5e87a-a042-43bd-9a50-f5b46e3d480d.6da2e07b-b910-46d0-a923-a30146342995" returned: 0 in 0.726s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:26 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-24503388-1fe9-4264-805e-7ba2ec8700a9 tempest-VolumesDeleteCascade-1379795829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ddc5e87a-a042-43bd-9a50-f5b46e3d480d.6da2e07b-b910-46d0-a923-a30146342995 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:26 devstack sudo[96835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ddc5e87a-a042-43bd-9a50-f5b46e3d480d.6da2e07b-b910-46d0-a923-a30146342995 Nov 02 10:11:26 devstack sudo[96835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:26 devstack sudo[96835]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:26 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-24503388-1fe9-4264-805e-7ba2ec8700a9 tempest-VolumesDeleteCascade-1379795829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ddc5e87a-a042-43bd-9a50-f5b46e3d480d.6da2e07b-b910-46d0-a923-a30146342995" returned: 0 in 0.367s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:26 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-24503388-1fe9-4264-805e-7ba2ec8700a9 tempest-VolumesDeleteCascade-1379795829 None] Lock "cinder-quobyte-6da2e07b-b910-46d0-a923-a30146342995" released by "_delete_snapshot" :: held 2.671s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:11:26 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-24503388-1fe9-4264-805e-7ba2ec8700a9 tempest-VolumesDeleteCascade-1379795829 None] Lock "cinder-quobyte-ddc5e87a-a042-43bd-9a50-f5b46e3d480d" released by "delete_snapshot" :: held 2.710s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:11:26 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-24503388-1fe9-4264-805e-7ba2ec8700a9 tempest-VolumesDeleteCascade-1379795829 None] Created reservations ['66144dae-054d-4dd8-baca-63bb060289e2', '896fba4a-b831-48f4-95cb-bbdee2abcc02', '66b8ad30-6b21-4617-8ccd-b1c0d416eebe', '0e8aa62a-656c-40aa-9e02-322743164309'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:11:26 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-24503388-1fe9-4264-805e-7ba2ec8700a9 tempest-VolumesDeleteCascade-1379795829 None] Delete snapshot completed successfully. Nov 02 10:11:26 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-24503388-1fe9-4264-805e-7ba2ec8700a9 tempest-VolumesDeleteCascade-1379795829 None] Lock "cinder-6da2e07b-b910-46d0-a923-a30146342995-delete_snapshot" released by "delete_snapshot" :: held 2.986s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:11:26 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-24503388-1fe9-4264-805e-7ba2ec8700a9 tempest-VolumesDeleteCascade-1379795829 None] Snapshots deleted, issuing volume delete {{(pid=86890) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Nov 02 10:11:26 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-24503388-1fe9-4264-805e-7ba2ec8700a9 tempest-VolumesDeleteCascade-1379795829 None] Acquiring lock "cinder-quobyte-ddc5e87a-a042-43bd-9a50-f5b46e3d480d" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:11:26 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-24503388-1fe9-4264-805e-7ba2ec8700a9 tempest-VolumesDeleteCascade-1379795829 None] Lock "cinder-quobyte-ddc5e87a-a042-43bd-9a50-f5b46e3d480d" acquired by "delete_volume" :: waited 0.026s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:11:26 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fe6d6db-3147-49db-a319-95353fe5b5a1]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:11:26 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-24503388-1fe9-4264-805e-7ba2ec8700a9 tempest-VolumesDeleteCascade-1379795829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ddc5e87a-a042-43bd-9a50-f5b46e3d480d {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:26 devstack sudo[96838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ddc5e87a-a042-43bd-9a50-f5b46e3d480d Nov 02 10:11:26 devstack sudo[96838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:27 devstack sudo[96838]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:27 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-24503388-1fe9-4264-805e-7ba2ec8700a9 tempest-VolumesDeleteCascade-1379795829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ddc5e87a-a042-43bd-9a50-f5b46e3d480d" returned: 0 in 0.539s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:27 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-24503388-1fe9-4264-805e-7ba2ec8700a9 tempest-VolumesDeleteCascade-1379795829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ddc5e87a-a042-43bd-9a50-f5b46e3d480d {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:27 devstack sudo[96844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ddc5e87a-a042-43bd-9a50-f5b46e3d480d Nov 02 10:11:27 devstack sudo[96844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:27 devstack sudo[96844]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:27 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-24503388-1fe9-4264-805e-7ba2ec8700a9 tempest-VolumesDeleteCascade-1379795829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ddc5e87a-a042-43bd-9a50-f5b46e3d480d" returned: 0 in 0.405s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:27 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-24503388-1fe9-4264-805e-7ba2ec8700a9 tempest-VolumesDeleteCascade-1379795829 None] Lock "cinder-quobyte-ddc5e87a-a042-43bd-9a50-f5b46e3d480d" released by "delete_volume" :: held 1.062s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:11:27 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-24503388-1fe9-4264-805e-7ba2ec8700a9 tempest-VolumesDeleteCascade-1379795829 None] Created reservations ['3d8e3939-ebfb-4c6f-ab19-75927f723b0e', '4fb7884e-a4ac-4737-b0f0-ed2b04c84620', '33f24529-232e-4582-a901-2b56917b3124', 'c9b69468-1f54-42c6-9dd5-7e5ca640aaaa'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:11:28 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-24503388-1fe9-4264-805e-7ba2ec8700a9 tempest-VolumesDeleteCascade-1379795829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:11:28 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-24503388-1fe9-4264-805e-7ba2ec8700a9 tempest-VolumesDeleteCascade-1379795829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:11:28 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-24503388-1fe9-4264-805e-7ba2ec8700a9 tempest-VolumesDeleteCascade-1379795829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:11:28 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-24503388-1fe9-4264-805e-7ba2ec8700a9 tempest-VolumesDeleteCascade-1379795829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:11:28 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-24503388-1fe9-4264-805e-7ba2ec8700a9 tempest-VolumesDeleteCascade-1379795829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:11:28 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-24503388-1fe9-4264-805e-7ba2ec8700a9 tempest-VolumesDeleteCascade-1379795829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:28 devstack sudo[96848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:11:28 devstack sudo[96848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:28 devstack sudo[96848]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:28 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-24503388-1fe9-4264-805e-7ba2ec8700a9 tempest-VolumesDeleteCascade-1379795829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.317s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:28 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-24503388-1fe9-4264-805e-7ba2ec8700a9 tempest-VolumesDeleteCascade-1379795829 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:11:28 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-24503388-1fe9-4264-805e-7ba2ec8700a9 tempest-VolumesDeleteCascade-1379795829 None] Deleted volume successfully. Nov 02 10:11:28 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-24503388-1fe9-4264-805e-7ba2ec8700a9 tempest-VolumesDeleteCascade-1379795829 None] Lock "cinder-ddc5e87a-a042-43bd-9a50-f5b46e3d480d-delete_volume" released by "delete_volume" :: held 7.370s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:11:31 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-85d435a4-7f5d-49d3-b6ca-927ef8943aae tempest-VolumesDeleteCascade-1379795829 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:11:31 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-85d435a4-7f5d-49d3-b6ca-927ef8943aae tempest-VolumesDeleteCascade-1379795829 None] Flow 'volume_create_manager' (341136c6-e80f-4463-a023-17b639338b16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:11:31 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-85d435a4-7f5d-49d3-b6ca-927ef8943aae tempest-VolumesDeleteCascade-1379795829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7889564-f9b7-4401-946c-ae4565c92660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:11:31 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-85d435a4-7f5d-49d3-b6ca-927ef8943aae tempest-VolumesDeleteCascade-1379795829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7889564-f9b7-4401-946c-ae4565c92660) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:11:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-91889870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=738ada42-e52f-4a83-801d-36b551aa0c68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d7cf55f3c9a46618bbfbfd5a5487d05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:11:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:11:31Z,use_quota=True,user_id='77a1591eaadd49ac92fcb91825363f8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:11:31 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-85d435a4-7f5d-49d3-b6ca-927ef8943aae tempest-VolumesDeleteCascade-1379795829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (223a5c5f-2b95-4cbe-a88b-f2bc185fdd71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:11:31 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-85d435a4-7f5d-49d3-b6ca-927ef8943aae tempest-VolumesDeleteCascade-1379795829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (223a5c5f-2b95-4cbe-a88b-f2bc185fdd71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:11:31 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-85d435a4-7f5d-49d3-b6ca-927ef8943aae tempest-VolumesDeleteCascade-1379795829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9ac7155-12fb-4e1a-b468-7d3a4d638250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:11:31 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-85d435a4-7f5d-49d3-b6ca-927ef8943aae tempest-VolumesDeleteCascade-1379795829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9ac7155-12fb-4e1a-b468-7d3a4d638250) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '738ada42-e52f-4a83-801d-36b551aa0c68', 'volume_name': 'volume-738ada42-e52f-4a83-801d-36b551aa0c68', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:11:31 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-85d435a4-7f5d-49d3-b6ca-927ef8943aae tempest-VolumesDeleteCascade-1379795829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (576fde71-3eb2-4126-8611-3a9cf5e07ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:11:31 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-85d435a4-7f5d-49d3-b6ca-927ef8943aae tempest-VolumesDeleteCascade-1379795829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (576fde71-3eb2-4126-8611-3a9cf5e07ad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:11:31 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-85d435a4-7f5d-49d3-b6ca-927ef8943aae tempest-VolumesDeleteCascade-1379795829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59fd7088-a164-436c-8d07-b5ed86b61b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:11:31 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-85d435a4-7f5d-49d3-b6ca-927ef8943aae tempest-VolumesDeleteCascade-1379795829 None] Volume 738ada42-e52f-4a83-801d-36b551aa0c68: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-738ada42-e52f-4a83-801d-36b551aa0c68', 'volume_size': 1} Nov 02 10:11:31 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-85d435a4-7f5d-49d3-b6ca-927ef8943aae tempest-VolumesDeleteCascade-1379795829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:11:31 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-85d435a4-7f5d-49d3-b6ca-927ef8943aae tempest-VolumesDeleteCascade-1379795829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:11:31 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-85d435a4-7f5d-49d3-b6ca-927ef8943aae tempest-VolumesDeleteCascade-1379795829 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:11:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-91889870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=738ada42-e52f-4a83-801d-36b551aa0c68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d7cf55f3c9a46618bbfbfd5a5487d05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:11:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:11:31Z,use_quota=True,user_id='77a1591eaadd49ac92fcb91825363f8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:11:31 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-85d435a4-7f5d-49d3-b6ca-927ef8943aae tempest-VolumesDeleteCascade-1379795829 None] Creating volume 738ada42-e52f-4a83-801d-36b551aa0c68 {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:11:31 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-85d435a4-7f5d-49d3-b6ca-927ef8943aae tempest-VolumesDeleteCascade-1379795829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:11:31 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-85d435a4-7f5d-49d3-b6ca-927ef8943aae tempest-VolumesDeleteCascade-1379795829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:11:31 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-85d435a4-7f5d-49d3-b6ca-927ef8943aae tempest-VolumesDeleteCascade-1379795829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:11:31 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-85d435a4-7f5d-49d3-b6ca-927ef8943aae tempest-VolumesDeleteCascade-1379795829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:11:31 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-85d435a4-7f5d-49d3-b6ca-927ef8943aae tempest-VolumesDeleteCascade-1379795829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:11:31 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-85d435a4-7f5d-49d3-b6ca-927ef8943aae tempest-VolumesDeleteCascade-1379795829 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:11:31 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-85d435a4-7f5d-49d3-b6ca-927ef8943aae tempest-VolumesDeleteCascade-1379795829 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:11:31 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-85d435a4-7f5d-49d3-b6ca-927ef8943aae tempest-VolumesDeleteCascade-1379795829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-738ada42-e52f-4a83-801d-36b551aa0c68 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:31 devstack sudo[97370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-738ada42-e52f-4a83-801d-36b551aa0c68 1073741824 Nov 02 10:11:31 devstack sudo[97370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:32 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-a5e71e53-36df-4ae1-9072-44e032ba028c tempest-GroupSnapshotsTest-1082888639 None] Group tempest-GroupSnapshotsTest-Group-1333789394: creating Nov 02 10:11:32 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-a5e71e53-36df-4ae1-9072-44e032ba028c tempest-GroupSnapshotsTest-1082888639 None] Group tempest-GroupSnapshotsTest-Group-1333789394: created successfully Nov 02 10:11:32 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-a5e71e53-36df-4ae1-9072-44e032ba028c tempest-GroupSnapshotsTest-1082888639 None] Create group completed successfully. Nov 02 10:11:32 devstack sudo[97370]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:32 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-85d435a4-7f5d-49d3-b6ca-927ef8943aae tempest-VolumesDeleteCascade-1379795829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-738ada42-e52f-4a83-801d-36b551aa0c68 1073741824" returned: 0 in 1.281s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:32 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-85d435a4-7f5d-49d3-b6ca-927ef8943aae tempest-VolumesDeleteCascade-1379795829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-738ada42-e52f-4a83-801d-36b551aa0c68 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:32 devstack sudo[97396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-738ada42-e52f-4a83-801d-36b551aa0c68 Nov 02 10:11:32 devstack sudo[97396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:33 devstack sudo[97396]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:33 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-85d435a4-7f5d-49d3-b6ca-927ef8943aae tempest-VolumesDeleteCascade-1379795829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-738ada42-e52f-4a83-801d-36b551aa0c68" returned: 0 in 0.532s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:33 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-85d435a4-7f5d-49d3-b6ca-927ef8943aae tempest-VolumesDeleteCascade-1379795829 None] <== create_volume: return (1916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:11:33 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-85d435a4-7f5d-49d3-b6ca-927ef8943aae tempest-VolumesDeleteCascade-1379795829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.930s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:11:33 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-85d435a4-7f5d-49d3-b6ca-927ef8943aae tempest-VolumesDeleteCascade-1379795829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59fd7088-a164-436c-8d07-b5ed86b61b4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-738ada42-e52f-4a83-801d-36b551aa0c68', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:11:33 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-85d435a4-7f5d-49d3-b6ca-927ef8943aae tempest-VolumesDeleteCascade-1379795829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ee6f648-aa61-4170-a225-7a4b10d5770e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:11:33 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-85d435a4-7f5d-49d3-b6ca-927ef8943aae tempest-VolumesDeleteCascade-1379795829 None] Volume volume-738ada42-e52f-4a83-801d-36b551aa0c68 (738ada42-e52f-4a83-801d-36b551aa0c68): created successfully Nov 02 10:11:33 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-85d435a4-7f5d-49d3-b6ca-927ef8943aae tempest-VolumesDeleteCascade-1379795829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ee6f648-aa61-4170-a225-7a4b10d5770e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:11:33 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-85d435a4-7f5d-49d3-b6ca-927ef8943aae tempest-VolumesDeleteCascade-1379795829 None] Flow 'volume_create_manager' (341136c6-e80f-4463-a023-17b639338b16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:11:33 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-85d435a4-7f5d-49d3-b6ca-927ef8943aae tempest-VolumesDeleteCascade-1379795829 None] Created volume successfully. Nov 02 10:11:34 devstack cinder-volume[86890]: DEBUG oslo_service.periodic_task [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86890) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:11:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:11:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:11:34 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:11:34 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:11:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:11:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:34 devstack sudo[97402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:11:34 devstack sudo[97402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:35 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-a5e39593-278a-4a37-b8bd-11df0edd0449 tempest-VolumesDeleteCascade-1379795829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:11:35 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-a5e39593-278a-4a37-b8bd-11df0edd0449 tempest-VolumesDeleteCascade-1379795829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:11:35 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-6445cf28-27ce-4c13-ab72-14c44826f877 tempest-GroupSnapshotsTest-1082888639 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:11:35 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-6445cf28-27ce-4c13-ab72-14c44826f877 tempest-GroupSnapshotsTest-1082888639 None] Flow 'volume_create_manager' (22cc4423-2859-45cc-bd14-350da86a9968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:11:35 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-6445cf28-27ce-4c13-ab72-14c44826f877 tempest-GroupSnapshotsTest-1082888639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfd744f8-27dd-42c3-b1f3-048e5d8f5202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:11:35 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-a5e39593-278a-4a37-b8bd-11df0edd0449 tempest-VolumesDeleteCascade-1379795829 None] Creating offline snapshot 3d09373d-5dc8-41de-8f61-8613f5424095 of volume 738ada42-e52f-4a83-801d-36b551aa0c68 {{(pid=86890) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:11:35 devstack sudo[97402]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:35 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.369s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:35 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:11:35 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-6445cf28-27ce-4c13-ab72-14c44826f877 tempest-GroupSnapshotsTest-1082888639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfd744f8-27dd-42c3-b1f3-048e5d8f5202) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:11:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1477894228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=45c94ca2-5c64-4f35-81a0-44d01949242e,host='devstack@QuobyteHD#QuobyteHD',id=74f507a5-8b75-4b2b-9a7f-6bd47652be49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da86bd772015494296c5a89b91fd6860',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:11:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:11:35Z,use_quota=True,user_id='3ea20c0690384eebbaa7d0ec60adf22a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f13a6fdb-af79-447d-a57a-3802b76c52f1),volume_type_id=f13a6fdb-af79-447d-a57a-3802b76c52f1)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:11:35 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-6445cf28-27ce-4c13-ab72-14c44826f877 tempest-GroupSnapshotsTest-1082888639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51512612-1b0a-48ab-b4c1-725f268e0c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:11:35 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-6445cf28-27ce-4c13-ab72-14c44826f877 tempest-GroupSnapshotsTest-1082888639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51512612-1b0a-48ab-b4c1-725f268e0c34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:11:35 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-6445cf28-27ce-4c13-ab72-14c44826f877 tempest-GroupSnapshotsTest-1082888639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b496f7b-0c23-4bc4-bec1-8e7dc2ba25de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:11:35 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-6445cf28-27ce-4c13-ab72-14c44826f877 tempest-GroupSnapshotsTest-1082888639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b496f7b-0c23-4bc4-bec1-8e7dc2ba25de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74f507a5-8b75-4b2b-9a7f-6bd47652be49', 'volume_name': 'volume-74f507a5-8b75-4b2b-9a7f-6bd47652be49', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:11:35 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-6445cf28-27ce-4c13-ab72-14c44826f877 tempest-GroupSnapshotsTest-1082888639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5d633fb-e70c-4641-aa3b-c923b0b6034f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:11:35 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-6445cf28-27ce-4c13-ab72-14c44826f877 tempest-GroupSnapshotsTest-1082888639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5d633fb-e70c-4641-aa3b-c923b0b6034f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:11:35 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-6445cf28-27ce-4c13-ab72-14c44826f877 tempest-GroupSnapshotsTest-1082888639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9cae83a-b1ee-4b3d-9292-0c1f8c0832c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:11:35 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-6445cf28-27ce-4c13-ab72-14c44826f877 tempest-GroupSnapshotsTest-1082888639 None] Volume 74f507a5-8b75-4b2b-9a7f-6bd47652be49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74f507a5-8b75-4b2b-9a7f-6bd47652be49', 'volume_size': 1} Nov 02 10:11:35 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-6445cf28-27ce-4c13-ab72-14c44826f877 tempest-GroupSnapshotsTest-1082888639 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:11:35 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7b0f6c4-5e4e-4216-8a86-ec0fc8079ab7]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:11:35 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a5e39593-278a-4a37-b8bd-11df0edd0449 tempest-VolumesDeleteCascade-1379795829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-738ada42-e52f-4a83-801d-36b551aa0c68 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:35 devstack cinder-volume[86890]: DEBUG oslo_service.periodic_task [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Running periodic task VolumeManager._thread_info {{(pid=86890) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:11:35 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] thread count: 29 {{(pid=86890) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:11:35 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] thread info: [<_MainThread(MainThread, started 133913319395456)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86890) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:11:35 devstack sudo[97405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-738ada42-e52f-4a83-801d-36b551aa0c68 Nov 02 10:11:35 devstack sudo[97405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:35 devstack sudo[97405]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:35 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a5e39593-278a-4a37-b8bd-11df0edd0449 tempest-VolumesDeleteCascade-1379795829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-738ada42-e52f-4a83-801d-36b551aa0c68" returned: 0 in 0.653s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:35 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a5e39593-278a-4a37-b8bd-11df0edd0449 tempest-VolumesDeleteCascade-1379795829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-738ada42-e52f-4a83-801d-36b551aa0c68,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-738ada42-e52f-4a83-801d-36b551aa0c68.3d09373d-5dc8-41de-8f61-8613f5424095 1G {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:35 devstack sudo[97414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-738ada42-e52f-4a83-801d-36b551aa0c68,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-738ada42-e52f-4a83-801d-36b551aa0c68.3d09373d-5dc8-41de-8f61-8613f5424095 1G Nov 02 10:11:35 devstack sudo[97414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:36 devstack sudo[97414]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:36 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a5e39593-278a-4a37-b8bd-11df0edd0449 tempest-VolumesDeleteCascade-1379795829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-738ada42-e52f-4a83-801d-36b551aa0c68,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-738ada42-e52f-4a83-801d-36b551aa0c68.3d09373d-5dc8-41de-8f61-8613f5424095 1G" returned: 0 in 0.455s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:36 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a5e39593-278a-4a37-b8bd-11df0edd0449 tempest-VolumesDeleteCascade-1379795829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-738ada42-e52f-4a83-801d-36b551aa0c68 -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-738ada42-e52f-4a83-801d-36b551aa0c68.3d09373d-5dc8-41de-8f61-8613f5424095 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:36 devstack sudo[97420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-738ada42-e52f-4a83-801d-36b551aa0c68 -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-738ada42-e52f-4a83-801d-36b551aa0c68.3d09373d-5dc8-41de-8f61-8613f5424095 Nov 02 10:11:36 devstack sudo[97420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:36 devstack sudo[97420]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:36 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a5e39593-278a-4a37-b8bd-11df0edd0449 tempest-VolumesDeleteCascade-1379795829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-738ada42-e52f-4a83-801d-36b551aa0c68 -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-738ada42-e52f-4a83-801d-36b551aa0c68.3d09373d-5dc8-41de-8f61-8613f5424095" returned: 0 in 0.318s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:36 devstack cinder-volume[86890]: WARNING cinder.volume.drivers.remotefs [None req-a5e39593-278a-4a37-b8bd-11df0edd0449 tempest-VolumesDeleteCascade-1379795829 None] /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-738ada42-e52f-4a83-801d-36b551aa0c68.3d09373d-5dc8-41de-8f61-8613f5424095 is being set with open permissions: ugo+rw Nov 02 10:11:36 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a5e39593-278a-4a37-b8bd-11df0edd0449 tempest-VolumesDeleteCascade-1379795829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-738ada42-e52f-4a83-801d-36b551aa0c68.3d09373d-5dc8-41de-8f61-8613f5424095 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:36 devstack sudo[97426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-738ada42-e52f-4a83-801d-36b551aa0c68.3d09373d-5dc8-41de-8f61-8613f5424095 Nov 02 10:11:36 devstack sudo[97426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:37 devstack sudo[97426]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:37 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a5e39593-278a-4a37-b8bd-11df0edd0449 tempest-VolumesDeleteCascade-1379795829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-738ada42-e52f-4a83-801d-36b551aa0c68.3d09373d-5dc8-41de-8f61-8613f5424095" returned: 0 in 0.410s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:37 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a5e39593-278a-4a37-b8bd-11df0edd0449 tempest-VolumesDeleteCascade-1379795829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-738ada42-e52f-4a83-801d-36b551aa0c68.info {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:37 devstack sudo[97429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-738ada42-e52f-4a83-801d-36b551aa0c68.info Nov 02 10:11:37 devstack sudo[97429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:37 devstack sudo[97429]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:37 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a5e39593-278a-4a37-b8bd-11df0edd0449 tempest-VolumesDeleteCascade-1379795829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-738ada42-e52f-4a83-801d-36b551aa0c68.info" returned: 0 in 0.423s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:37 devstack cinder-volume[86890]: WARNING cinder.volume.drivers.remotefs [None req-a5e39593-278a-4a37-b8bd-11df0edd0449 tempest-VolumesDeleteCascade-1379795829 None] /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-738ada42-e52f-4a83-801d-36b551aa0c68.info is being set with open permissions: ugo+rw Nov 02 10:11:37 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a5e39593-278a-4a37-b8bd-11df0edd0449 tempest-VolumesDeleteCascade-1379795829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-738ada42-e52f-4a83-801d-36b551aa0c68.info {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:37 devstack sudo[97432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-738ada42-e52f-4a83-801d-36b551aa0c68.info Nov 02 10:11:37 devstack sudo[97432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:37 devstack sudo[97432]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:37 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a5e39593-278a-4a37-b8bd-11df0edd0449 tempest-VolumesDeleteCascade-1379795829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-738ada42-e52f-4a83-801d-36b551aa0c68.info" returned: 0 in 0.304s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:37 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-a5e39593-278a-4a37-b8bd-11df0edd0449 tempest-VolumesDeleteCascade-1379795829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.831s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:11:37 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-6445cf28-27ce-4c13-ab72-14c44826f877 tempest-GroupSnapshotsTest-1082888639 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.652s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:11:37 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-6445cf28-27ce-4c13-ab72-14c44826f877 tempest-GroupSnapshotsTest-1082888639 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=45c94ca2-5c64-4f35-81a0-44d01949242e,created_at=2026-11-02T09:11:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1477894228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=45c94ca2-5c64-4f35-81a0-44d01949242e,host='devstack@QuobyteHD#QuobyteHD',id=74f507a5-8b75-4b2b-9a7f-6bd47652be49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da86bd772015494296c5a89b91fd6860',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:11:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:11:35Z,use_quota=True,user_id='3ea20c0690384eebbaa7d0ec60adf22a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f13a6fdb-af79-447d-a57a-3802b76c52f1),volume_type_id=f13a6fdb-af79-447d-a57a-3802b76c52f1)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:11:37 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-6445cf28-27ce-4c13-ab72-14c44826f877 tempest-GroupSnapshotsTest-1082888639 None] Creating volume 74f507a5-8b75-4b2b-9a7f-6bd47652be49 {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:11:37 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-6445cf28-27ce-4c13-ab72-14c44826f877 tempest-GroupSnapshotsTest-1082888639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:11:37 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-6445cf28-27ce-4c13-ab72-14c44826f877 tempest-GroupSnapshotsTest-1082888639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:11:37 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-6445cf28-27ce-4c13-ab72-14c44826f877 tempest-GroupSnapshotsTest-1082888639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:11:37 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-6445cf28-27ce-4c13-ab72-14c44826f877 tempest-GroupSnapshotsTest-1082888639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:11:37 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-6445cf28-27ce-4c13-ab72-14c44826f877 tempest-GroupSnapshotsTest-1082888639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:11:37 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-6445cf28-27ce-4c13-ab72-14c44826f877 tempest-GroupSnapshotsTest-1082888639 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:11:37 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-6445cf28-27ce-4c13-ab72-14c44826f877 tempest-GroupSnapshotsTest-1082888639 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:11:37 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6445cf28-27ce-4c13-ab72-14c44826f877 tempest-GroupSnapshotsTest-1082888639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-74f507a5-8b75-4b2b-9a7f-6bd47652be49 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:38 devstack sudo[97435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-74f507a5-8b75-4b2b-9a7f-6bd47652be49 1073741824 Nov 02 10:11:38 devstack sudo[97435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:38 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-a5e39593-278a-4a37-b8bd-11df0edd0449 tempest-VolumesDeleteCascade-1379795829 None] Create snapshot completed successfully Nov 02 10:11:38 devstack sudo[97435]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:38 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6445cf28-27ce-4c13-ab72-14c44826f877 tempest-GroupSnapshotsTest-1082888639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-74f507a5-8b75-4b2b-9a7f-6bd47652be49 1073741824" returned: 0 in 0.507s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:38 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6445cf28-27ce-4c13-ab72-14c44826f877 tempest-GroupSnapshotsTest-1082888639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-74f507a5-8b75-4b2b-9a7f-6bd47652be49 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:38 devstack sudo[97441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-74f507a5-8b75-4b2b-9a7f-6bd47652be49 Nov 02 10:11:38 devstack sudo[97441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:38 devstack sudo[97441]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:38 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6445cf28-27ce-4c13-ab72-14c44826f877 tempest-GroupSnapshotsTest-1082888639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-74f507a5-8b75-4b2b-9a7f-6bd47652be49" returned: 0 in 0.324s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:38 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-6445cf28-27ce-4c13-ab72-14c44826f877 tempest-GroupSnapshotsTest-1082888639 None] <== create_volume: return (886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:11:38 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-6445cf28-27ce-4c13-ab72-14c44826f877 tempest-GroupSnapshotsTest-1082888639 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:11:38 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-6445cf28-27ce-4c13-ab72-14c44826f877 tempest-GroupSnapshotsTest-1082888639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9cae83a-b1ee-4b3d-9292-0c1f8c0832c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74f507a5-8b75-4b2b-9a7f-6bd47652be49', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:11:38 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-6445cf28-27ce-4c13-ab72-14c44826f877 tempest-GroupSnapshotsTest-1082888639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75b1ee20-22e9-4810-a628-642dba162e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:11:38 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-6445cf28-27ce-4c13-ab72-14c44826f877 tempest-GroupSnapshotsTest-1082888639 None] Volume volume-74f507a5-8b75-4b2b-9a7f-6bd47652be49 (74f507a5-8b75-4b2b-9a7f-6bd47652be49): created successfully Nov 02 10:11:38 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-6445cf28-27ce-4c13-ab72-14c44826f877 tempest-GroupSnapshotsTest-1082888639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75b1ee20-22e9-4810-a628-642dba162e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:11:38 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-6445cf28-27ce-4c13-ab72-14c44826f877 tempest-GroupSnapshotsTest-1082888639 None] Flow 'volume_create_manager' (22cc4423-2859-45cc-bd14-350da86a9968) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:11:38 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-6445cf28-27ce-4c13-ab72-14c44826f877 tempest-GroupSnapshotsTest-1082888639 None] Created volume successfully. Nov 02 10:11:39 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-a20c908b-58d2-412d-aefc-c6cbbee16132 tempest-VolumesDeleteCascade-1379795829 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:11:39 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-a20c908b-58d2-412d-aefc-c6cbbee16132 tempest-VolumesDeleteCascade-1379795829 None] Flow 'volume_create_manager' (4ec0e486-f406-4197-9d24-ee2330f73f70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:11:39 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-a20c908b-58d2-412d-aefc-c6cbbee16132 tempest-VolumesDeleteCascade-1379795829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (419003a4-3d15-471f-b951-38ded3bd348d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:11:39 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-a20c908b-58d2-412d-aefc-c6cbbee16132 tempest-VolumesDeleteCascade-1379795829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (419003a4-3d15-471f-b951-38ded3bd348d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:11:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-263105388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01c5df5c-64b9-4029-bc92-869c9b48d2f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d7cf55f3c9a46618bbfbfd5a5487d05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:11:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3d09373d-5dc8-41de-8f61-8613f5424095,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:11:40Z,use_quota=True,user_id='77a1591eaadd49ac92fcb91825363f8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:11:39 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-a20c908b-58d2-412d-aefc-c6cbbee16132 tempest-VolumesDeleteCascade-1379795829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18751fda-aaa8-4972-909d-325d195cf339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:11:39 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-a20c908b-58d2-412d-aefc-c6cbbee16132 tempest-VolumesDeleteCascade-1379795829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18751fda-aaa8-4972-909d-325d195cf339) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:11:39 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-a20c908b-58d2-412d-aefc-c6cbbee16132 tempest-VolumesDeleteCascade-1379795829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbe9e027-294f-4dd6-a90c-bedc75c97554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:11:39 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-a20c908b-58d2-412d-aefc-c6cbbee16132 tempest-VolumesDeleteCascade-1379795829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbe9e027-294f-4dd6-a90c-bedc75c97554) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '01c5df5c-64b9-4029-bc92-869c9b48d2f9', 'volume_name': 'volume-01c5df5c-64b9-4029-bc92-869c9b48d2f9', 'volume_size': 1, 'snapshot_id': '3d09373d-5dc8-41de-8f61-8613f5424095'}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:11:39 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-a20c908b-58d2-412d-aefc-c6cbbee16132 tempest-VolumesDeleteCascade-1379795829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37b6ff09-9cdf-43b8-89e6-288c2473cdac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:11:39 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-a20c908b-58d2-412d-aefc-c6cbbee16132 tempest-VolumesDeleteCascade-1379795829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37b6ff09-9cdf-43b8-89e6-288c2473cdac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:11:39 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-a20c908b-58d2-412d-aefc-c6cbbee16132 tempest-VolumesDeleteCascade-1379795829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b093e0b3-6e15-43c8-9b4c-d0ff6eebf575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:11:39 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-a20c908b-58d2-412d-aefc-c6cbbee16132 tempest-VolumesDeleteCascade-1379795829 None] Volume 01c5df5c-64b9-4029-bc92-869c9b48d2f9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-01c5df5c-64b9-4029-bc92-869c9b48d2f9', 'volume_size': 1, 'snapshot_id': '3d09373d-5dc8-41de-8f61-8613f5424095'} Nov 02 10:11:39 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-a20c908b-58d2-412d-aefc-c6cbbee16132 tempest-VolumesDeleteCascade-1379795829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:11:39 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-a20c908b-58d2-412d-aefc-c6cbbee16132 tempest-VolumesDeleteCascade-1379795829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:11:39 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-a20c908b-58d2-412d-aefc-c6cbbee16132 tempest-VolumesDeleteCascade-1379795829 None] Acquiring lock "cinder-quobyte-3d09373d-5dc8-41de-8f61-8613f5424095-01c5df5c-64b9-4029-bc92-869c9b48d2f9" by "_create_volume_from_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:11:39 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-a20c908b-58d2-412d-aefc-c6cbbee16132 tempest-VolumesDeleteCascade-1379795829 None] Lock "cinder-quobyte-3d09373d-5dc8-41de-8f61-8613f5424095-01c5df5c-64b9-4029-bc92-869c9b48d2f9" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:11:39 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-a20c908b-58d2-412d-aefc-c6cbbee16132 tempest-VolumesDeleteCascade-1379795829 None] Creating volume 01c5df5c-64b9-4029-bc92-869c9b48d2f9 from snapshot 3d09373d-5dc8-41de-8f61-8613f5424095 {{(pid=86890) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 02 10:11:39 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-a20c908b-58d2-412d-aefc-c6cbbee16132 tempest-VolumesDeleteCascade-1379795829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:11:39 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-a20c908b-58d2-412d-aefc-c6cbbee16132 tempest-VolumesDeleteCascade-1379795829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:11:39 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-a20c908b-58d2-412d-aefc-c6cbbee16132 tempest-VolumesDeleteCascade-1379795829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:11:39 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-a20c908b-58d2-412d-aefc-c6cbbee16132 tempest-VolumesDeleteCascade-1379795829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:11:39 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-a20c908b-58d2-412d-aefc-c6cbbee16132 tempest-VolumesDeleteCascade-1379795829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:11:39 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-a20c908b-58d2-412d-aefc-c6cbbee16132 tempest-VolumesDeleteCascade-1379795829 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:11:39 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-a20c908b-58d2-412d-aefc-c6cbbee16132 tempest-VolumesDeleteCascade-1379795829 None] Acquiring lock "cinder-quobyte-01c5df5c-64b9-4029-bc92-869c9b48d2f9" by "_copy_volume_from_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:11:39 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-a20c908b-58d2-412d-aefc-c6cbbee16132 tempest-VolumesDeleteCascade-1379795829 None] Lock "cinder-quobyte-01c5df5c-64b9-4029-bc92-869c9b48d2f9" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:11:39 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-a20c908b-58d2-412d-aefc-c6cbbee16132 tempest-VolumesDeleteCascade-1379795829 None] snapshot: 3d09373d-5dc8-41de-8f61-8613f5424095, volume: 01c5df5c-64b9-4029-bc92-869c9b48d2f9, {{(pid=86890) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 10:11:39 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-a20c908b-58d2-412d-aefc-c6cbbee16132 tempest-VolumesDeleteCascade-1379795829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:11:39 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-a20c908b-58d2-412d-aefc-c6cbbee16132 tempest-VolumesDeleteCascade-1379795829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:11:39 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-a20c908b-58d2-412d-aefc-c6cbbee16132 tempest-VolumesDeleteCascade-1379795829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:11:39 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-a20c908b-58d2-412d-aefc-c6cbbee16132 tempest-VolumesDeleteCascade-1379795829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:11:39 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-a20c908b-58d2-412d-aefc-c6cbbee16132 tempest-VolumesDeleteCascade-1379795829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:11:39 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[af1e89cc-95ea-41a0-a86b-9493cd162705]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:11:39 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a20c908b-58d2-412d-aefc-c6cbbee16132 tempest-VolumesDeleteCascade-1379795829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-738ada42-e52f-4a83-801d-36b551aa0c68.3d09373d-5dc8-41de-8f61-8613f5424095 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:40 devstack sudo[97444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-738ada42-e52f-4a83-801d-36b551aa0c68.3d09373d-5dc8-41de-8f61-8613f5424095 Nov 02 10:11:40 devstack sudo[97444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:40 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-8988427c-c0e7-4775-8f6c-758b7a617a7b tempest-GroupSnapshotsTest-1082888639 None] GroupSnapshot 51674007-dd66-4dd3-b555-69699e9c452b: creating. Nov 02 10:11:40 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-8988427c-c0e7-4775-8f6c-758b7a617a7b tempest-GroupSnapshotsTest-1082888639 None] Group snapshot 51674007-dd66-4dd3-b555-69699e9c452b: creating. {{(pid=86890) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 02 10:11:40 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-8988427c-c0e7-4775-8f6c-758b7a617a7b tempest-GroupSnapshotsTest-1082888639 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:11:40 devstack sudo[97444]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:40 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a20c908b-58d2-412d-aefc-c6cbbee16132 tempest-VolumesDeleteCascade-1379795829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-738ada42-e52f-4a83-801d-36b551aa0c68.3d09373d-5dc8-41de-8f61-8613f5424095" returned: 0 in 0.505s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:40 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-a20c908b-58d2-412d-aefc-c6cbbee16132 tempest-VolumesDeleteCascade-1379795829 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-738ada42-e52f-4a83-801d-36b551aa0c68(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86890) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:11:40 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[24150e22-fb68-4024-b403-b913390bf5dc]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:11:40 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a20c908b-58d2-412d-aefc-c6cbbee16132 tempest-VolumesDeleteCascade-1379795829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-738ada42-e52f-4a83-801d-36b551aa0c68 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:40 devstack sudo[97449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-738ada42-e52f-4a83-801d-36b551aa0c68 Nov 02 10:11:40 devstack sudo[97449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:40 devstack sudo[97449]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:40 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a20c908b-58d2-412d-aefc-c6cbbee16132 tempest-VolumesDeleteCascade-1379795829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-738ada42-e52f-4a83-801d-36b551aa0c68" returned: 0 in 0.415s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:40 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-a20c908b-58d2-412d-aefc-c6cbbee16132 tempest-VolumesDeleteCascade-1379795829 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-738ada42-e52f-4a83-801d-36b551aa0c68 {{(pid=86890) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 10:11:40 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-a20c908b-58d2-412d-aefc-c6cbbee16132 tempest-VolumesDeleteCascade-1379795829 None] Creating direct copy from snapshot {{(pid=86890) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 10:11:40 devstack cinder-volume[86890]: DEBUG cinder.utils [None req-a20c908b-58d2-412d-aefc-c6cbbee16132 tempest-VolumesDeleteCascade-1379795829 None] Path /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-01c5df5c-64b9-4029-bc92-869c9b48d2f9 not found in is_blk_device check {{(pid=86890) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 10:11:40 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a20c908b-58d2-412d-aefc-c6cbbee16132 tempest-VolumesDeleteCascade-1379795829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-738ada42-e52f-4a83-801d-36b551aa0c68 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-01c5df5c-64b9-4029-bc92-869c9b48d2f9 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:40 devstack sudo[97454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-738ada42-e52f-4a83-801d-36b551aa0c68 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-01c5df5c-64b9-4029-bc92-869c9b48d2f9 Nov 02 10:11:40 devstack sudo[97454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:49 devstack sudo[97454]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:49 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a20c908b-58d2-412d-aefc-c6cbbee16132 tempest-VolumesDeleteCascade-1379795829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-738ada42-e52f-4a83-801d-36b551aa0c68 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-01c5df5c-64b9-4029-bc92-869c9b48d2f9" returned: 0 in 8.915s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:49 devstack cinder-volume[86890]: DEBUG cinder.image.image_utils [None req-a20c908b-58d2-412d-aefc-c6cbbee16132 tempest-VolumesDeleteCascade-1379795829 None] Image conversion details: src /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-738ada42-e52f-4a83-801d-36b551aa0c68, size 1024.00 MB, duration 8.92 sec, destination /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-01c5df5c-64b9-4029-bc92-869c9b48d2f9 {{(pid=86890) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 10:11:49 devstack cinder-volume[86890]: INFO cinder.image.image_utils [None req-a20c908b-58d2-412d-aefc-c6cbbee16132 tempest-VolumesDeleteCascade-1379795829 None] Converted 1024.00 MB image at 114.84 MB/s Nov 02 10:11:49 devstack cinder-volume[86890]: WARNING cinder.volume.drivers.remotefs [None req-a20c908b-58d2-412d-aefc-c6cbbee16132 tempest-VolumesDeleteCascade-1379795829 None] /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-01c5df5c-64b9-4029-bc92-869c9b48d2f9 is being set with open permissions: ugo+rw Nov 02 10:11:49 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a20c908b-58d2-412d-aefc-c6cbbee16132 tempest-VolumesDeleteCascade-1379795829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-01c5df5c-64b9-4029-bc92-869c9b48d2f9 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:49 devstack sudo[97523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-01c5df5c-64b9-4029-bc92-869c9b48d2f9 Nov 02 10:11:49 devstack sudo[97523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:50 devstack sudo[97523]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:50 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a20c908b-58d2-412d-aefc-c6cbbee16132 tempest-VolumesDeleteCascade-1379795829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-01c5df5c-64b9-4029-bc92-869c9b48d2f9" returned: 0 in 0.297s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:50 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-a20c908b-58d2-412d-aefc-c6cbbee16132 tempest-VolumesDeleteCascade-1379795829 None] Lock "cinder-quobyte-01c5df5c-64b9-4029-bc92-869c9b48d2f9" released by "_copy_volume_from_snapshot" :: held 10.227s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:11:50 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-a20c908b-58d2-412d-aefc-c6cbbee16132 tempest-VolumesDeleteCascade-1379795829 None] Lock "cinder-quobyte-3d09373d-5dc8-41de-8f61-8613f5424095-01c5df5c-64b9-4029-bc92-869c9b48d2f9" released by "_create_volume_from_snapshot" :: held 10.304s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:11:50 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-a20c908b-58d2-412d-aefc-c6cbbee16132 tempest-VolumesDeleteCascade-1379795829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.325s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:11:50 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-8988427c-c0e7-4775-8f6c-758b7a617a7b tempest-GroupSnapshotsTest-1082888639 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.778s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:11:50 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-8988427c-c0e7-4775-8f6c-758b7a617a7b tempest-GroupSnapshotsTest-1082888639 None] Creating offline snapshot 6a6f7165-cf7a-4267-83b1-91ee2c7d8cb3 of volume 74f507a5-8b75-4b2b-9a7f-6bd47652be49 {{(pid=86890) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:11:50 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-a20c908b-58d2-412d-aefc-c6cbbee16132 tempest-VolumesDeleteCascade-1379795829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b093e0b3-6e15-43c8-9b4c-d0ff6eebf575) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01c5df5c-64b9-4029-bc92-869c9b48d2f9', 'volume_size': 1, 'snapshot_id': '3d09373d-5dc8-41de-8f61-8613f5424095'}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:11:50 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-a20c908b-58d2-412d-aefc-c6cbbee16132 tempest-VolumesDeleteCascade-1379795829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d82998fc-91d1-40a7-8959-52868969139f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:11:50 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[46aad500-0027-49c6-a004-a5ba8697f5ed]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:11:50 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8988427c-c0e7-4775-8f6c-758b7a617a7b tempest-GroupSnapshotsTest-1082888639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-74f507a5-8b75-4b2b-9a7f-6bd47652be49 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:50 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-a20c908b-58d2-412d-aefc-c6cbbee16132 tempest-VolumesDeleteCascade-1379795829 None] Volume volume-01c5df5c-64b9-4029-bc92-869c9b48d2f9 (01c5df5c-64b9-4029-bc92-869c9b48d2f9): created successfully Nov 02 10:11:50 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-a20c908b-58d2-412d-aefc-c6cbbee16132 tempest-VolumesDeleteCascade-1379795829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d82998fc-91d1-40a7-8959-52868969139f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:11:50 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-a20c908b-58d2-412d-aefc-c6cbbee16132 tempest-VolumesDeleteCascade-1379795829 None] Flow 'volume_create_manager' (4ec0e486-f406-4197-9d24-ee2330f73f70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:11:50 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-a20c908b-58d2-412d-aefc-c6cbbee16132 tempest-VolumesDeleteCascade-1379795829 None] Created volume successfully. Nov 02 10:11:50 devstack sudo[97526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-74f507a5-8b75-4b2b-9a7f-6bd47652be49 Nov 02 10:11:50 devstack sudo[97526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:50 devstack sudo[97526]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:50 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8988427c-c0e7-4775-8f6c-758b7a617a7b tempest-GroupSnapshotsTest-1082888639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-74f507a5-8b75-4b2b-9a7f-6bd47652be49" returned: 0 in 0.406s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:50 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8988427c-c0e7-4775-8f6c-758b7a617a7b tempest-GroupSnapshotsTest-1082888639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-74f507a5-8b75-4b2b-9a7f-6bd47652be49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-74f507a5-8b75-4b2b-9a7f-6bd47652be49.6a6f7165-cf7a-4267-83b1-91ee2c7d8cb3 1G {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:50 devstack sudo[97532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-74f507a5-8b75-4b2b-9a7f-6bd47652be49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-74f507a5-8b75-4b2b-9a7f-6bd47652be49.6a6f7165-cf7a-4267-83b1-91ee2c7d8cb3 1G Nov 02 10:11:50 devstack sudo[97532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:51 devstack sudo[97532]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:51 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8988427c-c0e7-4775-8f6c-758b7a617a7b tempest-GroupSnapshotsTest-1082888639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-74f507a5-8b75-4b2b-9a7f-6bd47652be49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-74f507a5-8b75-4b2b-9a7f-6bd47652be49.6a6f7165-cf7a-4267-83b1-91ee2c7d8cb3 1G" returned: 0 in 0.397s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:51 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8988427c-c0e7-4775-8f6c-758b7a617a7b tempest-GroupSnapshotsTest-1082888639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74f507a5-8b75-4b2b-9a7f-6bd47652be49 -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-74f507a5-8b75-4b2b-9a7f-6bd47652be49.6a6f7165-cf7a-4267-83b1-91ee2c7d8cb3 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:51 devstack sudo[97537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74f507a5-8b75-4b2b-9a7f-6bd47652be49 -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-74f507a5-8b75-4b2b-9a7f-6bd47652be49.6a6f7165-cf7a-4267-83b1-91ee2c7d8cb3 Nov 02 10:11:51 devstack sudo[97537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:51 devstack sudo[97537]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:51 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8988427c-c0e7-4775-8f6c-758b7a617a7b tempest-GroupSnapshotsTest-1082888639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74f507a5-8b75-4b2b-9a7f-6bd47652be49 -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-74f507a5-8b75-4b2b-9a7f-6bd47652be49.6a6f7165-cf7a-4267-83b1-91ee2c7d8cb3" returned: 0 in 0.314s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:51 devstack cinder-volume[86890]: WARNING cinder.volume.drivers.remotefs [None req-8988427c-c0e7-4775-8f6c-758b7a617a7b tempest-GroupSnapshotsTest-1082888639 None] /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-74f507a5-8b75-4b2b-9a7f-6bd47652be49.6a6f7165-cf7a-4267-83b1-91ee2c7d8cb3 is being set with open permissions: ugo+rw: NotImplementedError Nov 02 10:11:51 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8988427c-c0e7-4775-8f6c-758b7a617a7b tempest-GroupSnapshotsTest-1082888639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-74f507a5-8b75-4b2b-9a7f-6bd47652be49.6a6f7165-cf7a-4267-83b1-91ee2c7d8cb3 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:51 devstack sudo[97542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-74f507a5-8b75-4b2b-9a7f-6bd47652be49.6a6f7165-cf7a-4267-83b1-91ee2c7d8cb3 Nov 02 10:11:51 devstack sudo[97542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:51 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-1a0558f8-9d2b-4012-9df5-d7b5d54ae2ee tempest-VolumesDeleteCascade-1379795829 None] Acquiring lock "cinder-738ada42-e52f-4a83-801d-36b551aa0c68-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:11:51 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-1a0558f8-9d2b-4012-9df5-d7b5d54ae2ee tempest-VolumesDeleteCascade-1379795829 None] Lock "cinder-738ada42-e52f-4a83-801d-36b551aa0c68-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:11:51 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-1a0558f8-9d2b-4012-9df5-d7b5d54ae2ee tempest-VolumesDeleteCascade-1379795829 None] Performing cascade delete. {{(pid=86890) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Nov 02 10:11:51 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-1a0558f8-9d2b-4012-9df5-d7b5d54ae2ee tempest-VolumesDeleteCascade-1379795829 None] Acquiring lock "cinder-3d09373d-5dc8-41de-8f61-8613f5424095-delete_snapshot" by "delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:11:51 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-1a0558f8-9d2b-4012-9df5-d7b5d54ae2ee tempest-VolumesDeleteCascade-1379795829 None] Lock "cinder-3d09373d-5dc8-41de-8f61-8613f5424095-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:11:51 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-1a0558f8-9d2b-4012-9df5-d7b5d54ae2ee tempest-VolumesDeleteCascade-1379795829 None] Acquiring lock "cinder-quobyte-738ada42-e52f-4a83-801d-36b551aa0c68" by "delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:11:51 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-1a0558f8-9d2b-4012-9df5-d7b5d54ae2ee tempest-VolumesDeleteCascade-1379795829 None] Lock "cinder-quobyte-738ada42-e52f-4a83-801d-36b551aa0c68" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:11:51 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-1a0558f8-9d2b-4012-9df5-d7b5d54ae2ee tempest-VolumesDeleteCascade-1379795829 None] Acquiring lock "cinder-quobyte-3d09373d-5dc8-41de-8f61-8613f5424095" by "_delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:11:51 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-1a0558f8-9d2b-4012-9df5-d7b5d54ae2ee tempest-VolumesDeleteCascade-1379795829 None] Lock "cinder-quobyte-3d09373d-5dc8-41de-8f61-8613f5424095" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:11:51 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-1a0558f8-9d2b-4012-9df5-d7b5d54ae2ee tempest-VolumesDeleteCascade-1379795829 None] Deleting offline snapshot 3d09373d-5dc8-41de-8f61-8613f5424095 of volume 738ada42-e52f-4a83-801d-36b551aa0c68 {{(pid=86890) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:11:51 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-1a0558f8-9d2b-4012-9df5-d7b5d54ae2ee tempest-VolumesDeleteCascade-1379795829 None] snapshot_file for this snap is: volume-738ada42-e52f-4a83-801d-36b551aa0c68.3d09373d-5dc8-41de-8f61-8613f5424095 {{(pid=86890) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:11:51 devstack sudo[97542]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:51 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8988427c-c0e7-4775-8f6c-758b7a617a7b tempest-GroupSnapshotsTest-1082888639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-74f507a5-8b75-4b2b-9a7f-6bd47652be49.6a6f7165-cf7a-4267-83b1-91ee2c7d8cb3" returned: 0 in 0.258s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:51 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[caa6f2dc-9341-4dd5-8be9-a7dbe6f64090]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:11:51 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-1a0558f8-9d2b-4012-9df5-d7b5d54ae2ee tempest-VolumesDeleteCascade-1379795829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-738ada42-e52f-4a83-801d-36b551aa0c68.3d09373d-5dc8-41de-8f61-8613f5424095 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:51 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8988427c-c0e7-4775-8f6c-758b7a617a7b tempest-GroupSnapshotsTest-1082888639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-74f507a5-8b75-4b2b-9a7f-6bd47652be49.info {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:51 devstack sudo[97546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-74f507a5-8b75-4b2b-9a7f-6bd47652be49.info Nov 02 10:11:51 devstack sudo[97546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:51 devstack sudo[97545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-738ada42-e52f-4a83-801d-36b551aa0c68.3d09373d-5dc8-41de-8f61-8613f5424095 Nov 02 10:11:51 devstack sudo[97545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:51 devstack sudo[97546]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:51 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8988427c-c0e7-4775-8f6c-758b7a617a7b tempest-GroupSnapshotsTest-1082888639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-74f507a5-8b75-4b2b-9a7f-6bd47652be49.info" returned: 0 in 0.260s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:51 devstack cinder-volume[86890]: WARNING cinder.volume.drivers.remotefs [None req-8988427c-c0e7-4775-8f6c-758b7a617a7b tempest-GroupSnapshotsTest-1082888639 None] /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-74f507a5-8b75-4b2b-9a7f-6bd47652be49.info is being set with open permissions: ugo+rw: NotImplementedError Nov 02 10:11:51 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8988427c-c0e7-4775-8f6c-758b7a617a7b tempest-GroupSnapshotsTest-1082888639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-74f507a5-8b75-4b2b-9a7f-6bd47652be49.info {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:51 devstack sudo[97550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-74f507a5-8b75-4b2b-9a7f-6bd47652be49.info Nov 02 10:11:51 devstack sudo[97550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:52 devstack sudo[97545]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:52 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-1a0558f8-9d2b-4012-9df5-d7b5d54ae2ee tempest-VolumesDeleteCascade-1379795829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-738ada42-e52f-4a83-801d-36b551aa0c68.3d09373d-5dc8-41de-8f61-8613f5424095" returned: 0 in 0.385s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:52 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-1a0558f8-9d2b-4012-9df5-d7b5d54ae2ee tempest-VolumesDeleteCascade-1379795829 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-738ada42-e52f-4a83-801d-36b551aa0c68(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86890) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:11:52 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d08df62-9164-4f26-bf80-66b7a403759b]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:11:52 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-1a0558f8-9d2b-4012-9df5-d7b5d54ae2ee tempest-VolumesDeleteCascade-1379795829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-738ada42-e52f-4a83-801d-36b551aa0c68 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:52 devstack sudo[97555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-738ada42-e52f-4a83-801d-36b551aa0c68 Nov 02 10:11:52 devstack sudo[97555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:52 devstack sudo[97550]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:52 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8988427c-c0e7-4775-8f6c-758b7a617a7b tempest-GroupSnapshotsTest-1082888639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-74f507a5-8b75-4b2b-9a7f-6bd47652be49.info" returned: 0 in 0.248s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:52 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-8988427c-c0e7-4775-8f6c-758b7a617a7b tempest-GroupSnapshotsTest-1082888639 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.027s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:11:52 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-8988427c-c0e7-4775-8f6c-758b7a617a7b tempest-GroupSnapshotsTest-1082888639 None] group_snapshot 51674007-dd66-4dd3-b555-69699e9c452b: created successfully Nov 02 10:11:52 devstack sudo[97555]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:52 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-1a0558f8-9d2b-4012-9df5-d7b5d54ae2ee tempest-VolumesDeleteCascade-1379795829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-738ada42-e52f-4a83-801d-36b551aa0c68" returned: 0 in 0.572s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:52 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-1a0558f8-9d2b-4012-9df5-d7b5d54ae2ee tempest-VolumesDeleteCascade-1379795829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-738ada42-e52f-4a83-801d-36b551aa0c68.3d09373d-5dc8-41de-8f61-8613f5424095 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:52 devstack sudo[97561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-738ada42-e52f-4a83-801d-36b551aa0c68.3d09373d-5dc8-41de-8f61-8613f5424095 Nov 02 10:11:52 devstack sudo[97561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:53 devstack sudo[97561]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:53 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-1a0558f8-9d2b-4012-9df5-d7b5d54ae2ee tempest-VolumesDeleteCascade-1379795829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-738ada42-e52f-4a83-801d-36b551aa0c68.3d09373d-5dc8-41de-8f61-8613f5424095" returned: 0 in 0.388s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:53 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-1a0558f8-9d2b-4012-9df5-d7b5d54ae2ee tempest-VolumesDeleteCascade-1379795829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-738ada42-e52f-4a83-801d-36b551aa0c68.3d09373d-5dc8-41de-8f61-8613f5424095 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:53 devstack sudo[97567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-738ada42-e52f-4a83-801d-36b551aa0c68.3d09373d-5dc8-41de-8f61-8613f5424095 Nov 02 10:11:53 devstack sudo[97567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:53 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-6f4c1a60-7c16-4765-b7a9-6b1506741b9b tempest-GroupSnapshotsTest-1082888639 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:11:53 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-6f4c1a60-7c16-4765-b7a9-6b1506741b9b tempest-GroupSnapshotsTest-1082888639 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:11:53 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-6f4c1a60-7c16-4765-b7a9-6b1506741b9b tempest-GroupSnapshotsTest-1082888639 None] Acquiring lock "cinder-quobyte-6a6f7165-cf7a-4267-83b1-91ee2c7d8cb3-41b48883-3d24-4ef1-b2a2-80cc598c16e1" by "_create_volume_from_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:11:53 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-6f4c1a60-7c16-4765-b7a9-6b1506741b9b tempest-GroupSnapshotsTest-1082888639 None] Lock "cinder-quobyte-6a6f7165-cf7a-4267-83b1-91ee2c7d8cb3-41b48883-3d24-4ef1-b2a2-80cc598c16e1" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:11:53 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-6f4c1a60-7c16-4765-b7a9-6b1506741b9b tempest-GroupSnapshotsTest-1082888639 None] Creating volume 41b48883-3d24-4ef1-b2a2-80cc598c16e1 from snapshot 6a6f7165-cf7a-4267-83b1-91ee2c7d8cb3 {{(pid=86890) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 02 10:11:53 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-6f4c1a60-7c16-4765-b7a9-6b1506741b9b tempest-GroupSnapshotsTest-1082888639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:11:53 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-6f4c1a60-7c16-4765-b7a9-6b1506741b9b tempest-GroupSnapshotsTest-1082888639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:11:53 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-6f4c1a60-7c16-4765-b7a9-6b1506741b9b tempest-GroupSnapshotsTest-1082888639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:11:53 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-6f4c1a60-7c16-4765-b7a9-6b1506741b9b tempest-GroupSnapshotsTest-1082888639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:11:53 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-6f4c1a60-7c16-4765-b7a9-6b1506741b9b tempest-GroupSnapshotsTest-1082888639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:11:53 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-6f4c1a60-7c16-4765-b7a9-6b1506741b9b tempest-GroupSnapshotsTest-1082888639 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:11:53 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-6f4c1a60-7c16-4765-b7a9-6b1506741b9b tempest-GroupSnapshotsTest-1082888639 None] Acquiring lock "cinder-quobyte-41b48883-3d24-4ef1-b2a2-80cc598c16e1" by "_copy_volume_from_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:11:53 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-6f4c1a60-7c16-4765-b7a9-6b1506741b9b tempest-GroupSnapshotsTest-1082888639 None] Lock "cinder-quobyte-41b48883-3d24-4ef1-b2a2-80cc598c16e1" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:11:53 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-6f4c1a60-7c16-4765-b7a9-6b1506741b9b tempest-GroupSnapshotsTest-1082888639 None] snapshot: 6a6f7165-cf7a-4267-83b1-91ee2c7d8cb3, volume: 41b48883-3d24-4ef1-b2a2-80cc598c16e1, {{(pid=86890) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 10:11:53 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-6f4c1a60-7c16-4765-b7a9-6b1506741b9b tempest-GroupSnapshotsTest-1082888639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:11:53 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-6f4c1a60-7c16-4765-b7a9-6b1506741b9b tempest-GroupSnapshotsTest-1082888639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:11:53 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-6f4c1a60-7c16-4765-b7a9-6b1506741b9b tempest-GroupSnapshotsTest-1082888639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:11:53 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-6f4c1a60-7c16-4765-b7a9-6b1506741b9b tempest-GroupSnapshotsTest-1082888639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:11:53 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-6f4c1a60-7c16-4765-b7a9-6b1506741b9b tempest-GroupSnapshotsTest-1082888639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:11:53 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[69bbc1d5-fbc7-4873-ab0d-9ae840e6f5da]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:11:53 devstack sudo[97567]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:53 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6f4c1a60-7c16-4765-b7a9-6b1506741b9b tempest-GroupSnapshotsTest-1082888639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-74f507a5-8b75-4b2b-9a7f-6bd47652be49.6a6f7165-cf7a-4267-83b1-91ee2c7d8cb3 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:53 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-1a0558f8-9d2b-4012-9df5-d7b5d54ae2ee tempest-VolumesDeleteCascade-1379795829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-738ada42-e52f-4a83-801d-36b551aa0c68.3d09373d-5dc8-41de-8f61-8613f5424095" returned: 0 in 0.359s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:53 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-1a0558f8-9d2b-4012-9df5-d7b5d54ae2ee tempest-VolumesDeleteCascade-1379795829 None] Lock "cinder-quobyte-3d09373d-5dc8-41de-8f61-8613f5424095" released by "_delete_snapshot" :: held 1.817s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:11:53 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-1a0558f8-9d2b-4012-9df5-d7b5d54ae2ee tempest-VolumesDeleteCascade-1379795829 None] Lock "cinder-quobyte-738ada42-e52f-4a83-801d-36b551aa0c68" released by "delete_snapshot" :: held 1.843s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:11:53 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-1a0558f8-9d2b-4012-9df5-d7b5d54ae2ee tempest-VolumesDeleteCascade-1379795829 None] Created reservations ['8af7ad88-0f78-4710-b227-49ee4dc04bb6', '8b483c5b-4069-46fe-8ad5-0fe77d2a2f05', 'eb3543c3-187e-46b4-8b3a-226cf4e04018', 'a71f6426-9e77-462f-9155-d118e12a0802'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:11:53 devstack sudo[97571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-74f507a5-8b75-4b2b-9a7f-6bd47652be49.6a6f7165-cf7a-4267-83b1-91ee2c7d8cb3 Nov 02 10:11:53 devstack sudo[97571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:53 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-1a0558f8-9d2b-4012-9df5-d7b5d54ae2ee tempest-VolumesDeleteCascade-1379795829 None] Delete snapshot completed successfully. Nov 02 10:11:53 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-1a0558f8-9d2b-4012-9df5-d7b5d54ae2ee tempest-VolumesDeleteCascade-1379795829 None] Lock "cinder-3d09373d-5dc8-41de-8f61-8613f5424095-delete_snapshot" released by "delete_snapshot" :: held 2.029s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:11:53 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-1a0558f8-9d2b-4012-9df5-d7b5d54ae2ee tempest-VolumesDeleteCascade-1379795829 None] Snapshots deleted, issuing volume delete {{(pid=86890) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Nov 02 10:11:53 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-1a0558f8-9d2b-4012-9df5-d7b5d54ae2ee tempest-VolumesDeleteCascade-1379795829 None] Acquiring lock "cinder-quobyte-738ada42-e52f-4a83-801d-36b551aa0c68" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:11:53 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-1a0558f8-9d2b-4012-9df5-d7b5d54ae2ee tempest-VolumesDeleteCascade-1379795829 None] Lock "cinder-quobyte-738ada42-e52f-4a83-801d-36b551aa0c68" acquired by "delete_volume" :: waited 0.028s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:11:53 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f8e528d-4faf-42a3-a318-88096f308562]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:11:53 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-1a0558f8-9d2b-4012-9df5-d7b5d54ae2ee tempest-VolumesDeleteCascade-1379795829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-738ada42-e52f-4a83-801d-36b551aa0c68 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:53 devstack sudo[97573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-738ada42-e52f-4a83-801d-36b551aa0c68 Nov 02 10:11:53 devstack sudo[97573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:53 devstack sudo[97571]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:53 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6f4c1a60-7c16-4765-b7a9-6b1506741b9b tempest-GroupSnapshotsTest-1082888639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-74f507a5-8b75-4b2b-9a7f-6bd47652be49.6a6f7165-cf7a-4267-83b1-91ee2c7d8cb3" returned: 0 in 0.496s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:53 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-6f4c1a60-7c16-4765-b7a9-6b1506741b9b tempest-GroupSnapshotsTest-1082888639 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-74f507a5-8b75-4b2b-9a7f-6bd47652be49(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86890) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:11:53 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[31e16cb6-31fa-47cc-b0b2-3dd0ae81ce55]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:11:53 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6f4c1a60-7c16-4765-b7a9-6b1506741b9b tempest-GroupSnapshotsTest-1082888639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-74f507a5-8b75-4b2b-9a7f-6bd47652be49 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:54 devstack sudo[97578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-74f507a5-8b75-4b2b-9a7f-6bd47652be49 Nov 02 10:11:54 devstack sudo[97578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:54 devstack sudo[97573]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:54 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-1a0558f8-9d2b-4012-9df5-d7b5d54ae2ee tempest-VolumesDeleteCascade-1379795829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-738ada42-e52f-4a83-801d-36b551aa0c68" returned: 0 in 0.476s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:54 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-1a0558f8-9d2b-4012-9df5-d7b5d54ae2ee tempest-VolumesDeleteCascade-1379795829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-738ada42-e52f-4a83-801d-36b551aa0c68 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:54 devstack sudo[97583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-738ada42-e52f-4a83-801d-36b551aa0c68 Nov 02 10:11:54 devstack sudo[97583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:54 devstack sudo[97578]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:54 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6f4c1a60-7c16-4765-b7a9-6b1506741b9b tempest-GroupSnapshotsTest-1082888639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-74f507a5-8b75-4b2b-9a7f-6bd47652be49" returned: 0 in 0.423s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:54 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-6f4c1a60-7c16-4765-b7a9-6b1506741b9b tempest-GroupSnapshotsTest-1082888639 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-74f507a5-8b75-4b2b-9a7f-6bd47652be49 {{(pid=86890) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 10:11:54 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-6f4c1a60-7c16-4765-b7a9-6b1506741b9b tempest-GroupSnapshotsTest-1082888639 None] Creating direct copy from snapshot {{(pid=86890) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 10:11:54 devstack cinder-volume[86890]: DEBUG cinder.utils [None req-6f4c1a60-7c16-4765-b7a9-6b1506741b9b tempest-GroupSnapshotsTest-1082888639 None] Path /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-41b48883-3d24-4ef1-b2a2-80cc598c16e1 not found in is_blk_device check {{(pid=86890) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 10:11:54 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6f4c1a60-7c16-4765-b7a9-6b1506741b9b tempest-GroupSnapshotsTest-1082888639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-74f507a5-8b75-4b2b-9a7f-6bd47652be49 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-41b48883-3d24-4ef1-b2a2-80cc598c16e1 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:54 devstack sudo[97588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-74f507a5-8b75-4b2b-9a7f-6bd47652be49 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-41b48883-3d24-4ef1-b2a2-80cc598c16e1 Nov 02 10:11:54 devstack sudo[97588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:54 devstack sudo[97583]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:54 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-1a0558f8-9d2b-4012-9df5-d7b5d54ae2ee tempest-VolumesDeleteCascade-1379795829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-738ada42-e52f-4a83-801d-36b551aa0c68" returned: 0 in 0.279s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:54 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-1a0558f8-9d2b-4012-9df5-d7b5d54ae2ee tempest-VolumesDeleteCascade-1379795829 None] Lock "cinder-quobyte-738ada42-e52f-4a83-801d-36b551aa0c68" released by "delete_volume" :: held 0.854s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:11:54 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-1a0558f8-9d2b-4012-9df5-d7b5d54ae2ee tempest-VolumesDeleteCascade-1379795829 None] Created reservations ['98fe8e7f-dce3-4c39-9f15-3aefbc6753b1', 'f673ca02-9590-43fb-b3a0-b740706c59ee', '4c75bbed-28c9-4f90-931e-572d36c599b4', 'e62510cb-5d3e-4669-a473-d759c2464793'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:11:54 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-1a0558f8-9d2b-4012-9df5-d7b5d54ae2ee tempest-VolumesDeleteCascade-1379795829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:11:54 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-1a0558f8-9d2b-4012-9df5-d7b5d54ae2ee tempest-VolumesDeleteCascade-1379795829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:11:54 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-1a0558f8-9d2b-4012-9df5-d7b5d54ae2ee tempest-VolumesDeleteCascade-1379795829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:11:54 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-1a0558f8-9d2b-4012-9df5-d7b5d54ae2ee tempest-VolumesDeleteCascade-1379795829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:11:54 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-1a0558f8-9d2b-4012-9df5-d7b5d54ae2ee tempest-VolumesDeleteCascade-1379795829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:11:54 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-1a0558f8-9d2b-4012-9df5-d7b5d54ae2ee tempest-VolumesDeleteCascade-1379795829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:54 devstack sudo[97594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:11:54 devstack sudo[97594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:55 devstack sudo[97594]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:55 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-1a0558f8-9d2b-4012-9df5-d7b5d54ae2ee tempest-VolumesDeleteCascade-1379795829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.497s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:55 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-1a0558f8-9d2b-4012-9df5-d7b5d54ae2ee tempest-VolumesDeleteCascade-1379795829 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:11:55 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-1a0558f8-9d2b-4012-9df5-d7b5d54ae2ee tempest-VolumesDeleteCascade-1379795829 None] Deleted volume successfully. Nov 02 10:11:55 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-b94e86f4-0211-440c-b71a-31336e9badfb tempest-VolumesDeleteCascade-1379795829 None] Acquiring lock "cinder-01c5df5c-64b9-4029-bc92-869c9b48d2f9-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:11:55 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-1a0558f8-9d2b-4012-9df5-d7b5d54ae2ee tempest-VolumesDeleteCascade-1379795829 None] Lock "cinder-738ada42-e52f-4a83-801d-36b551aa0c68-delete_volume" released by "delete_volume" :: held 3.698s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:11:55 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-b94e86f4-0211-440c-b71a-31336e9badfb tempest-VolumesDeleteCascade-1379795829 None] Lock "cinder-01c5df5c-64b9-4029-bc92-869c9b48d2f9-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:11:55 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-b94e86f4-0211-440c-b71a-31336e9badfb tempest-VolumesDeleteCascade-1379795829 None] Acquiring lock "cinder-quobyte-01c5df5c-64b9-4029-bc92-869c9b48d2f9" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:11:55 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-b94e86f4-0211-440c-b71a-31336e9badfb tempest-VolumesDeleteCascade-1379795829 None] Lock "cinder-quobyte-01c5df5c-64b9-4029-bc92-869c9b48d2f9" acquired by "delete_volume" :: waited 0.044s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:11:55 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[e595fcaa-40c3-4ea3-9c9f-7f2e0a9eb340]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:11:55 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-b94e86f4-0211-440c-b71a-31336e9badfb tempest-VolumesDeleteCascade-1379795829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-01c5df5c-64b9-4029-bc92-869c9b48d2f9 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:55 devstack sudo[97607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-01c5df5c-64b9-4029-bc92-869c9b48d2f9 Nov 02 10:11:55 devstack sudo[97607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:56 devstack sudo[97607]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:56 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-b94e86f4-0211-440c-b71a-31336e9badfb tempest-VolumesDeleteCascade-1379795829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-01c5df5c-64b9-4029-bc92-869c9b48d2f9" returned: 0 in 0.950s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:56 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-b94e86f4-0211-440c-b71a-31336e9badfb tempest-VolumesDeleteCascade-1379795829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-01c5df5c-64b9-4029-bc92-869c9b48d2f9 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:56 devstack sudo[97612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-01c5df5c-64b9-4029-bc92-869c9b48d2f9 Nov 02 10:11:56 devstack sudo[97612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:56 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb71c89b-19cc-42b2-9388-052ee56a88a8 tempest-AttachVolumeNegativeTest-1700545160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:11:56 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-cb71c89b-19cc-42b2-9388-052ee56a88a8 tempest-AttachVolumeNegativeTest-1700545160 None] Flow 'volume_create_manager' (32aed5a1-2c8c-4dfe-9b99-77345a966689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:11:56 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-cb71c89b-19cc-42b2-9388-052ee56a88a8 tempest-AttachVolumeNegativeTest-1700545160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4445c6c3-e22b-42ee-9599-366c5bbe11fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:11:57 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-cb71c89b-19cc-42b2-9388-052ee56a88a8 tempest-AttachVolumeNegativeTest-1700545160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4445c6c3-e22b-42ee-9599-366c5bbe11fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:11:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-231913111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2071ff43-fcfb-479a-a0e7-41bfd69f9022,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='253ee95a4446482e922e1729e2adb6c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:11:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:11:57Z,use_quota=True,user_id='ea709b481078418fad7a82c87c527935',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:11:57 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-cb71c89b-19cc-42b2-9388-052ee56a88a8 tempest-AttachVolumeNegativeTest-1700545160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (642f93ce-567a-407c-be2d-8b40c90b71fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:11:57 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-cb71c89b-19cc-42b2-9388-052ee56a88a8 tempest-AttachVolumeNegativeTest-1700545160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (642f93ce-567a-407c-be2d-8b40c90b71fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:11:57 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-cb71c89b-19cc-42b2-9388-052ee56a88a8 tempest-AttachVolumeNegativeTest-1700545160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccf7e97f-0acf-4b0a-8b38-d3b0b2c4e2a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:11:57 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-cb71c89b-19cc-42b2-9388-052ee56a88a8 tempest-AttachVolumeNegativeTest-1700545160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccf7e97f-0acf-4b0a-8b38-d3b0b2c4e2a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2071ff43-fcfb-479a-a0e7-41bfd69f9022', 'volume_name': 'volume-2071ff43-fcfb-479a-a0e7-41bfd69f9022', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:11:57 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-cb71c89b-19cc-42b2-9388-052ee56a88a8 tempest-AttachVolumeNegativeTest-1700545160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16b3190b-1d5e-43e9-8873-67cd05250d45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:11:57 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-cb71c89b-19cc-42b2-9388-052ee56a88a8 tempest-AttachVolumeNegativeTest-1700545160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16b3190b-1d5e-43e9-8873-67cd05250d45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:11:57 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-cb71c89b-19cc-42b2-9388-052ee56a88a8 tempest-AttachVolumeNegativeTest-1700545160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af40eac6-f6fa-4fe8-a290-27469047aeb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:11:57 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-cb71c89b-19cc-42b2-9388-052ee56a88a8 tempest-AttachVolumeNegativeTest-1700545160 None] Volume 2071ff43-fcfb-479a-a0e7-41bfd69f9022: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2071ff43-fcfb-479a-a0e7-41bfd69f9022', 'volume_size': 1} Nov 02 10:11:57 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-cb71c89b-19cc-42b2-9388-052ee56a88a8 tempest-AttachVolumeNegativeTest-1700545160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:11:57 devstack sudo[97612]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:57 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-b94e86f4-0211-440c-b71a-31336e9badfb tempest-VolumesDeleteCascade-1379795829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-01c5df5c-64b9-4029-bc92-869c9b48d2f9" returned: 0 in 0.711s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:57 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-b94e86f4-0211-440c-b71a-31336e9badfb tempest-VolumesDeleteCascade-1379795829 None] Lock "cinder-quobyte-01c5df5c-64b9-4029-bc92-869c9b48d2f9" released by "delete_volume" :: held 1.787s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:11:57 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-b94e86f4-0211-440c-b71a-31336e9badfb tempest-VolumesDeleteCascade-1379795829 None] Created reservations ['b66518d4-2f95-4aae-84e7-9267ede9c24c', 'c81cfea8-bc59-4ea1-8581-2be19a427026', '6049cbd0-3802-4242-85c9-6745a18ab4d4', '0a91147d-8663-4738-af33-2aae50052b1f'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:11:57 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-b94e86f4-0211-440c-b71a-31336e9badfb tempest-VolumesDeleteCascade-1379795829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:11:57 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-b94e86f4-0211-440c-b71a-31336e9badfb tempest-VolumesDeleteCascade-1379795829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:11:57 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-b94e86f4-0211-440c-b71a-31336e9badfb tempest-VolumesDeleteCascade-1379795829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:11:57 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-b94e86f4-0211-440c-b71a-31336e9badfb tempest-VolumesDeleteCascade-1379795829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:11:57 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-b94e86f4-0211-440c-b71a-31336e9badfb tempest-VolumesDeleteCascade-1379795829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:11:57 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-b94e86f4-0211-440c-b71a-31336e9badfb tempest-VolumesDeleteCascade-1379795829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:57 devstack sudo[97616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:11:57 devstack sudo[97616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:58 devstack sudo[97616]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:58 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-b94e86f4-0211-440c-b71a-31336e9badfb tempest-VolumesDeleteCascade-1379795829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.627s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:58 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-b94e86f4-0211-440c-b71a-31336e9badfb tempest-VolumesDeleteCascade-1379795829 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:11:58 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-b94e86f4-0211-440c-b71a-31336e9badfb tempest-VolumesDeleteCascade-1379795829 None] Deleted volume successfully. Nov 02 10:11:58 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-b94e86f4-0211-440c-b71a-31336e9badfb tempest-VolumesDeleteCascade-1379795829 None] Lock "cinder-01c5df5c-64b9-4029-bc92-869c9b48d2f9-delete_volume" released by "delete_volume" :: held 2.993s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:12:03 devstack sudo[97588]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:03 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6f4c1a60-7c16-4765-b7a9-6b1506741b9b tempest-GroupSnapshotsTest-1082888639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-74f507a5-8b75-4b2b-9a7f-6bd47652be49 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-41b48883-3d24-4ef1-b2a2-80cc598c16e1" returned: 0 in 8.723s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:03 devstack cinder-volume[86890]: DEBUG cinder.image.image_utils [None req-6f4c1a60-7c16-4765-b7a9-6b1506741b9b tempest-GroupSnapshotsTest-1082888639 None] Image conversion details: src /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-74f507a5-8b75-4b2b-9a7f-6bd47652be49, size 1024.00 MB, duration 8.72 sec, destination /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-41b48883-3d24-4ef1-b2a2-80cc598c16e1 {{(pid=86890) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 10:12:03 devstack cinder-volume[86890]: INFO cinder.image.image_utils [None req-6f4c1a60-7c16-4765-b7a9-6b1506741b9b tempest-GroupSnapshotsTest-1082888639 None] Converted 1024.00 MB image at 117.37 MB/s Nov 02 10:12:03 devstack cinder-volume[86890]: WARNING cinder.volume.drivers.remotefs [None req-6f4c1a60-7c16-4765-b7a9-6b1506741b9b tempest-GroupSnapshotsTest-1082888639 None] /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-41b48883-3d24-4ef1-b2a2-80cc598c16e1 is being set with open permissions: ugo+rw: NotImplementedError Nov 02 10:12:03 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6f4c1a60-7c16-4765-b7a9-6b1506741b9b tempest-GroupSnapshotsTest-1082888639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-41b48883-3d24-4ef1-b2a2-80cc598c16e1 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:03 devstack sudo[97629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-41b48883-3d24-4ef1-b2a2-80cc598c16e1 Nov 02 10:12:03 devstack sudo[97629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:03 devstack sudo[97629]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:03 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6f4c1a60-7c16-4765-b7a9-6b1506741b9b tempest-GroupSnapshotsTest-1082888639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-41b48883-3d24-4ef1-b2a2-80cc598c16e1" returned: 0 in 0.250s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:03 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-6f4c1a60-7c16-4765-b7a9-6b1506741b9b tempest-GroupSnapshotsTest-1082888639 None] Lock "cinder-quobyte-41b48883-3d24-4ef1-b2a2-80cc598c16e1" released by "_copy_volume_from_snapshot" :: held 10.017s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:12:03 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-6f4c1a60-7c16-4765-b7a9-6b1506741b9b tempest-GroupSnapshotsTest-1082888639 None] Lock "cinder-quobyte-6a6f7165-cf7a-4267-83b1-91ee2c7d8cb3-41b48883-3d24-4ef1-b2a2-80cc598c16e1" released by "_create_volume_from_snapshot" :: held 10.098s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:12:03 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-6f4c1a60-7c16-4765-b7a9-6b1506741b9b tempest-GroupSnapshotsTest-1082888639 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.122s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:12:03 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-cb71c89b-19cc-42b2-9388-052ee56a88a8 tempest-AttachVolumeNegativeTest-1700545160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.211s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:12:03 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-cb71c89b-19cc-42b2-9388-052ee56a88a8 tempest-AttachVolumeNegativeTest-1700545160 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:11:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-231913111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2071ff43-fcfb-479a-a0e7-41bfd69f9022,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='253ee95a4446482e922e1729e2adb6c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:11:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:11:57Z,use_quota=True,user_id='ea709b481078418fad7a82c87c527935',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:12:03 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-cb71c89b-19cc-42b2-9388-052ee56a88a8 tempest-AttachVolumeNegativeTest-1700545160 None] Creating volume 2071ff43-fcfb-479a-a0e7-41bfd69f9022 {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:12:03 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-cb71c89b-19cc-42b2-9388-052ee56a88a8 tempest-AttachVolumeNegativeTest-1700545160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:12:03 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-cb71c89b-19cc-42b2-9388-052ee56a88a8 tempest-AttachVolumeNegativeTest-1700545160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:12:03 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-cb71c89b-19cc-42b2-9388-052ee56a88a8 tempest-AttachVolumeNegativeTest-1700545160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:12:03 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-cb71c89b-19cc-42b2-9388-052ee56a88a8 tempest-AttachVolumeNegativeTest-1700545160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:12:03 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-cb71c89b-19cc-42b2-9388-052ee56a88a8 tempest-AttachVolumeNegativeTest-1700545160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:12:03 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-cb71c89b-19cc-42b2-9388-052ee56a88a8 tempest-AttachVolumeNegativeTest-1700545160 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:12:03 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-cb71c89b-19cc-42b2-9388-052ee56a88a8 tempest-AttachVolumeNegativeTest-1700545160 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:12:03 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-cb71c89b-19cc-42b2-9388-052ee56a88a8 tempest-AttachVolumeNegativeTest-1700545160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-2071ff43-fcfb-479a-a0e7-41bfd69f9022 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:03 devstack sudo[97633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-2071ff43-fcfb-479a-a0e7-41bfd69f9022 1073741824 Nov 02 10:12:03 devstack sudo[97633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:03 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-6f4c1a60-7c16-4765-b7a9-6b1506741b9b tempest-GroupSnapshotsTest-1082888639 None] Create group from source-snapshot-51674007-dd66-4dd3-b555-69699e9c452b completed successfully. Nov 02 10:12:03 devstack sudo[97633]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:03 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-cb71c89b-19cc-42b2-9388-052ee56a88a8 tempest-AttachVolumeNegativeTest-1700545160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-2071ff43-fcfb-479a-a0e7-41bfd69f9022 1073741824" returned: 0 in 0.482s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:03 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-cb71c89b-19cc-42b2-9388-052ee56a88a8 tempest-AttachVolumeNegativeTest-1700545160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-2071ff43-fcfb-479a-a0e7-41bfd69f9022 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:03 devstack sudo[97639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-2071ff43-fcfb-479a-a0e7-41bfd69f9022 Nov 02 10:12:03 devstack sudo[97639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:04 devstack sudo[97639]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:04 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-cb71c89b-19cc-42b2-9388-052ee56a88a8 tempest-AttachVolumeNegativeTest-1700545160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-2071ff43-fcfb-479a-a0e7-41bfd69f9022" returned: 0 in 0.262s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:04 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-cb71c89b-19cc-42b2-9388-052ee56a88a8 tempest-AttachVolumeNegativeTest-1700545160 None] <== create_volume: return (789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:12:04 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-cb71c89b-19cc-42b2-9388-052ee56a88a8 tempest-AttachVolumeNegativeTest-1700545160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.791s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:12:04 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-cb71c89b-19cc-42b2-9388-052ee56a88a8 tempest-AttachVolumeNegativeTest-1700545160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af40eac6-f6fa-4fe8-a290-27469047aeb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2071ff43-fcfb-479a-a0e7-41bfd69f9022', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:04 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-cb71c89b-19cc-42b2-9388-052ee56a88a8 tempest-AttachVolumeNegativeTest-1700545160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9af7446d-54a6-4ae8-8c96-e21242e26312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:04 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-cb71c89b-19cc-42b2-9388-052ee56a88a8 tempest-AttachVolumeNegativeTest-1700545160 None] Volume volume-2071ff43-fcfb-479a-a0e7-41bfd69f9022 (2071ff43-fcfb-479a-a0e7-41bfd69f9022): created successfully Nov 02 10:12:04 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-cb71c89b-19cc-42b2-9388-052ee56a88a8 tempest-AttachVolumeNegativeTest-1700545160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9af7446d-54a6-4ae8-8c96-e21242e26312) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:04 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-cb71c89b-19cc-42b2-9388-052ee56a88a8 tempest-AttachVolumeNegativeTest-1700545160 None] Flow 'volume_create_manager' (32aed5a1-2c8c-4dfe-9b99-77345a966689) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:12:04 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-cb71c89b-19cc-42b2-9388-052ee56a88a8 tempest-AttachVolumeNegativeTest-1700545160 None] Created volume successfully. Nov 02 10:12:04 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-404cfd14-f05d-4f6b-bab8-fb9052045dee tempest-GroupSnapshotsTest-1082888639 None] Acquiring lock "cinder-quobyte-41b48883-3d24-4ef1-b2a2-80cc598c16e1" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:12:04 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-404cfd14-f05d-4f6b-bab8-fb9052045dee tempest-GroupSnapshotsTest-1082888639 None] Lock "cinder-quobyte-41b48883-3d24-4ef1-b2a2-80cc598c16e1" acquired by "delete_volume" :: waited 0.028s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:12:04 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[15cc09f9-3088-4661-8b2b-c031ae85223d]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:12:04 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-404cfd14-f05d-4f6b-bab8-fb9052045dee tempest-GroupSnapshotsTest-1082888639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-41b48883-3d24-4ef1-b2a2-80cc598c16e1 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:04 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2cc6ff7-32ea-4aae-806f-a7f45be82de4 tempest-VolumesMetadataTest-1542756851 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:12:04 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c2cc6ff7-32ea-4aae-806f-a7f45be82de4 tempest-VolumesMetadataTest-1542756851 None] Flow 'volume_create_manager' (cc4eb892-83c1-4882-b334-6b7d4c7742c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:12:04 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c2cc6ff7-32ea-4aae-806f-a7f45be82de4 tempest-VolumesMetadataTest-1542756851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1183221c-069c-46a4-8f2a-b2a5a54fdd51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:04 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c2cc6ff7-32ea-4aae-806f-a7f45be82de4 tempest-VolumesMetadataTest-1542756851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1183221c-069c-46a4-8f2a-b2a5a54fdd51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:12:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-252339314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4a86ba8-61b5-4be1-8fc4-872326bfea72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9821f650a6f14a49929193ff61ceffbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:12:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:12:05Z,use_quota=True,user_id='494f624abdc54f18a464bf12e5c7cf4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:04 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c2cc6ff7-32ea-4aae-806f-a7f45be82de4 tempest-VolumesMetadataTest-1542756851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01e3e684-23f5-45f6-8d78-3790001ca208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:04 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c2cc6ff7-32ea-4aae-806f-a7f45be82de4 tempest-VolumesMetadataTest-1542756851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01e3e684-23f5-45f6-8d78-3790001ca208) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:04 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c2cc6ff7-32ea-4aae-806f-a7f45be82de4 tempest-VolumesMetadataTest-1542756851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80125e29-8a1b-4ba3-9ba2-1fdf2c171a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:04 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c2cc6ff7-32ea-4aae-806f-a7f45be82de4 tempest-VolumesMetadataTest-1542756851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80125e29-8a1b-4ba3-9ba2-1fdf2c171a50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4a86ba8-61b5-4be1-8fc4-872326bfea72', 'volume_name': 'volume-a4a86ba8-61b5-4be1-8fc4-872326bfea72', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:04 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c2cc6ff7-32ea-4aae-806f-a7f45be82de4 tempest-VolumesMetadataTest-1542756851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57ed051c-8026-493e-956d-4e43c7b59c05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:04 devstack sudo[97642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-41b48883-3d24-4ef1-b2a2-80cc598c16e1 Nov 02 10:12:04 devstack sudo[97642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:04 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c2cc6ff7-32ea-4aae-806f-a7f45be82de4 tempest-VolumesMetadataTest-1542756851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57ed051c-8026-493e-956d-4e43c7b59c05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:04 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c2cc6ff7-32ea-4aae-806f-a7f45be82de4 tempest-VolumesMetadataTest-1542756851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30b59570-56fc-463c-9ef0-a30e3a01f7e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:04 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-c2cc6ff7-32ea-4aae-806f-a7f45be82de4 tempest-VolumesMetadataTest-1542756851 None] Volume a4a86ba8-61b5-4be1-8fc4-872326bfea72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4a86ba8-61b5-4be1-8fc4-872326bfea72', 'volume_size': 1} Nov 02 10:12:04 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c2cc6ff7-32ea-4aae-806f-a7f45be82de4 tempest-VolumesMetadataTest-1542756851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:12:04 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c2cc6ff7-32ea-4aae-806f-a7f45be82de4 tempest-VolumesMetadataTest-1542756851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:12:04 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c2cc6ff7-32ea-4aae-806f-a7f45be82de4 tempest-VolumesMetadataTest-1542756851 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:12:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-252339314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4a86ba8-61b5-4be1-8fc4-872326bfea72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9821f650a6f14a49929193ff61ceffbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:12:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:12:05Z,use_quota=True,user_id='494f624abdc54f18a464bf12e5c7cf4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:12:04 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-c2cc6ff7-32ea-4aae-806f-a7f45be82de4 tempest-VolumesMetadataTest-1542756851 None] Creating volume a4a86ba8-61b5-4be1-8fc4-872326bfea72 {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:12:04 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c2cc6ff7-32ea-4aae-806f-a7f45be82de4 tempest-VolumesMetadataTest-1542756851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:12:04 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c2cc6ff7-32ea-4aae-806f-a7f45be82de4 tempest-VolumesMetadataTest-1542756851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:12:04 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c2cc6ff7-32ea-4aae-806f-a7f45be82de4 tempest-VolumesMetadataTest-1542756851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:12:04 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c2cc6ff7-32ea-4aae-806f-a7f45be82de4 tempest-VolumesMetadataTest-1542756851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:12:04 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c2cc6ff7-32ea-4aae-806f-a7f45be82de4 tempest-VolumesMetadataTest-1542756851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:12:04 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c2cc6ff7-32ea-4aae-806f-a7f45be82de4 tempest-VolumesMetadataTest-1542756851 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:12:04 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-c2cc6ff7-32ea-4aae-806f-a7f45be82de4 tempest-VolumesMetadataTest-1542756851 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:12:04 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c2cc6ff7-32ea-4aae-806f-a7f45be82de4 tempest-VolumesMetadataTest-1542756851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-a4a86ba8-61b5-4be1-8fc4-872326bfea72 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:04 devstack sudo[97646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-a4a86ba8-61b5-4be1-8fc4-872326bfea72 1073741824 Nov 02 10:12:04 devstack sudo[97646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:05 devstack sudo[97642]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:05 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-404cfd14-f05d-4f6b-bab8-fb9052045dee tempest-GroupSnapshotsTest-1082888639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-41b48883-3d24-4ef1-b2a2-80cc598c16e1" returned: 0 in 0.482s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:05 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-404cfd14-f05d-4f6b-bab8-fb9052045dee tempest-GroupSnapshotsTest-1082888639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-41b48883-3d24-4ef1-b2a2-80cc598c16e1 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:05 devstack sudo[97655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-41b48883-3d24-4ef1-b2a2-80cc598c16e1 Nov 02 10:12:05 devstack sudo[97655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:05 devstack sudo[97646]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:05 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c2cc6ff7-32ea-4aae-806f-a7f45be82de4 tempest-VolumesMetadataTest-1542756851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-a4a86ba8-61b5-4be1-8fc4-872326bfea72 1073741824" returned: 0 in 0.573s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:05 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c2cc6ff7-32ea-4aae-806f-a7f45be82de4 tempest-VolumesMetadataTest-1542756851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-a4a86ba8-61b5-4be1-8fc4-872326bfea72 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:05 devstack sudo[97667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-a4a86ba8-61b5-4be1-8fc4-872326bfea72 Nov 02 10:12:05 devstack sudo[97667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:05 devstack sudo[97655]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:05 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-404cfd14-f05d-4f6b-bab8-fb9052045dee tempest-GroupSnapshotsTest-1082888639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-41b48883-3d24-4ef1-b2a2-80cc598c16e1" returned: 0 in 0.329s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:05 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-404cfd14-f05d-4f6b-bab8-fb9052045dee tempest-GroupSnapshotsTest-1082888639 None] Lock "cinder-quobyte-41b48883-3d24-4ef1-b2a2-80cc598c16e1" released by "delete_volume" :: held 0.890s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:12:05 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [req-553a90dc-8aa2-4714-a992-f4c2bed7ec0f req-0a2a2053-8adc-44cc-9ae3-59c78bddc8ed tempest-AttachVolumeNegativeTest-1700545160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:12:05 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-404cfd14-f05d-4f6b-bab8-fb9052045dee tempest-GroupSnapshotsTest-1082888639 None] Created reservations ['8b5bf4a1-9445-4840-9b2f-8bd3057fd025'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:12:05 devstack cinder-volume[86890]: WARNING cinder.quota [None req-404cfd14-f05d-4f6b-bab8-fb9052045dee tempest-GroupSnapshotsTest-1082888639 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1211466853 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1211466853, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:12:05 devstack cinder-volume[86890]: WARNING cinder.quota [None req-404cfd14-f05d-4f6b-bab8-fb9052045dee tempest-GroupSnapshotsTest-1082888639 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1211466853 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1211466853, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:12:05 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-404cfd14-f05d-4f6b-bab8-fb9052045dee tempest-GroupSnapshotsTest-1082888639 None] Created reservations ['f571a778-38a7-4db6-ade1-2db6594fb268', '1d93e8f8-2813-4fd5-a583-2ecc0abdc05d', 'da0afe19-5887-4c76-b081-b7d6216c72f5', '43deb690-3cd3-465a-9ff7-2a60fe816eba'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:12:05 devstack sudo[97667]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:05 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c2cc6ff7-32ea-4aae-806f-a7f45be82de4 tempest-VolumesMetadataTest-1542756851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-a4a86ba8-61b5-4be1-8fc4-872326bfea72" returned: 0 in 0.291s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:05 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c2cc6ff7-32ea-4aae-806f-a7f45be82de4 tempest-VolumesMetadataTest-1542756851 None] <== create_volume: return (920ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:12:05 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c2cc6ff7-32ea-4aae-806f-a7f45be82de4 tempest-VolumesMetadataTest-1542756851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.923s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:12:05 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [req-553a90dc-8aa2-4714-a992-f4c2bed7ec0f req-0a2a2053-8adc-44cc-9ae3-59c78bddc8ed tempest-AttachVolumeNegativeTest-1700545160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.175s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:12:05 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c2cc6ff7-32ea-4aae-806f-a7f45be82de4 tempest-VolumesMetadataTest-1542756851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30b59570-56fc-463c-9ef0-a30e3a01f7e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4a86ba8-61b5-4be1-8fc4-872326bfea72', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:05 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c2cc6ff7-32ea-4aae-806f-a7f45be82de4 tempest-VolumesMetadataTest-1542756851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50716b6a-6c66-4b5b-988b-fe7cc621a085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:05 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-c2cc6ff7-32ea-4aae-806f-a7f45be82de4 tempest-VolumesMetadataTest-1542756851 None] Volume volume-a4a86ba8-61b5-4be1-8fc4-872326bfea72 (a4a86ba8-61b5-4be1-8fc4-872326bfea72): created successfully Nov 02 10:12:05 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c2cc6ff7-32ea-4aae-806f-a7f45be82de4 tempest-VolumesMetadataTest-1542756851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50716b6a-6c66-4b5b-988b-fe7cc621a085) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:05 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c2cc6ff7-32ea-4aae-806f-a7f45be82de4 tempest-VolumesMetadataTest-1542756851 None] Flow 'volume_create_manager' (cc4eb892-83c1-4882-b334-6b7d4c7742c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:12:05 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-404cfd14-f05d-4f6b-bab8-fb9052045dee tempest-GroupSnapshotsTest-1082888639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:12:05 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-404cfd14-f05d-4f6b-bab8-fb9052045dee tempest-GroupSnapshotsTest-1082888639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:12:05 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-404cfd14-f05d-4f6b-bab8-fb9052045dee tempest-GroupSnapshotsTest-1082888639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:12:05 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-404cfd14-f05d-4f6b-bab8-fb9052045dee tempest-GroupSnapshotsTest-1082888639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:12:05 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-404cfd14-f05d-4f6b-bab8-fb9052045dee tempest-GroupSnapshotsTest-1082888639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:12:05 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-404cfd14-f05d-4f6b-bab8-fb9052045dee tempest-GroupSnapshotsTest-1082888639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:05 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [req-553a90dc-8aa2-4714-a992-f4c2bed7ec0f req-0a2a2053-8adc-44cc-9ae3-59c78bddc8ed tempest-AttachVolumeNegativeTest-1700545160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.153s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:12:05 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-c2cc6ff7-32ea-4aae-806f-a7f45be82de4 tempest-VolumesMetadataTest-1542756851 None] Created volume successfully. Nov 02 10:12:05 devstack sudo[97672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:12:05 devstack sudo[97672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:05 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [req-553a90dc-8aa2-4714-a992-f4c2bed7ec0f req-0a2a2053-8adc-44cc-9ae3-59c78bddc8ed tempest-AttachVolumeNegativeTest-1700545160 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67', 'name': 'volume-2071ff43-fcfb-479a-a0e7-41bfd69f9022', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8b8f8a6d-a3ff-4b40-827a-75cc554cc678', 'enforce_multipath': True} {{(pid=86890) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:12:05 devstack cinder-volume[86890]: INFO cinder.volume.manager [req-553a90dc-8aa2-4714-a992-f4c2bed7ec0f req-0a2a2053-8adc-44cc-9ae3-59c78bddc8ed tempest-AttachVolumeNegativeTest-1700545160 None] attachment_update completed successfully. Nov 02 10:12:06 devstack sudo[97672]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:06 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-404cfd14-f05d-4f6b-bab8-fb9052045dee tempest-GroupSnapshotsTest-1082888639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.297s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:06 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-404cfd14-f05d-4f6b-bab8-fb9052045dee tempest-GroupSnapshotsTest-1082888639 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:12:06 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-404cfd14-f05d-4f6b-bab8-fb9052045dee tempest-GroupSnapshotsTest-1082888639 None] Delete group completed successfully. Nov 02 10:12:06 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-1b955d3f-61bc-4143-bae5-983f5f2c1c28 tempest-GroupSnapshotsTest-1082888639 None] group_snapshot 51674007-dd66-4dd3-b555-69699e9c452b: deleting Nov 02 10:12:07 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-1b955d3f-61bc-4143-bae5-983f5f2c1c28 tempest-GroupSnapshotsTest-1082888639 None] group_snapshot 51674007-dd66-4dd3-b555-69699e9c452b: deleting {{(pid=86890) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 02 10:12:07 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-1b955d3f-61bc-4143-bae5-983f5f2c1c28 tempest-GroupSnapshotsTest-1082888639 None] Acquiring lock "cinder-quobyte-74f507a5-8b75-4b2b-9a7f-6bd47652be49" by "delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:12:07 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-1b955d3f-61bc-4143-bae5-983f5f2c1c28 tempest-GroupSnapshotsTest-1082888639 None] Lock "cinder-quobyte-74f507a5-8b75-4b2b-9a7f-6bd47652be49" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:12:07 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-1b955d3f-61bc-4143-bae5-983f5f2c1c28 tempest-GroupSnapshotsTest-1082888639 None] Acquiring lock "cinder-quobyte-6a6f7165-cf7a-4267-83b1-91ee2c7d8cb3" by "_delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:12:07 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-1b955d3f-61bc-4143-bae5-983f5f2c1c28 tempest-GroupSnapshotsTest-1082888639 None] Lock "cinder-quobyte-6a6f7165-cf7a-4267-83b1-91ee2c7d8cb3" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:12:07 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-1b955d3f-61bc-4143-bae5-983f5f2c1c28 tempest-GroupSnapshotsTest-1082888639 None] Deleting offline snapshot 6a6f7165-cf7a-4267-83b1-91ee2c7d8cb3 of volume 74f507a5-8b75-4b2b-9a7f-6bd47652be49 {{(pid=86890) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:12:07 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-1b955d3f-61bc-4143-bae5-983f5f2c1c28 tempest-GroupSnapshotsTest-1082888639 None] snapshot_file for this snap is: volume-74f507a5-8b75-4b2b-9a7f-6bd47652be49.6a6f7165-cf7a-4267-83b1-91ee2c7d8cb3 {{(pid=86890) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:12:07 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3657b38-8049-4ad4-838d-5e9bad2979ea]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:12:07 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-1b955d3f-61bc-4143-bae5-983f5f2c1c28 tempest-GroupSnapshotsTest-1082888639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-74f507a5-8b75-4b2b-9a7f-6bd47652be49.6a6f7165-cf7a-4267-83b1-91ee2c7d8cb3 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:07 devstack sudo[97677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-74f507a5-8b75-4b2b-9a7f-6bd47652be49.6a6f7165-cf7a-4267-83b1-91ee2c7d8cb3 Nov 02 10:12:07 devstack sudo[97677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:07 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-6db94af7-71a5-4e66-b5e8-57f48a6ee40f tempest-VolumesMetadataTest-1542756851 None] Acquiring lock "cinder-a4a86ba8-61b5-4be1-8fc4-872326bfea72-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:12:07 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-6db94af7-71a5-4e66-b5e8-57f48a6ee40f tempest-VolumesMetadataTest-1542756851 None] Lock "cinder-a4a86ba8-61b5-4be1-8fc4-872326bfea72-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:12:07 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-6db94af7-71a5-4e66-b5e8-57f48a6ee40f tempest-VolumesMetadataTest-1542756851 None] Acquiring lock "cinder-quobyte-a4a86ba8-61b5-4be1-8fc4-872326bfea72" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:12:07 devstack sudo[97677]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:07 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-1b955d3f-61bc-4143-bae5-983f5f2c1c28 tempest-GroupSnapshotsTest-1082888639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-74f507a5-8b75-4b2b-9a7f-6bd47652be49.6a6f7165-cf7a-4267-83b1-91ee2c7d8cb3" returned: 0 in 0.477s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:07 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-1b955d3f-61bc-4143-bae5-983f5f2c1c28 tempest-GroupSnapshotsTest-1082888639 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-74f507a5-8b75-4b2b-9a7f-6bd47652be49(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86890) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:12:07 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-6db94af7-71a5-4e66-b5e8-57f48a6ee40f tempest-VolumesMetadataTest-1542756851 None] Lock "cinder-quobyte-a4a86ba8-61b5-4be1-8fc4-872326bfea72" acquired by "delete_volume" :: waited 0.040s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:12:07 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[faa6e808-6fcd-4329-9f49-f224134aab56]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:12:07 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-1b955d3f-61bc-4143-bae5-983f5f2c1c28 tempest-GroupSnapshotsTest-1082888639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-74f507a5-8b75-4b2b-9a7f-6bd47652be49 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:07 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[00f10bd1-273c-4cbe-a4af-0700b1a3cf66]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:12:07 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6db94af7-71a5-4e66-b5e8-57f48a6ee40f tempest-VolumesMetadataTest-1542756851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-a4a86ba8-61b5-4be1-8fc4-872326bfea72 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:07 devstack sudo[97682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-74f507a5-8b75-4b2b-9a7f-6bd47652be49 Nov 02 10:12:07 devstack sudo[97682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:07 devstack sudo[97683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-a4a86ba8-61b5-4be1-8fc4-872326bfea72 Nov 02 10:12:07 devstack sudo[97683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:08 devstack sudo[97683]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:08 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6db94af7-71a5-4e66-b5e8-57f48a6ee40f tempest-VolumesMetadataTest-1542756851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-a4a86ba8-61b5-4be1-8fc4-872326bfea72" returned: 0 in 0.427s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:08 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6db94af7-71a5-4e66-b5e8-57f48a6ee40f tempest-VolumesMetadataTest-1542756851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-a4a86ba8-61b5-4be1-8fc4-872326bfea72 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:08 devstack sudo[97691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-a4a86ba8-61b5-4be1-8fc4-872326bfea72 Nov 02 10:12:08 devstack sudo[97691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:08 devstack sudo[97682]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:08 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-1b955d3f-61bc-4143-bae5-983f5f2c1c28 tempest-GroupSnapshotsTest-1082888639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-74f507a5-8b75-4b2b-9a7f-6bd47652be49" returned: 0 in 0.617s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:08 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-1b955d3f-61bc-4143-bae5-983f5f2c1c28 tempest-GroupSnapshotsTest-1082888639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-74f507a5-8b75-4b2b-9a7f-6bd47652be49.6a6f7165-cf7a-4267-83b1-91ee2c7d8cb3 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:08 devstack sudo[97696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-74f507a5-8b75-4b2b-9a7f-6bd47652be49.6a6f7165-cf7a-4267-83b1-91ee2c7d8cb3 Nov 02 10:12:08 devstack sudo[97696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:08 devstack cinder-volume[86890]: INFO cinder.volume.manager [req-130e752c-5cf6-4a26-a79d-9a310f6ba0a3 req-1977dc95-c3e7-49a5-b9a6-7d53b15cb6ca tempest-AttachVolumeNegativeTest-1700545160 None] Terminate volume connection completed successfully. Nov 02 10:12:08 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [req-130e752c-5cf6-4a26-a79d-9a310f6ba0a3 req-1977dc95-c3e7-49a5-b9a6-7d53b15cb6ca tempest-AttachVolumeNegativeTest-1700545160 None] Deleting attachment 8b8f8a6d-a3ff-4b40-827a-75cc554cc678. {{(pid=86890) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:12:08 devstack sudo[97691]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:08 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6db94af7-71a5-4e66-b5e8-57f48a6ee40f tempest-VolumesMetadataTest-1542756851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-a4a86ba8-61b5-4be1-8fc4-872326bfea72" returned: 0 in 0.285s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:08 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-6db94af7-71a5-4e66-b5e8-57f48a6ee40f tempest-VolumesMetadataTest-1542756851 None] Lock "cinder-quobyte-a4a86ba8-61b5-4be1-8fc4-872326bfea72" released by "delete_volume" :: held 0.769s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:12:08 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-6db94af7-71a5-4e66-b5e8-57f48a6ee40f tempest-VolumesMetadataTest-1542756851 None] Created reservations ['707b3d0f-72a1-4dc1-9fbe-58c34c73b473', '5b02320d-33d5-4e95-a08c-04afc9cb9096', '2f12925d-283e-41af-bfea-7048d25b1772', '628bcfe6-d850-45ff-847e-32130decfcc3'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:12:08 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-6db94af7-71a5-4e66-b5e8-57f48a6ee40f tempest-VolumesMetadataTest-1542756851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:12:08 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-6db94af7-71a5-4e66-b5e8-57f48a6ee40f tempest-VolumesMetadataTest-1542756851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:12:08 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-6db94af7-71a5-4e66-b5e8-57f48a6ee40f tempest-VolumesMetadataTest-1542756851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:12:08 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-6db94af7-71a5-4e66-b5e8-57f48a6ee40f tempest-VolumesMetadataTest-1542756851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:12:08 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-6db94af7-71a5-4e66-b5e8-57f48a6ee40f tempest-VolumesMetadataTest-1542756851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:12:08 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6db94af7-71a5-4e66-b5e8-57f48a6ee40f tempest-VolumesMetadataTest-1542756851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:08 devstack sudo[97701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:12:08 devstack sudo[97701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:08 devstack sudo[97696]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:08 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-1b955d3f-61bc-4143-bae5-983f5f2c1c28 tempest-GroupSnapshotsTest-1082888639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-74f507a5-8b75-4b2b-9a7f-6bd47652be49.6a6f7165-cf7a-4267-83b1-91ee2c7d8cb3" returned: 0 in 0.477s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:08 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-1b955d3f-61bc-4143-bae5-983f5f2c1c28 tempest-GroupSnapshotsTest-1082888639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-74f507a5-8b75-4b2b-9a7f-6bd47652be49.6a6f7165-cf7a-4267-83b1-91ee2c7d8cb3 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:08 devstack sudo[97704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-74f507a5-8b75-4b2b-9a7f-6bd47652be49.6a6f7165-cf7a-4267-83b1-91ee2c7d8cb3 Nov 02 10:12:08 devstack sudo[97704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:08 devstack sudo[97701]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:08 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6db94af7-71a5-4e66-b5e8-57f48a6ee40f tempest-VolumesMetadataTest-1542756851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.347s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:08 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-6db94af7-71a5-4e66-b5e8-57f48a6ee40f tempest-VolumesMetadataTest-1542756851 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:12:08 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-6db94af7-71a5-4e66-b5e8-57f48a6ee40f tempest-VolumesMetadataTest-1542756851 None] Deleted volume successfully. Nov 02 10:12:08 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-6db94af7-71a5-4e66-b5e8-57f48a6ee40f tempest-VolumesMetadataTest-1542756851 None] Lock "cinder-a4a86ba8-61b5-4be1-8fc4-872326bfea72-delete_volume" released by "delete_volume" :: held 1.440s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:12:09 devstack sudo[97704]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:09 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-1b955d3f-61bc-4143-bae5-983f5f2c1c28 tempest-GroupSnapshotsTest-1082888639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-74f507a5-8b75-4b2b-9a7f-6bd47652be49.6a6f7165-cf7a-4267-83b1-91ee2c7d8cb3" returned: 0 in 0.341s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:09 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-1b955d3f-61bc-4143-bae5-983f5f2c1c28 tempest-GroupSnapshotsTest-1082888639 None] Lock "cinder-quobyte-6a6f7165-cf7a-4267-83b1-91ee2c7d8cb3" released by "_delete_snapshot" :: held 2.061s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:12:09 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-1b955d3f-61bc-4143-bae5-983f5f2c1c28 tempest-GroupSnapshotsTest-1082888639 None] Lock "cinder-quobyte-74f507a5-8b75-4b2b-9a7f-6bd47652be49" released by "delete_snapshot" :: held 2.090s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:12:09 devstack cinder-volume[86890]: WARNING cinder.quota [None req-1b955d3f-61bc-4143-bae5-983f5f2c1c28 tempest-GroupSnapshotsTest-1082888639 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1211466853 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1211466853, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:12:09 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-1b955d3f-61bc-4143-bae5-983f5f2c1c28 tempest-GroupSnapshotsTest-1082888639 None] Created reservations ['7e5c7896-5ae6-4755-9652-90a922233cdb', 'b47d7850-0c33-4ffe-90f5-d88e441e00e6', '82601314-3022-44c2-a557-0f769a1d59b7', '15c635a5-5768-4461-af32-f6274b28304f'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:12:09 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-1b955d3f-61bc-4143-bae5-983f5f2c1c28 tempest-GroupSnapshotsTest-1082888639 None] group_snapshot 51674007-dd66-4dd3-b555-69699e9c452b: deleted successfully Nov 02 10:12:10 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-a79f6525-39c7-47f2-8697-46ffdf768c00 tempest-GroupSnapshotsTest-1082888639 None] Acquiring lock "cinder-quobyte-74f507a5-8b75-4b2b-9a7f-6bd47652be49" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:12:10 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-a79f6525-39c7-47f2-8697-46ffdf768c00 tempest-GroupSnapshotsTest-1082888639 None] Lock "cinder-quobyte-74f507a5-8b75-4b2b-9a7f-6bd47652be49" acquired by "delete_volume" :: waited 0.017s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:12:10 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[764bdf01-d69d-48ea-ae86-3273b962823d]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:12:10 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a79f6525-39c7-47f2-8697-46ffdf768c00 tempest-GroupSnapshotsTest-1082888639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-74f507a5-8b75-4b2b-9a7f-6bd47652be49 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:10 devstack sudo[97733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-74f507a5-8b75-4b2b-9a7f-6bd47652be49 Nov 02 10:12:10 devstack sudo[97733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:11 devstack sudo[97733]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:11 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a79f6525-39c7-47f2-8697-46ffdf768c00 tempest-GroupSnapshotsTest-1082888639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-74f507a5-8b75-4b2b-9a7f-6bd47652be49" returned: 0 in 0.548s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:11 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a79f6525-39c7-47f2-8697-46ffdf768c00 tempest-GroupSnapshotsTest-1082888639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-74f507a5-8b75-4b2b-9a7f-6bd47652be49 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:11 devstack sudo[97741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-74f507a5-8b75-4b2b-9a7f-6bd47652be49 Nov 02 10:12:11 devstack sudo[97741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:11 devstack sudo[97741]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:11 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a79f6525-39c7-47f2-8697-46ffdf768c00 tempest-GroupSnapshotsTest-1082888639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-74f507a5-8b75-4b2b-9a7f-6bd47652be49" returned: 0 in 0.554s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:11 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-a79f6525-39c7-47f2-8697-46ffdf768c00 tempest-GroupSnapshotsTest-1082888639 None] Lock "cinder-quobyte-74f507a5-8b75-4b2b-9a7f-6bd47652be49" released by "delete_volume" :: held 1.237s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:12:11 devstack cinder-volume[86890]: DEBUG dbcounter [-] [86890] Writing DB stats cinder:SELECT=112,cinder:INSERT=25,cinder:UPDATE=104,cinder:DELETE=5 {{(pid=86890) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:12:11 devstack cinder-volume[86890]: DEBUG dbcounter [-] [86890] Writing DB stats cinder:UPDATE=104,cinder:SELECT=101,cinder:DELETE=9,cinder:INSERT=26 {{(pid=86890) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:12:12 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-a79f6525-39c7-47f2-8697-46ffdf768c00 tempest-GroupSnapshotsTest-1082888639 None] Created reservations ['a1b9a7bb-1731-4813-bd00-aee3fcc139aa'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:12:12 devstack cinder-volume[86890]: WARNING cinder.db.api [None req-a79f6525-39c7-47f2-8697-46ffdf768c00 tempest-GroupSnapshotsTest-1082888639 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1211466853'] Nov 02 10:12:12 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-a79f6525-39c7-47f2-8697-46ffdf768c00 tempest-GroupSnapshotsTest-1082888639 None] Created reservations ['c5ab6f51-1fa4-49b9-b35d-ea0edaba58e0', '66a55d9a-c03f-4a95-9337-fe8d9e6b60b3', '590c1189-a73e-41b0-8912-296683012396', '56fdec0a-4d61-435f-88b2-a16e61910ccd'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:12:12 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-a79f6525-39c7-47f2-8697-46ffdf768c00 tempest-GroupSnapshotsTest-1082888639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:12:12 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-a79f6525-39c7-47f2-8697-46ffdf768c00 tempest-GroupSnapshotsTest-1082888639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:12:12 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-a79f6525-39c7-47f2-8697-46ffdf768c00 tempest-GroupSnapshotsTest-1082888639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:12:12 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-a79f6525-39c7-47f2-8697-46ffdf768c00 tempest-GroupSnapshotsTest-1082888639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:12:12 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-a79f6525-39c7-47f2-8697-46ffdf768c00 tempest-GroupSnapshotsTest-1082888639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:12:12 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a79f6525-39c7-47f2-8697-46ffdf768c00 tempest-GroupSnapshotsTest-1082888639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:12 devstack sudo[97780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:12:12 devstack sudo[97780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:13 devstack sudo[97780]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:13 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a79f6525-39c7-47f2-8697-46ffdf768c00 tempest-GroupSnapshotsTest-1082888639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.649s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:13 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-a79f6525-39c7-47f2-8697-46ffdf768c00 tempest-GroupSnapshotsTest-1082888639 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:12:13 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-a79f6525-39c7-47f2-8697-46ffdf768c00 tempest-GroupSnapshotsTest-1082888639 None] Delete group completed successfully. Nov 02 10:12:14 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-7d7c1031-eb1f-47ab-97d7-64d4be928c35 tempest-GroupSnapshotsTest-1082888639 None] Group tempest-GroupSnapshotsTest-Group-110277678: creating Nov 02 10:12:14 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-7d7c1031-eb1f-47ab-97d7-64d4be928c35 tempest-GroupSnapshotsTest-1082888639 None] Group tempest-GroupSnapshotsTest-Group-110277678: created successfully Nov 02 10:12:14 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-7d7c1031-eb1f-47ab-97d7-64d4be928c35 tempest-GroupSnapshotsTest-1082888639 None] Create group completed successfully. Nov 02 10:12:14 devstack cinder-volume[86890]: INFO cinder.volume.manager [req-8d089825-53cb-44a9-ab30-fb27fcc4ca24 req-7aa09035-04a6-4815-bea6-fccf722f842e tempest-TestShelveInstance-1130720155 None] Terminate volume connection completed successfully. Nov 02 10:12:14 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [req-8d089825-53cb-44a9-ab30-fb27fcc4ca24 req-7aa09035-04a6-4815-bea6-fccf722f842e tempest-TestShelveInstance-1130720155 None] Deleting attachment 821201a5-ed61-4205-be03-0cf85261f437. {{(pid=86890) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:12:14 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-91f1a862-8f73-4f7b-a0fe-ffa8e54100ac tempest-AttachVolumeNegativeTest-1700545160 None] Acquiring lock "cinder-2071ff43-fcfb-479a-a0e7-41bfd69f9022-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:12:14 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-91f1a862-8f73-4f7b-a0fe-ffa8e54100ac tempest-AttachVolumeNegativeTest-1700545160 None] Lock "cinder-2071ff43-fcfb-479a-a0e7-41bfd69f9022-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:12:14 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-91f1a862-8f73-4f7b-a0fe-ffa8e54100ac tempest-AttachVolumeNegativeTest-1700545160 None] Acquiring lock "cinder-quobyte-2071ff43-fcfb-479a-a0e7-41bfd69f9022" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:12:14 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-91f1a862-8f73-4f7b-a0fe-ffa8e54100ac tempest-AttachVolumeNegativeTest-1700545160 None] Lock "cinder-quobyte-2071ff43-fcfb-479a-a0e7-41bfd69f9022" acquired by "delete_volume" :: waited 0.019s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:12:14 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[a71db160-54dc-41fe-9554-b01f666c7a50]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:12:14 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-91f1a862-8f73-4f7b-a0fe-ffa8e54100ac tempest-AttachVolumeNegativeTest-1700545160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-2071ff43-fcfb-479a-a0e7-41bfd69f9022 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:14 devstack cinder-volume[86890]: DEBUG cinder.coordination [req-8d089825-53cb-44a9-ab30-fb27fcc4ca24 req-0ddfba0e-066b-4d6c-ba62-799c3be8a7f5 tempest-TestShelveInstance-1130720155 None] Acquiring lock "cinder-4c56933d-ce9c-41c2-aa45-efe5fd9f9cb5-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:12:14 devstack cinder-volume[86890]: DEBUG cinder.coordination [req-8d089825-53cb-44a9-ab30-fb27fcc4ca24 req-0ddfba0e-066b-4d6c-ba62-799c3be8a7f5 tempest-TestShelveInstance-1130720155 None] Lock "cinder-4c56933d-ce9c-41c2-aa45-efe5fd9f9cb5-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:12:14 devstack cinder-volume[86890]: DEBUG cinder.coordination [req-8d089825-53cb-44a9-ab30-fb27fcc4ca24 req-0ddfba0e-066b-4d6c-ba62-799c3be8a7f5 tempest-TestShelveInstance-1130720155 None] Acquiring lock "cinder-quobyte-4c56933d-ce9c-41c2-aa45-efe5fd9f9cb5" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:12:14 devstack cinder-volume[86890]: DEBUG cinder.coordination [req-8d089825-53cb-44a9-ab30-fb27fcc4ca24 req-0ddfba0e-066b-4d6c-ba62-799c3be8a7f5 tempest-TestShelveInstance-1130720155 None] Lock "cinder-quobyte-4c56933d-ce9c-41c2-aa45-efe5fd9f9cb5" acquired by "delete_volume" :: waited 0.023s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:12:14 devstack sudo[97810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-2071ff43-fcfb-479a-a0e7-41bfd69f9022 Nov 02 10:12:14 devstack sudo[97810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:14 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[e596d019-d7b6-4ee8-96a5-f175b55b6b2c]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:12:14 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [req-8d089825-53cb-44a9-ab30-fb27fcc4ca24 req-0ddfba0e-066b-4d6c-ba62-799c3be8a7f5 tempest-TestShelveInstance-1130720155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-4c56933d-ce9c-41c2-aa45-efe5fd9f9cb5 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:15 devstack sudo[97812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-4c56933d-ce9c-41c2-aa45-efe5fd9f9cb5 Nov 02 10:12:15 devstack sudo[97812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:15 devstack sudo[97810]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:15 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-91f1a862-8f73-4f7b-a0fe-ffa8e54100ac tempest-AttachVolumeNegativeTest-1700545160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-2071ff43-fcfb-479a-a0e7-41bfd69f9022" returned: 0 in 0.571s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:15 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-91f1a862-8f73-4f7b-a0fe-ffa8e54100ac tempest-AttachVolumeNegativeTest-1700545160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-2071ff43-fcfb-479a-a0e7-41bfd69f9022 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:15 devstack sudo[97818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-2071ff43-fcfb-479a-a0e7-41bfd69f9022 Nov 02 10:12:15 devstack sudo[97818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:15 devstack sudo[97812]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:15 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [req-8d089825-53cb-44a9-ab30-fb27fcc4ca24 req-0ddfba0e-066b-4d6c-ba62-799c3be8a7f5 tempest-TestShelveInstance-1130720155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-4c56933d-ce9c-41c2-aa45-efe5fd9f9cb5" returned: 0 in 0.589s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:15 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [req-8d089825-53cb-44a9-ab30-fb27fcc4ca24 req-0ddfba0e-066b-4d6c-ba62-799c3be8a7f5 tempest-TestShelveInstance-1130720155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-4c56933d-ce9c-41c2-aa45-efe5fd9f9cb5 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:15 devstack sudo[97824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-4c56933d-ce9c-41c2-aa45-efe5fd9f9cb5 Nov 02 10:12:15 devstack sudo[97824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:15 devstack sudo[97818]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:15 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-91f1a862-8f73-4f7b-a0fe-ffa8e54100ac tempest-AttachVolumeNegativeTest-1700545160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-2071ff43-fcfb-479a-a0e7-41bfd69f9022" returned: 0 in 0.523s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:15 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-91f1a862-8f73-4f7b-a0fe-ffa8e54100ac tempest-AttachVolumeNegativeTest-1700545160 None] Lock "cinder-quobyte-2071ff43-fcfb-479a-a0e7-41bfd69f9022" released by "delete_volume" :: held 1.170s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:12:15 devstack sudo[97824]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:16 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [req-8d089825-53cb-44a9-ab30-fb27fcc4ca24 req-0ddfba0e-066b-4d6c-ba62-799c3be8a7f5 tempest-TestShelveInstance-1130720155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-4c56933d-ce9c-41c2-aa45-efe5fd9f9cb5" returned: 0 in 0.516s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:16 devstack cinder-volume[86890]: DEBUG cinder.coordination [req-8d089825-53cb-44a9-ab30-fb27fcc4ca24 req-0ddfba0e-066b-4d6c-ba62-799c3be8a7f5 tempest-TestShelveInstance-1130720155 None] Lock "cinder-quobyte-4c56933d-ce9c-41c2-aa45-efe5fd9f9cb5" released by "delete_volume" :: held 1.200s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:12:16 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-91f1a862-8f73-4f7b-a0fe-ffa8e54100ac tempest-AttachVolumeNegativeTest-1700545160 None] Created reservations ['7050fdb2-646a-47bd-b0f7-7e489580e521', 'ba41bb66-92a0-404e-aa05-788ebce20043', '3be65557-a97e-4e9a-926c-a9c17f65036d', '5fb3c889-439d-4664-9d81-7b1231579ff1'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:12:16 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-91f1a862-8f73-4f7b-a0fe-ffa8e54100ac tempest-AttachVolumeNegativeTest-1700545160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:12:16 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-91f1a862-8f73-4f7b-a0fe-ffa8e54100ac tempest-AttachVolumeNegativeTest-1700545160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:12:16 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-91f1a862-8f73-4f7b-a0fe-ffa8e54100ac tempest-AttachVolumeNegativeTest-1700545160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:12:16 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-91f1a862-8f73-4f7b-a0fe-ffa8e54100ac tempest-AttachVolumeNegativeTest-1700545160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:12:16 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-91f1a862-8f73-4f7b-a0fe-ffa8e54100ac tempest-AttachVolumeNegativeTest-1700545160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:12:16 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-91f1a862-8f73-4f7b-a0fe-ffa8e54100ac tempest-AttachVolumeNegativeTest-1700545160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:16 devstack cinder-volume[86890]: DEBUG cinder.quota [req-8d089825-53cb-44a9-ab30-fb27fcc4ca24 req-0ddfba0e-066b-4d6c-ba62-799c3be8a7f5 tempest-TestShelveInstance-1130720155 None] Created reservations ['56967124-8685-4ed7-b418-1188257ffcec', 'd8950bc4-5e9c-48ab-93bc-0a8a13d7a387', '18bc6813-c9cc-4a8e-aa69-ea749ca1e493', '7f7a1944-bd68-4e37-a6c1-9dacdef803d7'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:12:16 devstack sudo[97834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:12:16 devstack sudo[97834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:16 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-5eb5a3ec-5e0a-44a7-b496-ac2282a59a4d tempest-GroupSnapshotsTest-1082888639 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:12:16 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-5eb5a3ec-5e0a-44a7-b496-ac2282a59a4d tempest-GroupSnapshotsTest-1082888639 None] Flow 'volume_create_manager' (d807fa0b-7ea7-4bf7-a722-192eb0d44e70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:12:16 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-5eb5a3ec-5e0a-44a7-b496-ac2282a59a4d tempest-GroupSnapshotsTest-1082888639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81d609ff-2396-421c-beb9-2e323093fa7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:16 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-5eb5a3ec-5e0a-44a7-b496-ac2282a59a4d tempest-GroupSnapshotsTest-1082888639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81d609ff-2396-421c-beb9-2e323093fa7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:12:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-75508466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b8a0b70f-37c0-4a2f-ad8b-7485796e5181,host='devstack@QuobyteHD#QuobyteHD',id=a633439c-c477-46dd-aac4-7c2515eca7c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da86bd772015494296c5a89b91fd6860',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:12:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:12:16Z,use_quota=True,user_id='3ea20c0690384eebbaa7d0ec60adf22a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ee0bf7a-d54a-4acd-8fe0-2a2afba1d992),volume_type_id=6ee0bf7a-d54a-4acd-8fe0-2a2afba1d992)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:16 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-5eb5a3ec-5e0a-44a7-b496-ac2282a59a4d tempest-GroupSnapshotsTest-1082888639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a11d1a4-8f63-496a-bf21-1143a4aaafc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:16 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-5eb5a3ec-5e0a-44a7-b496-ac2282a59a4d tempest-GroupSnapshotsTest-1082888639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a11d1a4-8f63-496a-bf21-1143a4aaafc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:16 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-5eb5a3ec-5e0a-44a7-b496-ac2282a59a4d tempest-GroupSnapshotsTest-1082888639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2442a19-f502-4ca1-a210-630a932e19e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:16 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-5eb5a3ec-5e0a-44a7-b496-ac2282a59a4d tempest-GroupSnapshotsTest-1082888639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2442a19-f502-4ca1-a210-630a932e19e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a633439c-c477-46dd-aac4-7c2515eca7c0', 'volume_name': 'volume-a633439c-c477-46dd-aac4-7c2515eca7c0', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:16 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-5eb5a3ec-5e0a-44a7-b496-ac2282a59a4d tempest-GroupSnapshotsTest-1082888639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68f5520f-fb32-43ae-b2d2-1a7bc6685cd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:16 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-5eb5a3ec-5e0a-44a7-b496-ac2282a59a4d tempest-GroupSnapshotsTest-1082888639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68f5520f-fb32-43ae-b2d2-1a7bc6685cd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:16 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-5eb5a3ec-5e0a-44a7-b496-ac2282a59a4d tempest-GroupSnapshotsTest-1082888639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ac55af0-77d6-428f-ae1c-896ddabbad09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:16 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-5eb5a3ec-5e0a-44a7-b496-ac2282a59a4d tempest-GroupSnapshotsTest-1082888639 None] Volume a633439c-c477-46dd-aac4-7c2515eca7c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a633439c-c477-46dd-aac4-7c2515eca7c0', 'volume_size': 1} Nov 02 10:12:16 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-5eb5a3ec-5e0a-44a7-b496-ac2282a59a4d tempest-GroupSnapshotsTest-1082888639 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:12:16 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-5eb5a3ec-5e0a-44a7-b496-ac2282a59a4d tempest-GroupSnapshotsTest-1082888639 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:12:16 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-5eb5a3ec-5e0a-44a7-b496-ac2282a59a4d tempest-GroupSnapshotsTest-1082888639 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b8a0b70f-37c0-4a2f-ad8b-7485796e5181,created_at=2026-11-02T09:12:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-75508466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b8a0b70f-37c0-4a2f-ad8b-7485796e5181,host='devstack@QuobyteHD#QuobyteHD',id=a633439c-c477-46dd-aac4-7c2515eca7c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da86bd772015494296c5a89b91fd6860',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:12:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:12:16Z,use_quota=True,user_id='3ea20c0690384eebbaa7d0ec60adf22a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ee0bf7a-d54a-4acd-8fe0-2a2afba1d992),volume_type_id=6ee0bf7a-d54a-4acd-8fe0-2a2afba1d992)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:12:16 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-5eb5a3ec-5e0a-44a7-b496-ac2282a59a4d tempest-GroupSnapshotsTest-1082888639 None] Creating volume a633439c-c477-46dd-aac4-7c2515eca7c0 {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:12:16 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-5eb5a3ec-5e0a-44a7-b496-ac2282a59a4d tempest-GroupSnapshotsTest-1082888639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:12:16 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-5eb5a3ec-5e0a-44a7-b496-ac2282a59a4d tempest-GroupSnapshotsTest-1082888639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:12:16 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-5eb5a3ec-5e0a-44a7-b496-ac2282a59a4d tempest-GroupSnapshotsTest-1082888639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:12:16 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-5eb5a3ec-5e0a-44a7-b496-ac2282a59a4d tempest-GroupSnapshotsTest-1082888639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:12:16 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-5eb5a3ec-5e0a-44a7-b496-ac2282a59a4d tempest-GroupSnapshotsTest-1082888639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:12:16 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-5eb5a3ec-5e0a-44a7-b496-ac2282a59a4d tempest-GroupSnapshotsTest-1082888639 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:12:16 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-5eb5a3ec-5e0a-44a7-b496-ac2282a59a4d tempest-GroupSnapshotsTest-1082888639 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:12:16 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-5eb5a3ec-5e0a-44a7-b496-ac2282a59a4d tempest-GroupSnapshotsTest-1082888639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-a633439c-c477-46dd-aac4-7c2515eca7c0 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:16 devstack sudo[97837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-a633439c-c477-46dd-aac4-7c2515eca7c0 1073741824 Nov 02 10:12:16 devstack sudo[97837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:16 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [req-8d089825-53cb-44a9-ab30-fb27fcc4ca24 req-0ddfba0e-066b-4d6c-ba62-799c3be8a7f5 tempest-TestShelveInstance-1130720155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:12:16 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [req-8d089825-53cb-44a9-ab30-fb27fcc4ca24 req-0ddfba0e-066b-4d6c-ba62-799c3be8a7f5 tempest-TestShelveInstance-1130720155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:12:16 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [req-8d089825-53cb-44a9-ab30-fb27fcc4ca24 req-0ddfba0e-066b-4d6c-ba62-799c3be8a7f5 tempest-TestShelveInstance-1130720155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:12:16 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [req-8d089825-53cb-44a9-ab30-fb27fcc4ca24 req-0ddfba0e-066b-4d6c-ba62-799c3be8a7f5 tempest-TestShelveInstance-1130720155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:12:16 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [req-8d089825-53cb-44a9-ab30-fb27fcc4ca24 req-0ddfba0e-066b-4d6c-ba62-799c3be8a7f5 tempest-TestShelveInstance-1130720155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:12:16 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [req-8d089825-53cb-44a9-ab30-fb27fcc4ca24 req-0ddfba0e-066b-4d6c-ba62-799c3be8a7f5 tempest-TestShelveInstance-1130720155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:16 devstack sudo[97834]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:16 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-91f1a862-8f73-4f7b-a0fe-ffa8e54100ac tempest-AttachVolumeNegativeTest-1700545160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.392s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:16 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-91f1a862-8f73-4f7b-a0fe-ffa8e54100ac tempest-AttachVolumeNegativeTest-1700545160 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:12:16 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-91f1a862-8f73-4f7b-a0fe-ffa8e54100ac tempest-AttachVolumeNegativeTest-1700545160 None] Deleted volume successfully. Nov 02 10:12:16 devstack sudo[97841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:12:16 devstack sudo[97841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:16 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-91f1a862-8f73-4f7b-a0fe-ffa8e54100ac tempest-AttachVolumeNegativeTest-1700545160 None] Lock "cinder-2071ff43-fcfb-479a-a0e7-41bfd69f9022-delete_volume" released by "delete_volume" :: held 2.087s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:12:17 devstack sudo[97841]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:17 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [req-8d089825-53cb-44a9-ab30-fb27fcc4ca24 req-0ddfba0e-066b-4d6c-ba62-799c3be8a7f5 tempest-TestShelveInstance-1130720155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.413s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:17 devstack cinder-volume[86890]: DEBUG cinder.manager [req-8d089825-53cb-44a9-ab30-fb27fcc4ca24 req-0ddfba0e-066b-4d6c-ba62-799c3be8a7f5 tempest-TestShelveInstance-1130720155 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:12:17 devstack cinder-volume[86890]: INFO cinder.volume.manager [req-8d089825-53cb-44a9-ab30-fb27fcc4ca24 req-0ddfba0e-066b-4d6c-ba62-799c3be8a7f5 tempest-TestShelveInstance-1130720155 None] Deleted volume successfully. Nov 02 10:12:17 devstack cinder-volume[86890]: DEBUG cinder.coordination [req-8d089825-53cb-44a9-ab30-fb27fcc4ca24 req-0ddfba0e-066b-4d6c-ba62-799c3be8a7f5 tempest-TestShelveInstance-1130720155 None] Lock "cinder-4c56933d-ce9c-41c2-aa45-efe5fd9f9cb5-delete_volume" released by "delete_volume" :: held 2.301s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:12:17 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-b3e563a3-2192-495d-b46e-2026ac577fbf tempest-AttachVolumeNegativeTest-1700545160 None] Acquiring lock "cinder-e64231a9-fda7-472a-b6e8-d2f2863bc4b7-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:12:17 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-b3e563a3-2192-495d-b46e-2026ac577fbf tempest-AttachVolumeNegativeTest-1700545160 None] Lock "cinder-e64231a9-fda7-472a-b6e8-d2f2863bc4b7-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:12:17 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-b3e563a3-2192-495d-b46e-2026ac577fbf tempest-AttachVolumeNegativeTest-1700545160 None] Acquiring lock "cinder-quobyte-e64231a9-fda7-472a-b6e8-d2f2863bc4b7" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:12:17 devstack sudo[97837]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:17 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-5eb5a3ec-5e0a-44a7-b496-ac2282a59a4d tempest-GroupSnapshotsTest-1082888639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-a633439c-c477-46dd-aac4-7c2515eca7c0 1073741824" returned: 0 in 0.755s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:17 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-b3e563a3-2192-495d-b46e-2026ac577fbf tempest-AttachVolumeNegativeTest-1700545160 None] Lock "cinder-quobyte-e64231a9-fda7-472a-b6e8-d2f2863bc4b7" acquired by "delete_volume" :: waited 0.025s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:12:17 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[57ffe3ce-52bc-42fc-b02d-ac11199a68a4]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:12:17 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-b3e563a3-2192-495d-b46e-2026ac577fbf tempest-AttachVolumeNegativeTest-1700545160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e64231a9-fda7-472a-b6e8-d2f2863bc4b7 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:17 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-5eb5a3ec-5e0a-44a7-b496-ac2282a59a4d tempest-GroupSnapshotsTest-1082888639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-a633439c-c477-46dd-aac4-7c2515eca7c0 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:17 devstack sudo[97850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-a633439c-c477-46dd-aac4-7c2515eca7c0 Nov 02 10:12:17 devstack sudo[97850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:17 devstack sudo[97849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e64231a9-fda7-472a-b6e8-d2f2863bc4b7 Nov 02 10:12:17 devstack sudo[97849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:17 devstack sudo[97850]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:17 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-5eb5a3ec-5e0a-44a7-b496-ac2282a59a4d tempest-GroupSnapshotsTest-1082888639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-a633439c-c477-46dd-aac4-7c2515eca7c0" returned: 0 in 0.405s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:17 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-5eb5a3ec-5e0a-44a7-b496-ac2282a59a4d tempest-GroupSnapshotsTest-1082888639 None] <== create_volume: return (1238ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:12:17 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-5eb5a3ec-5e0a-44a7-b496-ac2282a59a4d tempest-GroupSnapshotsTest-1082888639 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.244s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:12:17 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-5eb5a3ec-5e0a-44a7-b496-ac2282a59a4d tempest-GroupSnapshotsTest-1082888639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ac55af0-77d6-428f-ae1c-896ddabbad09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a633439c-c477-46dd-aac4-7c2515eca7c0', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:17 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-5eb5a3ec-5e0a-44a7-b496-ac2282a59a4d tempest-GroupSnapshotsTest-1082888639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15c67288-c0f4-4409-92af-0621b0e41ff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:17 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-5eb5a3ec-5e0a-44a7-b496-ac2282a59a4d tempest-GroupSnapshotsTest-1082888639 None] Volume volume-a633439c-c477-46dd-aac4-7c2515eca7c0 (a633439c-c477-46dd-aac4-7c2515eca7c0): created successfully Nov 02 10:12:17 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-5eb5a3ec-5e0a-44a7-b496-ac2282a59a4d tempest-GroupSnapshotsTest-1082888639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15c67288-c0f4-4409-92af-0621b0e41ff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:17 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-5eb5a3ec-5e0a-44a7-b496-ac2282a59a4d tempest-GroupSnapshotsTest-1082888639 None] Flow 'volume_create_manager' (d807fa0b-7ea7-4bf7-a722-192eb0d44e70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:12:17 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-5eb5a3ec-5e0a-44a7-b496-ac2282a59a4d tempest-GroupSnapshotsTest-1082888639 None] Created volume successfully. Nov 02 10:12:17 devstack sudo[97849]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:17 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-b3e563a3-2192-495d-b46e-2026ac577fbf tempest-AttachVolumeNegativeTest-1700545160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e64231a9-fda7-472a-b6e8-d2f2863bc4b7" returned: 0 in 0.556s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:17 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-b3e563a3-2192-495d-b46e-2026ac577fbf tempest-AttachVolumeNegativeTest-1700545160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e64231a9-fda7-472a-b6e8-d2f2863bc4b7 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:17 devstack sudo[97858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e64231a9-fda7-472a-b6e8-d2f2863bc4b7 Nov 02 10:12:17 devstack sudo[97858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:18 devstack sudo[97858]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:18 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-b3e563a3-2192-495d-b46e-2026ac577fbf tempest-AttachVolumeNegativeTest-1700545160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e64231a9-fda7-472a-b6e8-d2f2863bc4b7" returned: 0 in 0.295s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:18 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-b3e563a3-2192-495d-b46e-2026ac577fbf tempest-AttachVolumeNegativeTest-1700545160 None] Lock "cinder-quobyte-e64231a9-fda7-472a-b6e8-d2f2863bc4b7" released by "delete_volume" :: held 0.918s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:12:18 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-b3e563a3-2192-495d-b46e-2026ac577fbf tempest-AttachVolumeNegativeTest-1700545160 None] Created reservations ['7f29a83f-25a7-4a15-a0d5-02b6499650a2', 'fb5d69d1-d5b7-498f-bccc-77e050b76832', 'bf99ffd0-9eec-4468-80b0-18aeced74dd7', '760fd563-8d37-4f3e-98df-9489744b8e1c'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:12:18 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-b3e563a3-2192-495d-b46e-2026ac577fbf tempest-AttachVolumeNegativeTest-1700545160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:12:18 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-b3e563a3-2192-495d-b46e-2026ac577fbf tempest-AttachVolumeNegativeTest-1700545160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:12:18 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-b3e563a3-2192-495d-b46e-2026ac577fbf tempest-AttachVolumeNegativeTest-1700545160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:12:18 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-b3e563a3-2192-495d-b46e-2026ac577fbf tempest-AttachVolumeNegativeTest-1700545160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:12:18 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-b3e563a3-2192-495d-b46e-2026ac577fbf tempest-AttachVolumeNegativeTest-1700545160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:12:18 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-b3e563a3-2192-495d-b46e-2026ac577fbf tempest-AttachVolumeNegativeTest-1700545160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:18 devstack sudo[97863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:12:18 devstack sudo[97863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:18 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-67c676dd-d628-4082-b10c-507863277a3d tempest-AttachVolumeNegativeTest-1700545160 None] Acquiring lock "cinder-9a3345e9-17e6-4b0c-82be-04eb9765e8ef-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:12:18 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-67c676dd-d628-4082-b10c-507863277a3d tempest-AttachVolumeNegativeTest-1700545160 None] Lock "cinder-9a3345e9-17e6-4b0c-82be-04eb9765e8ef-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:12:18 devstack sudo[97863]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:18 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-b3e563a3-2192-495d-b46e-2026ac577fbf tempest-AttachVolumeNegativeTest-1700545160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.369s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:18 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-b3e563a3-2192-495d-b46e-2026ac577fbf tempest-AttachVolumeNegativeTest-1700545160 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:12:18 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-b3e563a3-2192-495d-b46e-2026ac577fbf tempest-AttachVolumeNegativeTest-1700545160 None] Deleted volume successfully. Nov 02 10:12:18 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-67c676dd-d628-4082-b10c-507863277a3d tempest-AttachVolumeNegativeTest-1700545160 None] Acquiring lock "cinder-quobyte-9a3345e9-17e6-4b0c-82be-04eb9765e8ef" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:12:18 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-b3e563a3-2192-495d-b46e-2026ac577fbf tempest-AttachVolumeNegativeTest-1700545160 None] Lock "cinder-e64231a9-fda7-472a-b6e8-d2f2863bc4b7-delete_volume" released by "delete_volume" :: held 1.629s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:12:18 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-67c676dd-d628-4082-b10c-507863277a3d tempest-AttachVolumeNegativeTest-1700545160 None] Lock "cinder-quobyte-9a3345e9-17e6-4b0c-82be-04eb9765e8ef" acquired by "delete_volume" :: waited 0.024s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:12:18 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[62c27111-7570-4d19-801f-efad8eefcba6]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:12:18 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-67c676dd-d628-4082-b10c-507863277a3d tempest-AttachVolumeNegativeTest-1700545160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-9a3345e9-17e6-4b0c-82be-04eb9765e8ef {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:19 devstack sudo[97866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-9a3345e9-17e6-4b0c-82be-04eb9765e8ef Nov 02 10:12:19 devstack sudo[97866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:19 devstack sudo[97866]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:19 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-67c676dd-d628-4082-b10c-507863277a3d tempest-AttachVolumeNegativeTest-1700545160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-9a3345e9-17e6-4b0c-82be-04eb9765e8ef" returned: 0 in 0.541s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:19 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-67c676dd-d628-4082-b10c-507863277a3d tempest-AttachVolumeNegativeTest-1700545160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-9a3345e9-17e6-4b0c-82be-04eb9765e8ef {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:19 devstack sudo[97872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-9a3345e9-17e6-4b0c-82be-04eb9765e8ef Nov 02 10:12:19 devstack sudo[97872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:19 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-81908807-ccf6-4852-aca0-7b7df5a221e9 tempest-GroupSnapshotsTest-1082888639 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:12:19 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-81908807-ccf6-4852-aca0-7b7df5a221e9 tempest-GroupSnapshotsTest-1082888639 None] Flow 'volume_create_manager' (4e8e1be2-6a35-48c1-ab05-aa5a26b35757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:12:19 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-81908807-ccf6-4852-aca0-7b7df5a221e9 tempest-GroupSnapshotsTest-1082888639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a570b90a-7dc7-46c7-b74e-216e50ce9ac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:19 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-81908807-ccf6-4852-aca0-7b7df5a221e9 tempest-GroupSnapshotsTest-1082888639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a570b90a-7dc7-46c7-b74e-216e50ce9ac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:12:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-458186232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b8a0b70f-37c0-4a2f-ad8b-7485796e5181,host='devstack@QuobyteHD#QuobyteHD',id=ef13e06b-5dd4-4aab-9427-96f0ff49b0db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da86bd772015494296c5a89b91fd6860',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:12:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:12:20Z,use_quota=True,user_id='3ea20c0690384eebbaa7d0ec60adf22a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ee0bf7a-d54a-4acd-8fe0-2a2afba1d992),volume_type_id=6ee0bf7a-d54a-4acd-8fe0-2a2afba1d992)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:19 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-81908807-ccf6-4852-aca0-7b7df5a221e9 tempest-GroupSnapshotsTest-1082888639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad136a52-9624-4ba5-b9ef-4554af3614cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:19 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-81908807-ccf6-4852-aca0-7b7df5a221e9 tempest-GroupSnapshotsTest-1082888639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad136a52-9624-4ba5-b9ef-4554af3614cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:19 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-81908807-ccf6-4852-aca0-7b7df5a221e9 tempest-GroupSnapshotsTest-1082888639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (606c82de-4531-45fe-b6a8-b21f659366d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:19 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-81908807-ccf6-4852-aca0-7b7df5a221e9 tempest-GroupSnapshotsTest-1082888639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (606c82de-4531-45fe-b6a8-b21f659366d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef13e06b-5dd4-4aab-9427-96f0ff49b0db', 'volume_name': 'volume-ef13e06b-5dd4-4aab-9427-96f0ff49b0db', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:19 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-81908807-ccf6-4852-aca0-7b7df5a221e9 tempest-GroupSnapshotsTest-1082888639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ac68477-970b-4d0a-bf8e-7d10bb77d276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:19 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-81908807-ccf6-4852-aca0-7b7df5a221e9 tempest-GroupSnapshotsTest-1082888639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ac68477-970b-4d0a-bf8e-7d10bb77d276) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:19 devstack sudo[97872]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:19 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-81908807-ccf6-4852-aca0-7b7df5a221e9 tempest-GroupSnapshotsTest-1082888639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbedb676-1c1f-4fa4-a571-64480db71c8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:19 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-81908807-ccf6-4852-aca0-7b7df5a221e9 tempest-GroupSnapshotsTest-1082888639 None] Volume ef13e06b-5dd4-4aab-9427-96f0ff49b0db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef13e06b-5dd4-4aab-9427-96f0ff49b0db', 'volume_size': 1} Nov 02 10:12:19 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-81908807-ccf6-4852-aca0-7b7df5a221e9 tempest-GroupSnapshotsTest-1082888639 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:12:19 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-81908807-ccf6-4852-aca0-7b7df5a221e9 tempest-GroupSnapshotsTest-1082888639 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:12:19 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-81908807-ccf6-4852-aca0-7b7df5a221e9 tempest-GroupSnapshotsTest-1082888639 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b8a0b70f-37c0-4a2f-ad8b-7485796e5181,created_at=2026-11-02T09:12:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-458186232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b8a0b70f-37c0-4a2f-ad8b-7485796e5181,host='devstack@QuobyteHD#QuobyteHD',id=ef13e06b-5dd4-4aab-9427-96f0ff49b0db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da86bd772015494296c5a89b91fd6860',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:12:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:12:20Z,use_quota=True,user_id='3ea20c0690384eebbaa7d0ec60adf22a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ee0bf7a-d54a-4acd-8fe0-2a2afba1d992),volume_type_id=6ee0bf7a-d54a-4acd-8fe0-2a2afba1d992)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:12:19 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-81908807-ccf6-4852-aca0-7b7df5a221e9 tempest-GroupSnapshotsTest-1082888639 None] Creating volume ef13e06b-5dd4-4aab-9427-96f0ff49b0db {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:12:19 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-81908807-ccf6-4852-aca0-7b7df5a221e9 tempest-GroupSnapshotsTest-1082888639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:12:19 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-81908807-ccf6-4852-aca0-7b7df5a221e9 tempest-GroupSnapshotsTest-1082888639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:12:19 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-81908807-ccf6-4852-aca0-7b7df5a221e9 tempest-GroupSnapshotsTest-1082888639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:12:19 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-81908807-ccf6-4852-aca0-7b7df5a221e9 tempest-GroupSnapshotsTest-1082888639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:12:19 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-81908807-ccf6-4852-aca0-7b7df5a221e9 tempest-GroupSnapshotsTest-1082888639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:12:19 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-81908807-ccf6-4852-aca0-7b7df5a221e9 tempest-GroupSnapshotsTest-1082888639 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:12:19 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-81908807-ccf6-4852-aca0-7b7df5a221e9 tempest-GroupSnapshotsTest-1082888639 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:12:19 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-81908807-ccf6-4852-aca0-7b7df5a221e9 tempest-GroupSnapshotsTest-1082888639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ef13e06b-5dd4-4aab-9427-96f0ff49b0db 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:19 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-67c676dd-d628-4082-b10c-507863277a3d tempest-AttachVolumeNegativeTest-1700545160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-9a3345e9-17e6-4b0c-82be-04eb9765e8ef" returned: 0 in 0.522s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:19 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-67c676dd-d628-4082-b10c-507863277a3d tempest-AttachVolumeNegativeTest-1700545160 None] Lock "cinder-quobyte-9a3345e9-17e6-4b0c-82be-04eb9765e8ef" released by "delete_volume" :: held 1.130s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:12:19 devstack sudo[97875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ef13e06b-5dd4-4aab-9427-96f0ff49b0db 1073741824 Nov 02 10:12:19 devstack sudo[97875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:20 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-67c676dd-d628-4082-b10c-507863277a3d tempest-AttachVolumeNegativeTest-1700545160 None] Created reservations ['5166bf4c-771b-4703-945a-bf6d1cee8c81', '05138bb3-5058-4fa2-a48f-fb054315da5d', '6a9c3a8d-dbda-40a1-932e-cbc807e9bc77', '0059a294-aef2-4f0a-8bb2-5316562ac98c'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:12:20 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-67c676dd-d628-4082-b10c-507863277a3d tempest-AttachVolumeNegativeTest-1700545160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:12:20 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-67c676dd-d628-4082-b10c-507863277a3d tempest-AttachVolumeNegativeTest-1700545160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:12:20 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-67c676dd-d628-4082-b10c-507863277a3d tempest-AttachVolumeNegativeTest-1700545160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:12:20 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-67c676dd-d628-4082-b10c-507863277a3d tempest-AttachVolumeNegativeTest-1700545160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:12:20 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-67c676dd-d628-4082-b10c-507863277a3d tempest-AttachVolumeNegativeTest-1700545160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:12:20 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-67c676dd-d628-4082-b10c-507863277a3d tempest-AttachVolumeNegativeTest-1700545160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:20 devstack sudo[97880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:12:20 devstack sudo[97880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:20 devstack sudo[97875]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:20 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-81908807-ccf6-4852-aca0-7b7df5a221e9 tempest-GroupSnapshotsTest-1082888639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ef13e06b-5dd4-4aab-9427-96f0ff49b0db 1073741824" returned: 0 in 0.518s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:20 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-81908807-ccf6-4852-aca0-7b7df5a221e9 tempest-GroupSnapshotsTest-1082888639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ef13e06b-5dd4-4aab-9427-96f0ff49b0db {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:20 devstack sudo[97882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ef13e06b-5dd4-4aab-9427-96f0ff49b0db Nov 02 10:12:20 devstack sudo[97882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:20 devstack sudo[97880]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:20 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-67c676dd-d628-4082-b10c-507863277a3d tempest-AttachVolumeNegativeTest-1700545160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.300s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:20 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-67c676dd-d628-4082-b10c-507863277a3d tempest-AttachVolumeNegativeTest-1700545160 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:12:20 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-67c676dd-d628-4082-b10c-507863277a3d tempest-AttachVolumeNegativeTest-1700545160 None] Deleted volume successfully. Nov 02 10:12:20 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-67c676dd-d628-4082-b10c-507863277a3d tempest-AttachVolumeNegativeTest-1700545160 None] Lock "cinder-9a3345e9-17e6-4b0c-82be-04eb9765e8ef-delete_volume" released by "delete_volume" :: held 1.879s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:12:20 devstack sudo[97882]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:20 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-81908807-ccf6-4852-aca0-7b7df5a221e9 tempest-GroupSnapshotsTest-1082888639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ef13e06b-5dd4-4aab-9427-96f0ff49b0db" returned: 0 in 0.290s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:20 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-81908807-ccf6-4852-aca0-7b7df5a221e9 tempest-GroupSnapshotsTest-1082888639 None] <== create_volume: return (858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:12:20 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-81908807-ccf6-4852-aca0-7b7df5a221e9 tempest-GroupSnapshotsTest-1082888639 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.861s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:12:20 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-81908807-ccf6-4852-aca0-7b7df5a221e9 tempest-GroupSnapshotsTest-1082888639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbedb676-1c1f-4fa4-a571-64480db71c8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef13e06b-5dd4-4aab-9427-96f0ff49b0db', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:20 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-81908807-ccf6-4852-aca0-7b7df5a221e9 tempest-GroupSnapshotsTest-1082888639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2404eef4-81b2-45dd-b490-39230866b4ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:20 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-81908807-ccf6-4852-aca0-7b7df5a221e9 tempest-GroupSnapshotsTest-1082888639 None] Volume volume-ef13e06b-5dd4-4aab-9427-96f0ff49b0db (ef13e06b-5dd4-4aab-9427-96f0ff49b0db): created successfully Nov 02 10:12:20 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-81908807-ccf6-4852-aca0-7b7df5a221e9 tempest-GroupSnapshotsTest-1082888639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2404eef4-81b2-45dd-b490-39230866b4ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:20 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-81908807-ccf6-4852-aca0-7b7df5a221e9 tempest-GroupSnapshotsTest-1082888639 None] Flow 'volume_create_manager' (4e8e1be2-6a35-48c1-ab05-aa5a26b35757) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:12:20 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-81908807-ccf6-4852-aca0-7b7df5a221e9 tempest-GroupSnapshotsTest-1082888639 None] Created volume successfully. Nov 02 10:12:22 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-c7184667-58bf-4aa0-901c-e4e5d7e9591d tempest-GroupSnapshotsTest-1082888639 None] Update group completed successfully. Nov 02 10:12:23 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-9378aaa3-e9c1-40a4-934a-aa3dc9497cfa tempest-GroupSnapshotsTest-1082888639 None] Update group completed successfully. Nov 02 10:12:24 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-ac5896e3-ca62-4eab-8324-46fc979af25d tempest-GroupSnapshotsTest-1082888639 None] Update group completed successfully. Nov 02 10:12:26 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-ecb9aef5-8109-4777-9102-c215ca26887e tempest-GroupSnapshotsTest-1082888639 None] Update group completed successfully. Nov 02 10:12:27 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-1655cd53-01df-4e75-8ec9-67b0052a25aa tempest-GroupSnapshotsTest-1082888639 None] GroupSnapshot f383d5ca-0b61-48f1-b4c5-a13b9faa00cd: creating. Nov 02 10:12:27 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-1655cd53-01df-4e75-8ec9-67b0052a25aa tempest-GroupSnapshotsTest-1082888639 None] Group snapshot f383d5ca-0b61-48f1-b4c5-a13b9faa00cd: creating. {{(pid=86890) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 02 10:12:27 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-1655cd53-01df-4e75-8ec9-67b0052a25aa tempest-GroupSnapshotsTest-1082888639 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:12:27 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-1655cd53-01df-4e75-8ec9-67b0052a25aa tempest-GroupSnapshotsTest-1082888639 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:12:27 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-1655cd53-01df-4e75-8ec9-67b0052a25aa tempest-GroupSnapshotsTest-1082888639 None] Creating offline snapshot a4da21b6-e9ba-430a-a2c7-6da5f9707654 of volume a633439c-c477-46dd-aac4-7c2515eca7c0 {{(pid=86890) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:12:27 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f59b2e3-d7c7-4056-888c-8ca52b9d949e]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:12:27 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-1655cd53-01df-4e75-8ec9-67b0052a25aa tempest-GroupSnapshotsTest-1082888639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-a633439c-c477-46dd-aac4-7c2515eca7c0 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:27 devstack sudo[97891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-a633439c-c477-46dd-aac4-7c2515eca7c0 Nov 02 10:12:27 devstack sudo[97891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:28 devstack sudo[97891]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:28 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-1655cd53-01df-4e75-8ec9-67b0052a25aa tempest-GroupSnapshotsTest-1082888639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-a633439c-c477-46dd-aac4-7c2515eca7c0" returned: 0 in 0.478s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:28 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-1655cd53-01df-4e75-8ec9-67b0052a25aa tempest-GroupSnapshotsTest-1082888639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-a633439c-c477-46dd-aac4-7c2515eca7c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-a633439c-c477-46dd-aac4-7c2515eca7c0.a4da21b6-e9ba-430a-a2c7-6da5f9707654 1G {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:28 devstack sudo[97897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-a633439c-c477-46dd-aac4-7c2515eca7c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-a633439c-c477-46dd-aac4-7c2515eca7c0.a4da21b6-e9ba-430a-a2c7-6da5f9707654 1G Nov 02 10:12:28 devstack sudo[97897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:28 devstack sudo[97897]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:28 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-1655cd53-01df-4e75-8ec9-67b0052a25aa tempest-GroupSnapshotsTest-1082888639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-a633439c-c477-46dd-aac4-7c2515eca7c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-a633439c-c477-46dd-aac4-7c2515eca7c0.a4da21b6-e9ba-430a-a2c7-6da5f9707654 1G" returned: 0 in 0.609s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:28 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-1655cd53-01df-4e75-8ec9-67b0052a25aa tempest-GroupSnapshotsTest-1082888639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a633439c-c477-46dd-aac4-7c2515eca7c0 -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-a633439c-c477-46dd-aac4-7c2515eca7c0.a4da21b6-e9ba-430a-a2c7-6da5f9707654 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:28 devstack sudo[97903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a633439c-c477-46dd-aac4-7c2515eca7c0 -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-a633439c-c477-46dd-aac4-7c2515eca7c0.a4da21b6-e9ba-430a-a2c7-6da5f9707654 Nov 02 10:12:28 devstack sudo[97903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:29 devstack sudo[97903]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:29 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-1655cd53-01df-4e75-8ec9-67b0052a25aa tempest-GroupSnapshotsTest-1082888639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a633439c-c477-46dd-aac4-7c2515eca7c0 -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-a633439c-c477-46dd-aac4-7c2515eca7c0.a4da21b6-e9ba-430a-a2c7-6da5f9707654" returned: 0 in 0.363s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:29 devstack cinder-volume[86890]: WARNING cinder.volume.drivers.remotefs [None req-1655cd53-01df-4e75-8ec9-67b0052a25aa tempest-GroupSnapshotsTest-1082888639 None] /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-a633439c-c477-46dd-aac4-7c2515eca7c0.a4da21b6-e9ba-430a-a2c7-6da5f9707654 is being set with open permissions: ugo+rw: NotImplementedError Nov 02 10:12:29 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-1655cd53-01df-4e75-8ec9-67b0052a25aa tempest-GroupSnapshotsTest-1082888639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-a633439c-c477-46dd-aac4-7c2515eca7c0.a4da21b6-e9ba-430a-a2c7-6da5f9707654 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:29 devstack sudo[97908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-a633439c-c477-46dd-aac4-7c2515eca7c0.a4da21b6-e9ba-430a-a2c7-6da5f9707654 Nov 02 10:12:29 devstack sudo[97908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:29 devstack sudo[97908]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:29 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-1655cd53-01df-4e75-8ec9-67b0052a25aa tempest-GroupSnapshotsTest-1082888639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-a633439c-c477-46dd-aac4-7c2515eca7c0.a4da21b6-e9ba-430a-a2c7-6da5f9707654" returned: 0 in 0.340s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:29 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-1655cd53-01df-4e75-8ec9-67b0052a25aa tempest-GroupSnapshotsTest-1082888639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-a633439c-c477-46dd-aac4-7c2515eca7c0.info {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:29 devstack sudo[97911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-a633439c-c477-46dd-aac4-7c2515eca7c0.info Nov 02 10:12:29 devstack sudo[97911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:30 devstack sudo[97911]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:30 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-1655cd53-01df-4e75-8ec9-67b0052a25aa tempest-GroupSnapshotsTest-1082888639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-a633439c-c477-46dd-aac4-7c2515eca7c0.info" returned: 0 in 0.495s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:30 devstack cinder-volume[86890]: WARNING cinder.volume.drivers.remotefs [None req-1655cd53-01df-4e75-8ec9-67b0052a25aa tempest-GroupSnapshotsTest-1082888639 None] /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-a633439c-c477-46dd-aac4-7c2515eca7c0.info is being set with open permissions: ugo+rw: NotImplementedError Nov 02 10:12:30 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-1655cd53-01df-4e75-8ec9-67b0052a25aa tempest-GroupSnapshotsTest-1082888639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-a633439c-c477-46dd-aac4-7c2515eca7c0.info {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:30 devstack sudo[97914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-a633439c-c477-46dd-aac4-7c2515eca7c0.info Nov 02 10:12:30 devstack sudo[97914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:30 devstack sudo[97914]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:30 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-1655cd53-01df-4e75-8ec9-67b0052a25aa tempest-GroupSnapshotsTest-1082888639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-a633439c-c477-46dd-aac4-7c2515eca7c0.info" returned: 0 in 0.395s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:30 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-1655cd53-01df-4e75-8ec9-67b0052a25aa tempest-GroupSnapshotsTest-1082888639 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.852s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:12:30 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-1655cd53-01df-4e75-8ec9-67b0052a25aa tempest-GroupSnapshotsTest-1082888639 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:12:30 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-1655cd53-01df-4e75-8ec9-67b0052a25aa tempest-GroupSnapshotsTest-1082888639 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:12:30 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-1655cd53-01df-4e75-8ec9-67b0052a25aa tempest-GroupSnapshotsTest-1082888639 None] Creating offline snapshot d2de95c9-1613-4ae5-ad51-579ee5d6dbf5 of volume ef13e06b-5dd4-4aab-9427-96f0ff49b0db {{(pid=86890) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:12:30 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[931dd9ad-cb2e-4119-a5c2-b83ad32a7422]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:12:30 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-1655cd53-01df-4e75-8ec9-67b0052a25aa tempest-GroupSnapshotsTest-1082888639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ef13e06b-5dd4-4aab-9427-96f0ff49b0db {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:30 devstack sudo[97918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ef13e06b-5dd4-4aab-9427-96f0ff49b0db Nov 02 10:12:30 devstack sudo[97918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:30 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-5549b32c-22b9-454e-9070-76d7f198328f tempest-VolumesActionsTest-1577301131 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:12:30 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-5549b32c-22b9-454e-9070-76d7f198328f tempest-VolumesActionsTest-1577301131 None] Flow 'volume_create_manager' (83ec4605-282b-44b7-9069-471d5187c837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:12:30 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-5549b32c-22b9-454e-9070-76d7f198328f tempest-VolumesActionsTest-1577301131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7699d89d-fbfd-421a-accd-29922561b623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:30 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-5549b32c-22b9-454e-9070-76d7f198328f tempest-VolumesActionsTest-1577301131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7699d89d-fbfd-421a-accd-29922561b623) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:12:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-169441810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce1ccdf8-2ef8-469a-8a7d-862b00223a49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1edc792f7384737acd9f20dc8e8df30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:12:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:12:31Z,use_quota=True,user_id='64938085dcfe42439325fa221b924cbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:30 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-5549b32c-22b9-454e-9070-76d7f198328f tempest-VolumesActionsTest-1577301131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38ea7382-5a2f-4eae-8242-a9861de24827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:30 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-5549b32c-22b9-454e-9070-76d7f198328f tempest-VolumesActionsTest-1577301131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38ea7382-5a2f-4eae-8242-a9861de24827) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:30 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-5549b32c-22b9-454e-9070-76d7f198328f tempest-VolumesActionsTest-1577301131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1989f6a1-4cd1-4d97-b5e2-2b3125469a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:30 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-5549b32c-22b9-454e-9070-76d7f198328f tempest-VolumesActionsTest-1577301131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1989f6a1-4cd1-4d97-b5e2-2b3125469a77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce1ccdf8-2ef8-469a-8a7d-862b00223a49', 'volume_name': 'volume-ce1ccdf8-2ef8-469a-8a7d-862b00223a49', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:30 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-5549b32c-22b9-454e-9070-76d7f198328f tempest-VolumesActionsTest-1577301131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbdbb558-83dd-4cf1-b814-582aa7cf2135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:30 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-5549b32c-22b9-454e-9070-76d7f198328f tempest-VolumesActionsTest-1577301131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbdbb558-83dd-4cf1-b814-582aa7cf2135) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:31 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-5549b32c-22b9-454e-9070-76d7f198328f tempest-VolumesActionsTest-1577301131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c59d46f-167f-4a3d-9826-53660affbddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:31 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-5549b32c-22b9-454e-9070-76d7f198328f tempest-VolumesActionsTest-1577301131 None] Volume ce1ccdf8-2ef8-469a-8a7d-862b00223a49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce1ccdf8-2ef8-469a-8a7d-862b00223a49', 'volume_size': 1} Nov 02 10:12:31 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-5549b32c-22b9-454e-9070-76d7f198328f tempest-VolumesActionsTest-1577301131 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:12:31 devstack sudo[97918]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:31 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-1655cd53-01df-4e75-8ec9-67b0052a25aa tempest-GroupSnapshotsTest-1082888639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ef13e06b-5dd4-4aab-9427-96f0ff49b0db" returned: 0 in 0.534s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:31 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-1655cd53-01df-4e75-8ec9-67b0052a25aa tempest-GroupSnapshotsTest-1082888639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ef13e06b-5dd4-4aab-9427-96f0ff49b0db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ef13e06b-5dd4-4aab-9427-96f0ff49b0db.d2de95c9-1613-4ae5-ad51-579ee5d6dbf5 1G {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:31 devstack sudo[97924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ef13e06b-5dd4-4aab-9427-96f0ff49b0db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ef13e06b-5dd4-4aab-9427-96f0ff49b0db.d2de95c9-1613-4ae5-ad51-579ee5d6dbf5 1G Nov 02 10:12:31 devstack sudo[97924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:31 devstack sudo[97924]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:31 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-1655cd53-01df-4e75-8ec9-67b0052a25aa tempest-GroupSnapshotsTest-1082888639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ef13e06b-5dd4-4aab-9427-96f0ff49b0db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ef13e06b-5dd4-4aab-9427-96f0ff49b0db.d2de95c9-1613-4ae5-ad51-579ee5d6dbf5 1G" returned: 0 in 0.545s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:31 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-1655cd53-01df-4e75-8ec9-67b0052a25aa tempest-GroupSnapshotsTest-1082888639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef13e06b-5dd4-4aab-9427-96f0ff49b0db -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ef13e06b-5dd4-4aab-9427-96f0ff49b0db.d2de95c9-1613-4ae5-ad51-579ee5d6dbf5 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:31 devstack sudo[97930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef13e06b-5dd4-4aab-9427-96f0ff49b0db -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ef13e06b-5dd4-4aab-9427-96f0ff49b0db.d2de95c9-1613-4ae5-ad51-579ee5d6dbf5 Nov 02 10:12:31 devstack sudo[97930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:32 devstack sudo[97930]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:32 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-1655cd53-01df-4e75-8ec9-67b0052a25aa tempest-GroupSnapshotsTest-1082888639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef13e06b-5dd4-4aab-9427-96f0ff49b0db -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ef13e06b-5dd4-4aab-9427-96f0ff49b0db.d2de95c9-1613-4ae5-ad51-579ee5d6dbf5" returned: 0 in 0.379s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:32 devstack cinder-volume[86890]: WARNING cinder.volume.drivers.remotefs [None req-1655cd53-01df-4e75-8ec9-67b0052a25aa tempest-GroupSnapshotsTest-1082888639 None] /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ef13e06b-5dd4-4aab-9427-96f0ff49b0db.d2de95c9-1613-4ae5-ad51-579ee5d6dbf5 is being set with open permissions: ugo+rw: NotImplementedError Nov 02 10:12:32 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-1655cd53-01df-4e75-8ec9-67b0052a25aa tempest-GroupSnapshotsTest-1082888639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ef13e06b-5dd4-4aab-9427-96f0ff49b0db.d2de95c9-1613-4ae5-ad51-579ee5d6dbf5 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:32 devstack sudo[97935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ef13e06b-5dd4-4aab-9427-96f0ff49b0db.d2de95c9-1613-4ae5-ad51-579ee5d6dbf5 Nov 02 10:12:32 devstack sudo[97935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:32 devstack sudo[97935]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:32 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-1655cd53-01df-4e75-8ec9-67b0052a25aa tempest-GroupSnapshotsTest-1082888639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ef13e06b-5dd4-4aab-9427-96f0ff49b0db.d2de95c9-1613-4ae5-ad51-579ee5d6dbf5" returned: 0 in 0.259s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:32 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-1655cd53-01df-4e75-8ec9-67b0052a25aa tempest-GroupSnapshotsTest-1082888639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ef13e06b-5dd4-4aab-9427-96f0ff49b0db.info {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:32 devstack sudo[97938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ef13e06b-5dd4-4aab-9427-96f0ff49b0db.info Nov 02 10:12:32 devstack sudo[97938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:32 devstack sudo[97938]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:32 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-1655cd53-01df-4e75-8ec9-67b0052a25aa tempest-GroupSnapshotsTest-1082888639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ef13e06b-5dd4-4aab-9427-96f0ff49b0db.info" returned: 0 in 0.304s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:32 devstack cinder-volume[86890]: WARNING cinder.volume.drivers.remotefs [None req-1655cd53-01df-4e75-8ec9-67b0052a25aa tempest-GroupSnapshotsTest-1082888639 None] /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ef13e06b-5dd4-4aab-9427-96f0ff49b0db.info is being set with open permissions: ugo+rw: NotImplementedError Nov 02 10:12:32 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-1655cd53-01df-4e75-8ec9-67b0052a25aa tempest-GroupSnapshotsTest-1082888639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ef13e06b-5dd4-4aab-9427-96f0ff49b0db.info {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:32 devstack sudo[97941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ef13e06b-5dd4-4aab-9427-96f0ff49b0db.info Nov 02 10:12:32 devstack sudo[97941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:33 devstack sudo[97941]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:33 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-1655cd53-01df-4e75-8ec9-67b0052a25aa tempest-GroupSnapshotsTest-1082888639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ef13e06b-5dd4-4aab-9427-96f0ff49b0db.info" returned: 0 in 0.278s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:33 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-1655cd53-01df-4e75-8ec9-67b0052a25aa tempest-GroupSnapshotsTest-1082888639 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.427s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:12:33 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-5549b32c-22b9-454e-9070-76d7f198328f tempest-VolumesActionsTest-1577301131 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.026s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:12:33 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-5549b32c-22b9-454e-9070-76d7f198328f tempest-VolumesActionsTest-1577301131 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:12:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-169441810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce1ccdf8-2ef8-469a-8a7d-862b00223a49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1edc792f7384737acd9f20dc8e8df30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:12:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:12:31Z,use_quota=True,user_id='64938085dcfe42439325fa221b924cbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:12:33 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-5549b32c-22b9-454e-9070-76d7f198328f tempest-VolumesActionsTest-1577301131 None] Creating volume ce1ccdf8-2ef8-469a-8a7d-862b00223a49 {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:12:33 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-5549b32c-22b9-454e-9070-76d7f198328f tempest-VolumesActionsTest-1577301131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:12:33 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-5549b32c-22b9-454e-9070-76d7f198328f tempest-VolumesActionsTest-1577301131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:12:33 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-5549b32c-22b9-454e-9070-76d7f198328f tempest-VolumesActionsTest-1577301131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:12:33 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-5549b32c-22b9-454e-9070-76d7f198328f tempest-VolumesActionsTest-1577301131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:12:33 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-5549b32c-22b9-454e-9070-76d7f198328f tempest-VolumesActionsTest-1577301131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:12:33 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-5549b32c-22b9-454e-9070-76d7f198328f tempest-VolumesActionsTest-1577301131 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:12:33 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-5549b32c-22b9-454e-9070-76d7f198328f tempest-VolumesActionsTest-1577301131 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:12:33 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-5549b32c-22b9-454e-9070-76d7f198328f tempest-VolumesActionsTest-1577301131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ce1ccdf8-2ef8-469a-8a7d-862b00223a49 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:33 devstack sudo[97944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ce1ccdf8-2ef8-469a-8a7d-862b00223a49 1073741824 Nov 02 10:12:33 devstack sudo[97944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:33 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-1655cd53-01df-4e75-8ec9-67b0052a25aa tempest-GroupSnapshotsTest-1082888639 None] group_snapshot f383d5ca-0b61-48f1-b4c5-a13b9faa00cd: created successfully Nov 02 10:12:33 devstack sudo[97944]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:33 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-5549b32c-22b9-454e-9070-76d7f198328f tempest-VolumesActionsTest-1577301131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ce1ccdf8-2ef8-469a-8a7d-862b00223a49 1073741824" returned: 0 in 0.568s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:33 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-5549b32c-22b9-454e-9070-76d7f198328f tempest-VolumesActionsTest-1577301131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ce1ccdf8-2ef8-469a-8a7d-862b00223a49 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:33 devstack sudo[97951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ce1ccdf8-2ef8-469a-8a7d-862b00223a49 Nov 02 10:12:33 devstack sudo[97951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:33 devstack sudo[97951]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:33 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-5549b32c-22b9-454e-9070-76d7f198328f tempest-VolumesActionsTest-1577301131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ce1ccdf8-2ef8-469a-8a7d-862b00223a49" returned: 0 in 0.285s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:33 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-5549b32c-22b9-454e-9070-76d7f198328f tempest-VolumesActionsTest-1577301131 None] <== create_volume: return (900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:12:33 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-5549b32c-22b9-454e-9070-76d7f198328f tempest-VolumesActionsTest-1577301131 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:12:33 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-5549b32c-22b9-454e-9070-76d7f198328f tempest-VolumesActionsTest-1577301131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c59d46f-167f-4a3d-9826-53660affbddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce1ccdf8-2ef8-469a-8a7d-862b00223a49', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:33 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-5549b32c-22b9-454e-9070-76d7f198328f tempest-VolumesActionsTest-1577301131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c09368fb-f728-4dca-a741-f5230029c323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:33 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-5549b32c-22b9-454e-9070-76d7f198328f tempest-VolumesActionsTest-1577301131 None] Volume volume-ce1ccdf8-2ef8-469a-8a7d-862b00223a49 (ce1ccdf8-2ef8-469a-8a7d-862b00223a49): created successfully Nov 02 10:12:33 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-5549b32c-22b9-454e-9070-76d7f198328f tempest-VolumesActionsTest-1577301131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c09368fb-f728-4dca-a741-f5230029c323) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:33 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-5549b32c-22b9-454e-9070-76d7f198328f tempest-VolumesActionsTest-1577301131 None] Flow 'volume_create_manager' (83ec4605-282b-44b7-9069-471d5187c837) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:12:34 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-5549b32c-22b9-454e-9070-76d7f198328f tempest-VolumesActionsTest-1577301131 None] Created volume successfully. Nov 02 10:12:34 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-100ee0de-fc9f-4d7b-833a-e9395acc8085 tempest-GroupSnapshotsTest-1082888639 None] group_snapshot f383d5ca-0b61-48f1-b4c5-a13b9faa00cd: deleting Nov 02 10:12:34 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-100ee0de-fc9f-4d7b-833a-e9395acc8085 tempest-GroupSnapshotsTest-1082888639 None] group_snapshot f383d5ca-0b61-48f1-b4c5-a13b9faa00cd: deleting {{(pid=86890) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 02 10:12:34 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-100ee0de-fc9f-4d7b-833a-e9395acc8085 tempest-GroupSnapshotsTest-1082888639 None] Acquiring lock "cinder-quobyte-a633439c-c477-46dd-aac4-7c2515eca7c0" by "delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:12:34 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-100ee0de-fc9f-4d7b-833a-e9395acc8085 tempest-GroupSnapshotsTest-1082888639 None] Lock "cinder-quobyte-a633439c-c477-46dd-aac4-7c2515eca7c0" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:12:34 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-100ee0de-fc9f-4d7b-833a-e9395acc8085 tempest-GroupSnapshotsTest-1082888639 None] Acquiring lock "cinder-quobyte-a4da21b6-e9ba-430a-a2c7-6da5f9707654" by "_delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:12:34 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-100ee0de-fc9f-4d7b-833a-e9395acc8085 tempest-GroupSnapshotsTest-1082888639 None] Lock "cinder-quobyte-a4da21b6-e9ba-430a-a2c7-6da5f9707654" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:12:34 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-100ee0de-fc9f-4d7b-833a-e9395acc8085 tempest-GroupSnapshotsTest-1082888639 None] Deleting offline snapshot a4da21b6-e9ba-430a-a2c7-6da5f9707654 of volume a633439c-c477-46dd-aac4-7c2515eca7c0 {{(pid=86890) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:12:34 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-100ee0de-fc9f-4d7b-833a-e9395acc8085 tempest-GroupSnapshotsTest-1082888639 None] snapshot_file for this snap is: volume-a633439c-c477-46dd-aac4-7c2515eca7c0.a4da21b6-e9ba-430a-a2c7-6da5f9707654 {{(pid=86890) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:12:34 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[75642119-82c3-4bd2-a2e3-7fb3051e8145]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:12:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-100ee0de-fc9f-4d7b-833a-e9395acc8085 tempest-GroupSnapshotsTest-1082888639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-a633439c-c477-46dd-aac4-7c2515eca7c0.a4da21b6-e9ba-430a-a2c7-6da5f9707654 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:34 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [req-a4ed125a-a895-466c-8c11-77a0f5c6f55d req-ea8176c0-cbff-45d4-a91f-bda181ef33ec tempest-VolumesGetTestJSON-1081176215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:12:34 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [req-a4ed125a-a895-466c-8c11-77a0f5c6f55d req-ea8176c0-cbff-45d4-a91f-bda181ef33ec tempest-VolumesGetTestJSON-1081176215 None] Flow 'volume_create_manager' (f25c8af5-b1ce-407f-b193-a33597d5db72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:12:34 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [req-a4ed125a-a895-466c-8c11-77a0f5c6f55d req-ea8176c0-cbff-45d4-a91f-bda181ef33ec tempest-VolumesGetTestJSON-1081176215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbd20a59-aca7-426c-af63-6f2907e4c155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:34 devstack sudo[97954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-a633439c-c477-46dd-aac4-7c2515eca7c0.a4da21b6-e9ba-430a-a2c7-6da5f9707654 Nov 02 10:12:34 devstack sudo[97954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:34 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [req-a4ed125a-a895-466c-8c11-77a0f5c6f55d req-ea8176c0-cbff-45d4-a91f-bda181ef33ec tempest-VolumesGetTestJSON-1081176215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbd20a59-aca7-426c-af63-6f2907e4c155) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:12:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1515574636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c36449d9-d7da-4cdc-89ec-bf74c36d560b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2e18b02ed3e342499fef1032371003a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:12:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:12:35Z,use_quota=True,user_id='eff9b6779b6e4759ad71ed59b36d2c4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:34 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [req-a4ed125a-a895-466c-8c11-77a0f5c6f55d req-ea8176c0-cbff-45d4-a91f-bda181ef33ec tempest-VolumesGetTestJSON-1081176215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8436c5a2-0f27-47d7-89b9-47708f984837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:34 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [req-a4ed125a-a895-466c-8c11-77a0f5c6f55d req-ea8176c0-cbff-45d4-a91f-bda181ef33ec tempest-VolumesGetTestJSON-1081176215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8436c5a2-0f27-47d7-89b9-47708f984837) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:34 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [req-a4ed125a-a895-466c-8c11-77a0f5c6f55d req-ea8176c0-cbff-45d4-a91f-bda181ef33ec tempest-VolumesGetTestJSON-1081176215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66d90dcc-c169-4a47-87e3-3520118bc800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:34 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [req-a4ed125a-a895-466c-8c11-77a0f5c6f55d req-ea8176c0-cbff-45d4-a91f-bda181ef33ec tempest-VolumesGetTestJSON-1081176215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66d90dcc-c169-4a47-87e3-3520118bc800) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c36449d9-d7da-4cdc-89ec-bf74c36d560b', 'volume_name': 'volume-c36449d9-d7da-4cdc-89ec-bf74c36d560b', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:34 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [req-a4ed125a-a895-466c-8c11-77a0f5c6f55d req-ea8176c0-cbff-45d4-a91f-bda181ef33ec tempest-VolumesGetTestJSON-1081176215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4404d8c-c145-4bb9-8f26-0bbeccf3c91b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:34 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [req-a4ed125a-a895-466c-8c11-77a0f5c6f55d req-ea8176c0-cbff-45d4-a91f-bda181ef33ec tempest-VolumesGetTestJSON-1081176215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4404d8c-c145-4bb9-8f26-0bbeccf3c91b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:34 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [req-a4ed125a-a895-466c-8c11-77a0f5c6f55d req-ea8176c0-cbff-45d4-a91f-bda181ef33ec tempest-VolumesGetTestJSON-1081176215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45b1003b-08bf-4dd5-bddd-6ca63561707d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:34 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [req-a4ed125a-a895-466c-8c11-77a0f5c6f55d req-ea8176c0-cbff-45d4-a91f-bda181ef33ec tempest-VolumesGetTestJSON-1081176215 None] Volume c36449d9-d7da-4cdc-89ec-bf74c36d560b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c36449d9-d7da-4cdc-89ec-bf74c36d560b', 'volume_size': 1} Nov 02 10:12:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [req-a4ed125a-a895-466c-8c11-77a0f5c6f55d req-ea8176c0-cbff-45d4-a91f-bda181ef33ec tempest-VolumesGetTestJSON-1081176215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:12:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [req-a4ed125a-a895-466c-8c11-77a0f5c6f55d req-ea8176c0-cbff-45d4-a91f-bda181ef33ec tempest-VolumesGetTestJSON-1081176215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:12:34 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [req-a4ed125a-a895-466c-8c11-77a0f5c6f55d req-ea8176c0-cbff-45d4-a91f-bda181ef33ec tempest-VolumesGetTestJSON-1081176215 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:12:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1515574636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c36449d9-d7da-4cdc-89ec-bf74c36d560b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2e18b02ed3e342499fef1032371003a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:12:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:12:35Z,use_quota=True,user_id='eff9b6779b6e4759ad71ed59b36d2c4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:12:34 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [req-a4ed125a-a895-466c-8c11-77a0f5c6f55d req-ea8176c0-cbff-45d4-a91f-bda181ef33ec tempest-VolumesGetTestJSON-1081176215 None] Creating volume c36449d9-d7da-4cdc-89ec-bf74c36d560b {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:12:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [req-a4ed125a-a895-466c-8c11-77a0f5c6f55d req-ea8176c0-cbff-45d4-a91f-bda181ef33ec tempest-VolumesGetTestJSON-1081176215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:12:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [req-a4ed125a-a895-466c-8c11-77a0f5c6f55d req-ea8176c0-cbff-45d4-a91f-bda181ef33ec tempest-VolumesGetTestJSON-1081176215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:12:34 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [req-a4ed125a-a895-466c-8c11-77a0f5c6f55d req-ea8176c0-cbff-45d4-a91f-bda181ef33ec tempest-VolumesGetTestJSON-1081176215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:12:34 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [req-a4ed125a-a895-466c-8c11-77a0f5c6f55d req-ea8176c0-cbff-45d4-a91f-bda181ef33ec tempest-VolumesGetTestJSON-1081176215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:12:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [req-a4ed125a-a895-466c-8c11-77a0f5c6f55d req-ea8176c0-cbff-45d4-a91f-bda181ef33ec tempest-VolumesGetTestJSON-1081176215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:12:34 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [req-a4ed125a-a895-466c-8c11-77a0f5c6f55d req-ea8176c0-cbff-45d4-a91f-bda181ef33ec tempest-VolumesGetTestJSON-1081176215 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:12:34 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [req-a4ed125a-a895-466c-8c11-77a0f5c6f55d req-ea8176c0-cbff-45d4-a91f-bda181ef33ec tempest-VolumesGetTestJSON-1081176215 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:12:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [req-a4ed125a-a895-466c-8c11-77a0f5c6f55d req-ea8176c0-cbff-45d4-a91f-bda181ef33ec tempest-VolumesGetTestJSON-1081176215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-c36449d9-d7da-4cdc-89ec-bf74c36d560b 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:34 devstack cinder-volume[86890]: DEBUG oslo_service.periodic_task [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86890) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:12:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:12:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:12:34 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:12:34 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:12:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:12:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:34 devstack sudo[97956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-c36449d9-d7da-4cdc-89ec-bf74c36d560b 1073741824 Nov 02 10:12:34 devstack sudo[97956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:34 devstack sudo[97957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:12:34 devstack sudo[97957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:35 devstack sudo[97954]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:35 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-100ee0de-fc9f-4d7b-833a-e9395acc8085 tempest-GroupSnapshotsTest-1082888639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-a633439c-c477-46dd-aac4-7c2515eca7c0.a4da21b6-e9ba-430a-a2c7-6da5f9707654" returned: 0 in 0.553s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:35 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-100ee0de-fc9f-4d7b-833a-e9395acc8085 tempest-GroupSnapshotsTest-1082888639 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a633439c-c477-46dd-aac4-7c2515eca7c0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86890) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:12:35 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[70df6a4d-d788-47c9-bc6a-c73aea16332a]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:12:35 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-100ee0de-fc9f-4d7b-833a-e9395acc8085 tempest-GroupSnapshotsTest-1082888639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-a633439c-c477-46dd-aac4-7c2515eca7c0 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:35 devstack sudo[97957]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:35 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.354s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:35 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:12:35 devstack cinder-volume[86890]: DEBUG oslo_service.periodic_task [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Running periodic task VolumeManager._thread_info {{(pid=86890) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:12:35 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] thread count: 29 {{(pid=86890) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:12:35 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] thread info: [<_MainThread(MainThread, started 133913319395456)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86890) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:12:35 devstack sudo[97967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-a633439c-c477-46dd-aac4-7c2515eca7c0 Nov 02 10:12:35 devstack sudo[97967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:35 devstack sudo[97956]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:35 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [req-a4ed125a-a895-466c-8c11-77a0f5c6f55d req-ea8176c0-cbff-45d4-a91f-bda181ef33ec tempest-VolumesGetTestJSON-1081176215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-c36449d9-d7da-4cdc-89ec-bf74c36d560b 1073741824" returned: 0 in 0.658s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:35 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [req-a4ed125a-a895-466c-8c11-77a0f5c6f55d req-ea8176c0-cbff-45d4-a91f-bda181ef33ec tempest-VolumesGetTestJSON-1081176215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-c36449d9-d7da-4cdc-89ec-bf74c36d560b {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:35 devstack sudo[97970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-c36449d9-d7da-4cdc-89ec-bf74c36d560b Nov 02 10:12:35 devstack sudo[97970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:35 devstack sudo[97967]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:35 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-100ee0de-fc9f-4d7b-833a-e9395acc8085 tempest-GroupSnapshotsTest-1082888639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-a633439c-c477-46dd-aac4-7c2515eca7c0" returned: 0 in 0.521s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:35 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-100ee0de-fc9f-4d7b-833a-e9395acc8085 tempest-GroupSnapshotsTest-1082888639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-a633439c-c477-46dd-aac4-7c2515eca7c0.a4da21b6-e9ba-430a-a2c7-6da5f9707654 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:35 devstack sudo[97975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-a633439c-c477-46dd-aac4-7c2515eca7c0.a4da21b6-e9ba-430a-a2c7-6da5f9707654 Nov 02 10:12:35 devstack sudo[97975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:35 devstack sudo[97970]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:35 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [req-a4ed125a-a895-466c-8c11-77a0f5c6f55d req-ea8176c0-cbff-45d4-a91f-bda181ef33ec tempest-VolumesGetTestJSON-1081176215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-c36449d9-d7da-4cdc-89ec-bf74c36d560b" returned: 0 in 0.370s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:35 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [req-a4ed125a-a895-466c-8c11-77a0f5c6f55d req-ea8176c0-cbff-45d4-a91f-bda181ef33ec tempest-VolumesGetTestJSON-1081176215 None] <== create_volume: return (1098ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:12:35 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [req-a4ed125a-a895-466c-8c11-77a0f5c6f55d req-ea8176c0-cbff-45d4-a91f-bda181ef33ec tempest-VolumesGetTestJSON-1081176215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.102s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:12:35 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [req-a4ed125a-a895-466c-8c11-77a0f5c6f55d req-ea8176c0-cbff-45d4-a91f-bda181ef33ec tempest-VolumesGetTestJSON-1081176215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45b1003b-08bf-4dd5-bddd-6ca63561707d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c36449d9-d7da-4cdc-89ec-bf74c36d560b', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:35 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [req-a4ed125a-a895-466c-8c11-77a0f5c6f55d req-ea8176c0-cbff-45d4-a91f-bda181ef33ec tempest-VolumesGetTestJSON-1081176215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b16e1876-4201-47c2-bd4f-70611fe261f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:35 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [req-a4ed125a-a895-466c-8c11-77a0f5c6f55d req-ea8176c0-cbff-45d4-a91f-bda181ef33ec tempest-VolumesGetTestJSON-1081176215 None] Volume volume-c36449d9-d7da-4cdc-89ec-bf74c36d560b (c36449d9-d7da-4cdc-89ec-bf74c36d560b): created successfully Nov 02 10:12:35 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [req-a4ed125a-a895-466c-8c11-77a0f5c6f55d req-ea8176c0-cbff-45d4-a91f-bda181ef33ec tempest-VolumesGetTestJSON-1081176215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b16e1876-4201-47c2-bd4f-70611fe261f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:35 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [req-a4ed125a-a895-466c-8c11-77a0f5c6f55d req-ea8176c0-cbff-45d4-a91f-bda181ef33ec tempest-VolumesGetTestJSON-1081176215 None] Flow 'volume_create_manager' (f25c8af5-b1ce-407f-b193-a33597d5db72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:12:36 devstack cinder-volume[86890]: INFO cinder.volume.manager [req-a4ed125a-a895-466c-8c11-77a0f5c6f55d req-ea8176c0-cbff-45d4-a91f-bda181ef33ec tempest-VolumesGetTestJSON-1081176215 None] Created volume successfully. Nov 02 10:12:36 devstack sudo[97975]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:36 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-100ee0de-fc9f-4d7b-833a-e9395acc8085 tempest-GroupSnapshotsTest-1082888639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-a633439c-c477-46dd-aac4-7c2515eca7c0.a4da21b6-e9ba-430a-a2c7-6da5f9707654" returned: 0 in 0.527s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:36 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-100ee0de-fc9f-4d7b-833a-e9395acc8085 tempest-GroupSnapshotsTest-1082888639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-a633439c-c477-46dd-aac4-7c2515eca7c0.a4da21b6-e9ba-430a-a2c7-6da5f9707654 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:36 devstack sudo[97982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-a633439c-c477-46dd-aac4-7c2515eca7c0.a4da21b6-e9ba-430a-a2c7-6da5f9707654 Nov 02 10:12:36 devstack sudo[97982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:36 devstack sudo[97982]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:36 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-100ee0de-fc9f-4d7b-833a-e9395acc8085 tempest-GroupSnapshotsTest-1082888639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-a633439c-c477-46dd-aac4-7c2515eca7c0.a4da21b6-e9ba-430a-a2c7-6da5f9707654" returned: 0 in 0.282s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:36 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-100ee0de-fc9f-4d7b-833a-e9395acc8085 tempest-GroupSnapshotsTest-1082888639 None] Lock "cinder-quobyte-a4da21b6-e9ba-430a-a2c7-6da5f9707654" released by "_delete_snapshot" :: held 2.083s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:12:36 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-100ee0de-fc9f-4d7b-833a-e9395acc8085 tempest-GroupSnapshotsTest-1082888639 None] Lock "cinder-quobyte-a633439c-c477-46dd-aac4-7c2515eca7c0" released by "delete_snapshot" :: held 2.118s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:12:36 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-100ee0de-fc9f-4d7b-833a-e9395acc8085 tempest-GroupSnapshotsTest-1082888639 None] Acquiring lock "cinder-quobyte-ef13e06b-5dd4-4aab-9427-96f0ff49b0db" by "delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:12:36 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-100ee0de-fc9f-4d7b-833a-e9395acc8085 tempest-GroupSnapshotsTest-1082888639 None] Lock "cinder-quobyte-ef13e06b-5dd4-4aab-9427-96f0ff49b0db" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:12:36 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-100ee0de-fc9f-4d7b-833a-e9395acc8085 tempest-GroupSnapshotsTest-1082888639 None] Acquiring lock "cinder-quobyte-d2de95c9-1613-4ae5-ad51-579ee5d6dbf5" by "_delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:12:36 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-100ee0de-fc9f-4d7b-833a-e9395acc8085 tempest-GroupSnapshotsTest-1082888639 None] Lock "cinder-quobyte-d2de95c9-1613-4ae5-ad51-579ee5d6dbf5" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:12:36 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-100ee0de-fc9f-4d7b-833a-e9395acc8085 tempest-GroupSnapshotsTest-1082888639 None] Deleting offline snapshot d2de95c9-1613-4ae5-ad51-579ee5d6dbf5 of volume ef13e06b-5dd4-4aab-9427-96f0ff49b0db {{(pid=86890) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:12:36 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-100ee0de-fc9f-4d7b-833a-e9395acc8085 tempest-GroupSnapshotsTest-1082888639 None] snapshot_file for this snap is: volume-ef13e06b-5dd4-4aab-9427-96f0ff49b0db.d2de95c9-1613-4ae5-ad51-579ee5d6dbf5 {{(pid=86890) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:12:36 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6ebec04-9d20-48ee-a334-e1f2ccc837a6]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:12:36 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-100ee0de-fc9f-4d7b-833a-e9395acc8085 tempest-GroupSnapshotsTest-1082888639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ef13e06b-5dd4-4aab-9427-96f0ff49b0db.d2de95c9-1613-4ae5-ad51-579ee5d6dbf5 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:36 devstack sudo[97988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ef13e06b-5dd4-4aab-9427-96f0ff49b0db.d2de95c9-1613-4ae5-ad51-579ee5d6dbf5 Nov 02 10:12:36 devstack sudo[97988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:37 devstack sudo[97988]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:37 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-100ee0de-fc9f-4d7b-833a-e9395acc8085 tempest-GroupSnapshotsTest-1082888639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ef13e06b-5dd4-4aab-9427-96f0ff49b0db.d2de95c9-1613-4ae5-ad51-579ee5d6dbf5" returned: 0 in 0.485s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:37 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-100ee0de-fc9f-4d7b-833a-e9395acc8085 tempest-GroupSnapshotsTest-1082888639 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ef13e06b-5dd4-4aab-9427-96f0ff49b0db(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86890) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:12:37 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bd9b20f-8756-4ddd-a051-0a505e5dc841]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:12:37 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-100ee0de-fc9f-4d7b-833a-e9395acc8085 tempest-GroupSnapshotsTest-1082888639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ef13e06b-5dd4-4aab-9427-96f0ff49b0db {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:37 devstack cinder-volume[86890]: DEBUG cinder.coordination [req-c509a876-820e-4ad9-972c-8cf8aff2fac7 req-4c9c4ace-a6d3-4935-88f1-c078ba797361 tempest-VolumesGetTestJSON-1081176215 None] Acquiring lock "cinder-c36449d9-d7da-4cdc-89ec-bf74c36d560b-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:12:37 devstack cinder-volume[86890]: DEBUG cinder.coordination [req-c509a876-820e-4ad9-972c-8cf8aff2fac7 req-4c9c4ace-a6d3-4935-88f1-c078ba797361 tempest-VolumesGetTestJSON-1081176215 None] Lock "cinder-c36449d9-d7da-4cdc-89ec-bf74c36d560b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:12:37 devstack cinder-volume[86890]: DEBUG cinder.coordination [req-c509a876-820e-4ad9-972c-8cf8aff2fac7 req-4c9c4ace-a6d3-4935-88f1-c078ba797361 tempest-VolumesGetTestJSON-1081176215 None] Acquiring lock "cinder-quobyte-c36449d9-d7da-4cdc-89ec-bf74c36d560b" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:12:37 devstack cinder-volume[86890]: DEBUG cinder.coordination [req-c509a876-820e-4ad9-972c-8cf8aff2fac7 req-4c9c4ace-a6d3-4935-88f1-c078ba797361 tempest-VolumesGetTestJSON-1081176215 None] Lock "cinder-quobyte-c36449d9-d7da-4cdc-89ec-bf74c36d560b" acquired by "delete_volume" :: waited 0.021s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:12:37 devstack sudo[97993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ef13e06b-5dd4-4aab-9427-96f0ff49b0db Nov 02 10:12:37 devstack sudo[97993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:37 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[a33ba2a6-f383-45c6-aee2-d7f50178d130]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:12:37 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [req-c509a876-820e-4ad9-972c-8cf8aff2fac7 req-4c9c4ace-a6d3-4935-88f1-c078ba797361 tempest-VolumesGetTestJSON-1081176215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-c36449d9-d7da-4cdc-89ec-bf74c36d560b {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:37 devstack sudo[97995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-c36449d9-d7da-4cdc-89ec-bf74c36d560b Nov 02 10:12:37 devstack sudo[97995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:37 devstack sudo[97993]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:37 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-100ee0de-fc9f-4d7b-833a-e9395acc8085 tempest-GroupSnapshotsTest-1082888639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ef13e06b-5dd4-4aab-9427-96f0ff49b0db" returned: 0 in 0.628s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:37 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-100ee0de-fc9f-4d7b-833a-e9395acc8085 tempest-GroupSnapshotsTest-1082888639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ef13e06b-5dd4-4aab-9427-96f0ff49b0db.d2de95c9-1613-4ae5-ad51-579ee5d6dbf5 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:37 devstack sudo[98003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ef13e06b-5dd4-4aab-9427-96f0ff49b0db.d2de95c9-1613-4ae5-ad51-579ee5d6dbf5 Nov 02 10:12:37 devstack sudo[98003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:38 devstack sudo[97995]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:38 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [req-c509a876-820e-4ad9-972c-8cf8aff2fac7 req-4c9c4ace-a6d3-4935-88f1-c078ba797361 tempest-VolumesGetTestJSON-1081176215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-c36449d9-d7da-4cdc-89ec-bf74c36d560b" returned: 0 in 0.583s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:38 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [req-c509a876-820e-4ad9-972c-8cf8aff2fac7 req-4c9c4ace-a6d3-4935-88f1-c078ba797361 tempest-VolumesGetTestJSON-1081176215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-c36449d9-d7da-4cdc-89ec-bf74c36d560b {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:38 devstack sudo[98007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-c36449d9-d7da-4cdc-89ec-bf74c36d560b Nov 02 10:12:38 devstack sudo[98007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:38 devstack sudo[98007]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:38 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [req-c509a876-820e-4ad9-972c-8cf8aff2fac7 req-4c9c4ace-a6d3-4935-88f1-c078ba797361 tempest-VolumesGetTestJSON-1081176215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-c36449d9-d7da-4cdc-89ec-bf74c36d560b" returned: 0 in 0.351s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:38 devstack sudo[98003]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:38 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-100ee0de-fc9f-4d7b-833a-e9395acc8085 tempest-GroupSnapshotsTest-1082888639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ef13e06b-5dd4-4aab-9427-96f0ff49b0db.d2de95c9-1613-4ae5-ad51-579ee5d6dbf5" returned: 0 in 0.555s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:38 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-100ee0de-fc9f-4d7b-833a-e9395acc8085 tempest-GroupSnapshotsTest-1082888639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ef13e06b-5dd4-4aab-9427-96f0ff49b0db.d2de95c9-1613-4ae5-ad51-579ee5d6dbf5 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:38 devstack cinder-volume[86890]: DEBUG cinder.coordination [req-c509a876-820e-4ad9-972c-8cf8aff2fac7 req-4c9c4ace-a6d3-4935-88f1-c078ba797361 tempest-VolumesGetTestJSON-1081176215 None] Lock "cinder-quobyte-c36449d9-d7da-4cdc-89ec-bf74c36d560b" released by "delete_volume" :: held 1.035s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:12:38 devstack sudo[98015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ef13e06b-5dd4-4aab-9427-96f0ff49b0db.d2de95c9-1613-4ae5-ad51-579ee5d6dbf5 Nov 02 10:12:38 devstack sudo[98015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:38 devstack cinder-volume[86890]: DEBUG cinder.quota [req-c509a876-820e-4ad9-972c-8cf8aff2fac7 req-4c9c4ace-a6d3-4935-88f1-c078ba797361 tempest-VolumesGetTestJSON-1081176215 None] Created reservations ['45521dbf-adf5-4521-b26d-c4bf5d3d37d4', 'fc75d246-e74f-4a6a-9f03-e709b79ca006', '004d180e-bf68-4cab-b330-de2c363ca26f', '03283a86-d879-47ae-a994-daebb34890c4'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:12:38 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [req-c509a876-820e-4ad9-972c-8cf8aff2fac7 req-4c9c4ace-a6d3-4935-88f1-c078ba797361 tempest-VolumesGetTestJSON-1081176215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:12:38 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [req-c509a876-820e-4ad9-972c-8cf8aff2fac7 req-4c9c4ace-a6d3-4935-88f1-c078ba797361 tempest-VolumesGetTestJSON-1081176215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:12:38 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [req-c509a876-820e-4ad9-972c-8cf8aff2fac7 req-4c9c4ace-a6d3-4935-88f1-c078ba797361 tempest-VolumesGetTestJSON-1081176215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:12:38 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [req-c509a876-820e-4ad9-972c-8cf8aff2fac7 req-4c9c4ace-a6d3-4935-88f1-c078ba797361 tempest-VolumesGetTestJSON-1081176215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:12:38 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [req-c509a876-820e-4ad9-972c-8cf8aff2fac7 req-4c9c4ace-a6d3-4935-88f1-c078ba797361 tempest-VolumesGetTestJSON-1081176215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:12:38 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [req-c509a876-820e-4ad9-972c-8cf8aff2fac7 req-4c9c4ace-a6d3-4935-88f1-c078ba797361 tempest-VolumesGetTestJSON-1081176215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:38 devstack sudo[98017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:12:38 devstack sudo[98017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:39 devstack sudo[98015]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:39 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-100ee0de-fc9f-4d7b-833a-e9395acc8085 tempest-GroupSnapshotsTest-1082888639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ef13e06b-5dd4-4aab-9427-96f0ff49b0db.d2de95c9-1613-4ae5-ad51-579ee5d6dbf5" returned: 0 in 0.555s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:39 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-100ee0de-fc9f-4d7b-833a-e9395acc8085 tempest-GroupSnapshotsTest-1082888639 None] Lock "cinder-quobyte-d2de95c9-1613-4ae5-ad51-579ee5d6dbf5" released by "_delete_snapshot" :: held 2.428s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:12:39 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-100ee0de-fc9f-4d7b-833a-e9395acc8085 tempest-GroupSnapshotsTest-1082888639 None] Lock "cinder-quobyte-ef13e06b-5dd4-4aab-9427-96f0ff49b0db" released by "delete_snapshot" :: held 2.466s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:12:39 devstack sudo[98017]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:39 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [req-c509a876-820e-4ad9-972c-8cf8aff2fac7 req-4c9c4ace-a6d3-4935-88f1-c078ba797361 tempest-VolumesGetTestJSON-1081176215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.487s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:39 devstack cinder-volume[86890]: DEBUG cinder.manager [req-c509a876-820e-4ad9-972c-8cf8aff2fac7 req-4c9c4ace-a6d3-4935-88f1-c078ba797361 tempest-VolumesGetTestJSON-1081176215 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:12:39 devstack cinder-volume[86890]: INFO cinder.volume.manager [req-c509a876-820e-4ad9-972c-8cf8aff2fac7 req-4c9c4ace-a6d3-4935-88f1-c078ba797361 tempest-VolumesGetTestJSON-1081176215 None] Deleted volume successfully. Nov 02 10:12:39 devstack cinder-volume[86890]: DEBUG cinder.coordination [req-c509a876-820e-4ad9-972c-8cf8aff2fac7 req-4c9c4ace-a6d3-4935-88f1-c078ba797361 tempest-VolumesGetTestJSON-1081176215 None] Lock "cinder-c36449d9-d7da-4cdc-89ec-bf74c36d560b-delete_volume" released by "delete_volume" :: held 1.870s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:12:39 devstack cinder-volume[86890]: WARNING cinder.quota [None req-100ee0de-fc9f-4d7b-833a-e9395acc8085 tempest-GroupSnapshotsTest-1082888639 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-890737362 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-890737362, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:12:39 devstack cinder-volume[86890]: WARNING cinder.quota [None req-100ee0de-fc9f-4d7b-833a-e9395acc8085 tempest-GroupSnapshotsTest-1082888639 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-890737362 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-890737362, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:12:39 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-100ee0de-fc9f-4d7b-833a-e9395acc8085 tempest-GroupSnapshotsTest-1082888639 None] Created reservations ['89d20e6d-292c-4812-b006-efc6db2f24dd', 'c9b17cef-7c31-4e35-9161-9b205b8b6b9d', '1ad0ab45-66a5-4a25-9744-52a3d3e23432', 'c4fe54c6-0855-4b2d-b2b2-b2fb8be77394'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:12:39 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-100ee0de-fc9f-4d7b-833a-e9395acc8085 tempest-GroupSnapshotsTest-1082888639 None] Created reservations ['04807ce3-a2e2-46fe-b0d2-efdf6b0213ce', '4fec191b-5805-4212-8a1b-c02c557a11b7', '281f1e2d-de27-4ba2-9e91-727512225b8b', '29111703-2c0a-43eb-95d4-39c42acca5ad'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:12:39 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-100ee0de-fc9f-4d7b-833a-e9395acc8085 tempest-GroupSnapshotsTest-1082888639 None] group_snapshot f383d5ca-0b61-48f1-b4c5-a13b9faa00cd: deleted successfully Nov 02 10:12:40 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-44c24700-54a1-4376-8ed3-cf00e99116b3 tempest-GroupSnapshotsTest-1082888639 None] Acquiring lock "cinder-quobyte-a633439c-c477-46dd-aac4-7c2515eca7c0" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:12:40 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-44c24700-54a1-4376-8ed3-cf00e99116b3 tempest-GroupSnapshotsTest-1082888639 None] Lock "cinder-quobyte-a633439c-c477-46dd-aac4-7c2515eca7c0" acquired by "delete_volume" :: waited 0.024s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:12:40 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dbb9807-617b-4fbc-8ed5-91161987e318]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:12:40 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-44c24700-54a1-4376-8ed3-cf00e99116b3 tempest-GroupSnapshotsTest-1082888639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-a633439c-c477-46dd-aac4-7c2515eca7c0 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:41 devstack sudo[98037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-a633439c-c477-46dd-aac4-7c2515eca7c0 Nov 02 10:12:41 devstack sudo[98037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:41 devstack sudo[98037]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:41 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-44c24700-54a1-4376-8ed3-cf00e99116b3 tempest-GroupSnapshotsTest-1082888639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-a633439c-c477-46dd-aac4-7c2515eca7c0" returned: 0 in 0.477s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:41 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-44c24700-54a1-4376-8ed3-cf00e99116b3 tempest-GroupSnapshotsTest-1082888639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-a633439c-c477-46dd-aac4-7c2515eca7c0 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:41 devstack sudo[98042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-a633439c-c477-46dd-aac4-7c2515eca7c0 Nov 02 10:12:41 devstack sudo[98042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:41 devstack sudo[98042]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:41 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-44c24700-54a1-4376-8ed3-cf00e99116b3 tempest-GroupSnapshotsTest-1082888639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-a633439c-c477-46dd-aac4-7c2515eca7c0" returned: 0 in 0.338s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:41 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-44c24700-54a1-4376-8ed3-cf00e99116b3 tempest-GroupSnapshotsTest-1082888639 None] Lock "cinder-quobyte-a633439c-c477-46dd-aac4-7c2515eca7c0" released by "delete_volume" :: held 0.917s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:12:41 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-44c24700-54a1-4376-8ed3-cf00e99116b3 tempest-GroupSnapshotsTest-1082888639 None] Acquiring lock "cinder-quobyte-ef13e06b-5dd4-4aab-9427-96f0ff49b0db" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:12:41 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-44c24700-54a1-4376-8ed3-cf00e99116b3 tempest-GroupSnapshotsTest-1082888639 None] Lock "cinder-quobyte-ef13e06b-5dd4-4aab-9427-96f0ff49b0db" acquired by "delete_volume" :: waited 0.019s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:12:41 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[93aa42b2-bb66-4a6f-9b4f-8a3a4a5d84f4]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:12:41 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-44c24700-54a1-4376-8ed3-cf00e99116b3 tempest-GroupSnapshotsTest-1082888639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ef13e06b-5dd4-4aab-9427-96f0ff49b0db {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:42 devstack sudo[98045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ef13e06b-5dd4-4aab-9427-96f0ff49b0db Nov 02 10:12:42 devstack sudo[98045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:42 devstack sudo[98045]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:42 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-44c24700-54a1-4376-8ed3-cf00e99116b3 tempest-GroupSnapshotsTest-1082888639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ef13e06b-5dd4-4aab-9427-96f0ff49b0db" returned: 0 in 0.627s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:42 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-44c24700-54a1-4376-8ed3-cf00e99116b3 tempest-GroupSnapshotsTest-1082888639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ef13e06b-5dd4-4aab-9427-96f0ff49b0db {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:42 devstack sudo[98050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ef13e06b-5dd4-4aab-9427-96f0ff49b0db Nov 02 10:12:42 devstack sudo[98050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:42 devstack sudo[98050]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:42 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-44c24700-54a1-4376-8ed3-cf00e99116b3 tempest-GroupSnapshotsTest-1082888639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ef13e06b-5dd4-4aab-9427-96f0ff49b0db" returned: 0 in 0.382s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:42 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-44c24700-54a1-4376-8ed3-cf00e99116b3 tempest-GroupSnapshotsTest-1082888639 None] Lock "cinder-quobyte-ef13e06b-5dd4-4aab-9427-96f0ff49b0db" released by "delete_volume" :: held 1.094s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:12:42 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-44c24700-54a1-4376-8ed3-cf00e99116b3 tempest-GroupSnapshotsTest-1082888639 None] Created reservations ['a0342443-ddf4-4074-9650-994fac4835a0'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:12:43 devstack cinder-volume[86890]: WARNING cinder.quota [None req-44c24700-54a1-4376-8ed3-cf00e99116b3 tempest-GroupSnapshotsTest-1082888639 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-890737362 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-890737362, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:12:43 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-44c24700-54a1-4376-8ed3-cf00e99116b3 tempest-GroupSnapshotsTest-1082888639 None] Created reservations ['b99225eb-3fe4-43e3-bd56-8026f3baaf01', '8ae5d5ca-6cec-4ea3-9e8f-3f42c431533b', '0ff6a192-7dea-43da-9b6f-86464a44ad59', 'ee4c0604-16df-4278-a35f-7fb44efb0aa9'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:12:43 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-44c24700-54a1-4376-8ed3-cf00e99116b3 tempest-GroupSnapshotsTest-1082888639 None] Created reservations ['37820c4c-dcc0-44ad-bc39-aeb2dacef4bd', '67be0fbe-bd98-4047-961f-de927a1f5f24', '21ad81c8-2268-40ea-814d-5029c7dbc4ff', '01514a1f-a05d-445b-b4cf-2d6bbe94cbfc'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:12:43 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-44c24700-54a1-4376-8ed3-cf00e99116b3 tempest-GroupSnapshotsTest-1082888639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:12:43 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-44c24700-54a1-4376-8ed3-cf00e99116b3 tempest-GroupSnapshotsTest-1082888639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:12:43 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-44c24700-54a1-4376-8ed3-cf00e99116b3 tempest-GroupSnapshotsTest-1082888639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:12:43 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-44c24700-54a1-4376-8ed3-cf00e99116b3 tempest-GroupSnapshotsTest-1082888639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:12:43 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-44c24700-54a1-4376-8ed3-cf00e99116b3 tempest-GroupSnapshotsTest-1082888639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:12:43 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-44c24700-54a1-4376-8ed3-cf00e99116b3 tempest-GroupSnapshotsTest-1082888639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:43 devstack sudo[98055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:12:43 devstack sudo[98055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:43 devstack sudo[98055]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:43 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-44c24700-54a1-4376-8ed3-cf00e99116b3 tempest-GroupSnapshotsTest-1082888639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.395s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:43 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-44c24700-54a1-4376-8ed3-cf00e99116b3 tempest-GroupSnapshotsTest-1082888639 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:12:43 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-44c24700-54a1-4376-8ed3-cf00e99116b3 tempest-GroupSnapshotsTest-1082888639 None] Delete group completed successfully. Nov 02 10:12:44 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-43e6721a-e3db-40f3-8180-2bdffe446861 tempest-GroupSnapshotsTest-1082888639 None] Group tempest-GroupSnapshotsTest-Group-862310627: creating Nov 02 10:12:44 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-43e6721a-e3db-40f3-8180-2bdffe446861 tempest-GroupSnapshotsTest-1082888639 None] Group tempest-GroupSnapshotsTest-Group-862310627: created successfully Nov 02 10:12:44 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-43e6721a-e3db-40f3-8180-2bdffe446861 tempest-GroupSnapshotsTest-1082888639 None] Create group completed successfully. Nov 02 10:12:46 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-66779a95-3cc0-4cc4-b325-982f3ba86b22 tempest-GroupSnapshotsTest-1082888639 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:12:46 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-66779a95-3cc0-4cc4-b325-982f3ba86b22 tempest-GroupSnapshotsTest-1082888639 None] Flow 'volume_create_manager' (80624c5e-fc9d-4aa5-b4a2-5cf68e803a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:12:46 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-66779a95-3cc0-4cc4-b325-982f3ba86b22 tempest-GroupSnapshotsTest-1082888639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b72f72d9-e714-429f-a48e-c495ba733a9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:46 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-66779a95-3cc0-4cc4-b325-982f3ba86b22 tempest-GroupSnapshotsTest-1082888639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b72f72d9-e714-429f-a48e-c495ba733a9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:12:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1287707862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b8d28c42-22d4-4827-8a8f-e2a8d4eb4037,host='devstack@QuobyteHD#QuobyteHD',id=839dc6ed-e0cc-470a-b14b-c71502c06b20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da86bd772015494296c5a89b91fd6860',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:12:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:12:46Z,use_quota=True,user_id='3ea20c0690384eebbaa7d0ec60adf22a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0297c51-6584-4147-9457-c68e2195233d),volume_type_id=b0297c51-6584-4147-9457-c68e2195233d)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:46 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-66779a95-3cc0-4cc4-b325-982f3ba86b22 tempest-GroupSnapshotsTest-1082888639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a7fc063-62d4-42d5-9ff0-9d8f551def6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:46 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-66779a95-3cc0-4cc4-b325-982f3ba86b22 tempest-GroupSnapshotsTest-1082888639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a7fc063-62d4-42d5-9ff0-9d8f551def6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:46 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-66779a95-3cc0-4cc4-b325-982f3ba86b22 tempest-GroupSnapshotsTest-1082888639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79345817-8297-4d44-8950-525333676464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:46 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-66779a95-3cc0-4cc4-b325-982f3ba86b22 tempest-GroupSnapshotsTest-1082888639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79345817-8297-4d44-8950-525333676464) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '839dc6ed-e0cc-470a-b14b-c71502c06b20', 'volume_name': 'volume-839dc6ed-e0cc-470a-b14b-c71502c06b20', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:46 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-66779a95-3cc0-4cc4-b325-982f3ba86b22 tempest-GroupSnapshotsTest-1082888639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98db2682-e06f-432a-af50-d17090b7fead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:46 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-66779a95-3cc0-4cc4-b325-982f3ba86b22 tempest-GroupSnapshotsTest-1082888639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98db2682-e06f-432a-af50-d17090b7fead) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:46 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-66779a95-3cc0-4cc4-b325-982f3ba86b22 tempest-GroupSnapshotsTest-1082888639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8ff4be4-c7d1-4728-8a3a-593689aa70fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:46 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-66779a95-3cc0-4cc4-b325-982f3ba86b22 tempest-GroupSnapshotsTest-1082888639 None] Volume 839dc6ed-e0cc-470a-b14b-c71502c06b20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-839dc6ed-e0cc-470a-b14b-c71502c06b20', 'volume_size': 1} Nov 02 10:12:46 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-66779a95-3cc0-4cc4-b325-982f3ba86b22 tempest-GroupSnapshotsTest-1082888639 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:12:46 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-66779a95-3cc0-4cc4-b325-982f3ba86b22 tempest-GroupSnapshotsTest-1082888639 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:12:46 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-66779a95-3cc0-4cc4-b325-982f3ba86b22 tempest-GroupSnapshotsTest-1082888639 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b8d28c42-22d4-4827-8a8f-e2a8d4eb4037,created_at=2026-11-02T09:12:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1287707862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b8d28c42-22d4-4827-8a8f-e2a8d4eb4037,host='devstack@QuobyteHD#QuobyteHD',id=839dc6ed-e0cc-470a-b14b-c71502c06b20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da86bd772015494296c5a89b91fd6860',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:12:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:12:46Z,use_quota=True,user_id='3ea20c0690384eebbaa7d0ec60adf22a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0297c51-6584-4147-9457-c68e2195233d),volume_type_id=b0297c51-6584-4147-9457-c68e2195233d)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:12:46 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-66779a95-3cc0-4cc4-b325-982f3ba86b22 tempest-GroupSnapshotsTest-1082888639 None] Creating volume 839dc6ed-e0cc-470a-b14b-c71502c06b20 {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:12:46 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-66779a95-3cc0-4cc4-b325-982f3ba86b22 tempest-GroupSnapshotsTest-1082888639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:12:46 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-66779a95-3cc0-4cc4-b325-982f3ba86b22 tempest-GroupSnapshotsTest-1082888639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:12:46 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-66779a95-3cc0-4cc4-b325-982f3ba86b22 tempest-GroupSnapshotsTest-1082888639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:12:46 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-66779a95-3cc0-4cc4-b325-982f3ba86b22 tempest-GroupSnapshotsTest-1082888639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:12:46 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-66779a95-3cc0-4cc4-b325-982f3ba86b22 tempest-GroupSnapshotsTest-1082888639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:12:46 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-66779a95-3cc0-4cc4-b325-982f3ba86b22 tempest-GroupSnapshotsTest-1082888639 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:12:46 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-66779a95-3cc0-4cc4-b325-982f3ba86b22 tempest-GroupSnapshotsTest-1082888639 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:12:46 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-66779a95-3cc0-4cc4-b325-982f3ba86b22 tempest-GroupSnapshotsTest-1082888639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-839dc6ed-e0cc-470a-b14b-c71502c06b20 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:46 devstack sudo[98115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-839dc6ed-e0cc-470a-b14b-c71502c06b20 1073741824 Nov 02 10:12:46 devstack sudo[98115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:47 devstack sudo[98115]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:47 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-66779a95-3cc0-4cc4-b325-982f3ba86b22 tempest-GroupSnapshotsTest-1082888639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-839dc6ed-e0cc-470a-b14b-c71502c06b20 1073741824" returned: 0 in 0.899s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:47 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-66779a95-3cc0-4cc4-b325-982f3ba86b22 tempest-GroupSnapshotsTest-1082888639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-839dc6ed-e0cc-470a-b14b-c71502c06b20 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:47 devstack sudo[98131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-839dc6ed-e0cc-470a-b14b-c71502c06b20 Nov 02 10:12:47 devstack sudo[98131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:48 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-66779a95-3cc0-4cc4-b325-982f3ba86b22 tempest-GroupSnapshotsTest-1082888639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-839dc6ed-e0cc-470a-b14b-c71502c06b20" returned: 0 in 0.840s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:48 devstack sudo[98131]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:48 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-66779a95-3cc0-4cc4-b325-982f3ba86b22 tempest-GroupSnapshotsTest-1082888639 None] <== create_volume: return (1827ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:12:48 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-66779a95-3cc0-4cc4-b325-982f3ba86b22 tempest-GroupSnapshotsTest-1082888639 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.833s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:12:48 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-66779a95-3cc0-4cc4-b325-982f3ba86b22 tempest-GroupSnapshotsTest-1082888639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8ff4be4-c7d1-4728-8a3a-593689aa70fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-839dc6ed-e0cc-470a-b14b-c71502c06b20', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:48 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-66779a95-3cc0-4cc4-b325-982f3ba86b22 tempest-GroupSnapshotsTest-1082888639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4263ce8-23f1-4228-96c9-82b713ce935e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:48 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-66779a95-3cc0-4cc4-b325-982f3ba86b22 tempest-GroupSnapshotsTest-1082888639 None] Volume volume-839dc6ed-e0cc-470a-b14b-c71502c06b20 (839dc6ed-e0cc-470a-b14b-c71502c06b20): created successfully Nov 02 10:12:48 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-66779a95-3cc0-4cc4-b325-982f3ba86b22 tempest-GroupSnapshotsTest-1082888639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4263ce8-23f1-4228-96c9-82b713ce935e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:48 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-66779a95-3cc0-4cc4-b325-982f3ba86b22 tempest-GroupSnapshotsTest-1082888639 None] Flow 'volume_create_manager' (80624c5e-fc9d-4aa5-b4a2-5cf68e803a03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:12:48 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-66779a95-3cc0-4cc4-b325-982f3ba86b22 tempest-GroupSnapshotsTest-1082888639 None] Created volume successfully. Nov 02 10:12:50 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-41deef9c-f5b2-4550-8d03-9699a82cadef tempest-GroupSnapshotsTest-1082888639 None] GroupSnapshot dd2b0505-2927-4dea-a0f6-de1076f890b2: creating. Nov 02 10:12:50 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-41deef9c-f5b2-4550-8d03-9699a82cadef tempest-GroupSnapshotsTest-1082888639 None] Group snapshot dd2b0505-2927-4dea-a0f6-de1076f890b2: creating. {{(pid=86890) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 02 10:12:50 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-41deef9c-f5b2-4550-8d03-9699a82cadef tempest-GroupSnapshotsTest-1082888639 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:12:50 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-41deef9c-f5b2-4550-8d03-9699a82cadef tempest-GroupSnapshotsTest-1082888639 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:12:50 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-41deef9c-f5b2-4550-8d03-9699a82cadef tempest-GroupSnapshotsTest-1082888639 None] Creating offline snapshot fa9d0aa3-0ccc-4db4-b624-378269514519 of volume 839dc6ed-e0cc-470a-b14b-c71502c06b20 {{(pid=86890) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:12:50 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[021bb7b4-1d07-4be7-a682-ac06a129381b]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:12:50 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-41deef9c-f5b2-4550-8d03-9699a82cadef tempest-GroupSnapshotsTest-1082888639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-839dc6ed-e0cc-470a-b14b-c71502c06b20 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:50 devstack sudo[98137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-839dc6ed-e0cc-470a-b14b-c71502c06b20 Nov 02 10:12:50 devstack sudo[98137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:50 devstack sudo[98137]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:50 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-41deef9c-f5b2-4550-8d03-9699a82cadef tempest-GroupSnapshotsTest-1082888639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-839dc6ed-e0cc-470a-b14b-c71502c06b20" returned: 0 in 0.590s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:50 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-41deef9c-f5b2-4550-8d03-9699a82cadef tempest-GroupSnapshotsTest-1082888639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-839dc6ed-e0cc-470a-b14b-c71502c06b20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-839dc6ed-e0cc-470a-b14b-c71502c06b20.fa9d0aa3-0ccc-4db4-b624-378269514519 1G {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:50 devstack sudo[98142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-839dc6ed-e0cc-470a-b14b-c71502c06b20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-839dc6ed-e0cc-470a-b14b-c71502c06b20.fa9d0aa3-0ccc-4db4-b624-378269514519 1G Nov 02 10:12:50 devstack sudo[98142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:50 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-1e1f488a-27b0-4cb6-96f6-a2c3f36189f4 tempest-VolumesActionsTest-1577301131 None] Acquiring lock "cinder-ce1ccdf8-2ef8-469a-8a7d-862b00223a49" by "attach_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:12:51 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-1e1f488a-27b0-4cb6-96f6-a2c3f36189f4 tempest-VolumesActionsTest-1577301131 None] Lock "cinder-ce1ccdf8-2ef8-469a-8a7d-862b00223a49" acquired by "attach_volume" :: waited 0.029s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:12:51 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-1e1f488a-27b0-4cb6-96f6-a2c3f36189f4 tempest-VolumesActionsTest-1577301131 None] Attaching volume ce1ccdf8-2ef8-469a-8a7d-862b00223a49 to instance b3594516-d471-4c7e-90de-930f20d59b61 at mountpoint /dev/vdb on host None. Nov 02 10:12:51 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-1e1f488a-27b0-4cb6-96f6-a2c3f36189f4 tempest-VolumesActionsTest-1577301131 None] Attach volume completed successfully. Nov 02 10:12:51 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-1e1f488a-27b0-4cb6-96f6-a2c3f36189f4 tempest-VolumesActionsTest-1577301131 None] Lock "cinder-ce1ccdf8-2ef8-469a-8a7d-862b00223a49" released by "attach_volume" :: held 0.280s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:12:51 devstack sudo[98142]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:51 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-41deef9c-f5b2-4550-8d03-9699a82cadef tempest-GroupSnapshotsTest-1082888639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-839dc6ed-e0cc-470a-b14b-c71502c06b20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-839dc6ed-e0cc-470a-b14b-c71502c06b20.fa9d0aa3-0ccc-4db4-b624-378269514519 1G" returned: 0 in 0.817s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:51 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-41deef9c-f5b2-4550-8d03-9699a82cadef tempest-GroupSnapshotsTest-1082888639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-839dc6ed-e0cc-470a-b14b-c71502c06b20 -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-839dc6ed-e0cc-470a-b14b-c71502c06b20.fa9d0aa3-0ccc-4db4-b624-378269514519 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:51 devstack sudo[98148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-839dc6ed-e0cc-470a-b14b-c71502c06b20 -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-839dc6ed-e0cc-470a-b14b-c71502c06b20.fa9d0aa3-0ccc-4db4-b624-378269514519 Nov 02 10:12:51 devstack sudo[98148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:51 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-12b4e070-6ea3-4d09-9563-8cafffadd123 tempest-VolumesActionsTest-1577301131 None] Acquiring lock "cinder-ce1ccdf8-2ef8-469a-8a7d-862b00223a49-detach_volume" by "detach_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:12:51 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-12b4e070-6ea3-4d09-9563-8cafffadd123 tempest-VolumesActionsTest-1577301131 None] Lock "cinder-ce1ccdf8-2ef8-469a-8a7d-862b00223a49-detach_volume" acquired by "detach_volume" :: waited 0.035s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:12:51 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-12b4e070-6ea3-4d09-9563-8cafffadd123 tempest-VolumesActionsTest-1577301131 None] Detaching volume ce1ccdf8-2ef8-469a-8a7d-862b00223a49 from instance b3594516-d471-4c7e-90de-930f20d59b61. Nov 02 10:12:51 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-12b4e070-6ea3-4d09-9563-8cafffadd123 tempest-VolumesActionsTest-1577301131 None] Detach volume completed successfully. Nov 02 10:12:51 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-12b4e070-6ea3-4d09-9563-8cafffadd123 tempest-VolumesActionsTest-1577301131 None] Lock "cinder-ce1ccdf8-2ef8-469a-8a7d-862b00223a49-detach_volume" released by "detach_volume" :: held 0.143s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:12:52 devstack sudo[98148]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:52 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-41deef9c-f5b2-4550-8d03-9699a82cadef tempest-GroupSnapshotsTest-1082888639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-839dc6ed-e0cc-470a-b14b-c71502c06b20 -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-839dc6ed-e0cc-470a-b14b-c71502c06b20.fa9d0aa3-0ccc-4db4-b624-378269514519" returned: 0 in 0.918s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:52 devstack cinder-volume[86890]: WARNING cinder.volume.drivers.remotefs [None req-41deef9c-f5b2-4550-8d03-9699a82cadef tempest-GroupSnapshotsTest-1082888639 None] /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-839dc6ed-e0cc-470a-b14b-c71502c06b20.fa9d0aa3-0ccc-4db4-b624-378269514519 is being set with open permissions: ugo+rw: NotImplementedError Nov 02 10:12:52 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-41deef9c-f5b2-4550-8d03-9699a82cadef tempest-GroupSnapshotsTest-1082888639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-839dc6ed-e0cc-470a-b14b-c71502c06b20.fa9d0aa3-0ccc-4db4-b624-378269514519 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:52 devstack sudo[98155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-839dc6ed-e0cc-470a-b14b-c71502c06b20.fa9d0aa3-0ccc-4db4-b624-378269514519 Nov 02 10:12:52 devstack sudo[98155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:52 devstack sudo[98155]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:52 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-41deef9c-f5b2-4550-8d03-9699a82cadef tempest-GroupSnapshotsTest-1082888639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-839dc6ed-e0cc-470a-b14b-c71502c06b20.fa9d0aa3-0ccc-4db4-b624-378269514519" returned: 0 in 0.445s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:52 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-41deef9c-f5b2-4550-8d03-9699a82cadef tempest-GroupSnapshotsTest-1082888639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-839dc6ed-e0cc-470a-b14b-c71502c06b20.info {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:52 devstack sudo[98177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-839dc6ed-e0cc-470a-b14b-c71502c06b20.info Nov 02 10:12:52 devstack sudo[98177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:53 devstack sudo[98177]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:53 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-41deef9c-f5b2-4550-8d03-9699a82cadef tempest-GroupSnapshotsTest-1082888639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-839dc6ed-e0cc-470a-b14b-c71502c06b20.info" returned: 0 in 0.392s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:53 devstack cinder-volume[86890]: WARNING cinder.volume.drivers.remotefs [None req-41deef9c-f5b2-4550-8d03-9699a82cadef tempest-GroupSnapshotsTest-1082888639 None] /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-839dc6ed-e0cc-470a-b14b-c71502c06b20.info is being set with open permissions: ugo+rw: NotImplementedError Nov 02 10:12:53 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-41deef9c-f5b2-4550-8d03-9699a82cadef tempest-GroupSnapshotsTest-1082888639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-839dc6ed-e0cc-470a-b14b-c71502c06b20.info {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:53 devstack sudo[98180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-839dc6ed-e0cc-470a-b14b-c71502c06b20.info Nov 02 10:12:53 devstack sudo[98180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:53 devstack sudo[98180]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:53 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-41deef9c-f5b2-4550-8d03-9699a82cadef tempest-GroupSnapshotsTest-1082888639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-839dc6ed-e0cc-470a-b14b-c71502c06b20.info" returned: 0 in 0.311s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:53 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-41deef9c-f5b2-4550-8d03-9699a82cadef tempest-GroupSnapshotsTest-1082888639 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.633s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:12:53 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-41deef9c-f5b2-4550-8d03-9699a82cadef tempest-GroupSnapshotsTest-1082888639 None] group_snapshot dd2b0505-2927-4dea-a0f6-de1076f890b2: created successfully Nov 02 10:12:54 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-b17324fc-e629-419f-a371-8aad4d289e84 tempest-GroupSnapshotsTest-1082888639 None] group_snapshot dd2b0505-2927-4dea-a0f6-de1076f890b2: deleting Nov 02 10:12:54 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-b17324fc-e629-419f-a371-8aad4d289e84 tempest-GroupSnapshotsTest-1082888639 None] group_snapshot dd2b0505-2927-4dea-a0f6-de1076f890b2: deleting {{(pid=86890) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 02 10:12:54 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-b17324fc-e629-419f-a371-8aad4d289e84 tempest-GroupSnapshotsTest-1082888639 None] Acquiring lock "cinder-quobyte-839dc6ed-e0cc-470a-b14b-c71502c06b20" by "delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:12:54 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-b17324fc-e629-419f-a371-8aad4d289e84 tempest-GroupSnapshotsTest-1082888639 None] Lock "cinder-quobyte-839dc6ed-e0cc-470a-b14b-c71502c06b20" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:12:54 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-b17324fc-e629-419f-a371-8aad4d289e84 tempest-GroupSnapshotsTest-1082888639 None] Acquiring lock "cinder-quobyte-fa9d0aa3-0ccc-4db4-b624-378269514519" by "_delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:12:54 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-b17324fc-e629-419f-a371-8aad4d289e84 tempest-GroupSnapshotsTest-1082888639 None] Lock "cinder-quobyte-fa9d0aa3-0ccc-4db4-b624-378269514519" acquired by "_delete_snapshot" :: waited 0.056s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:12:54 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-b17324fc-e629-419f-a371-8aad4d289e84 tempest-GroupSnapshotsTest-1082888639 None] Deleting offline snapshot fa9d0aa3-0ccc-4db4-b624-378269514519 of volume 839dc6ed-e0cc-470a-b14b-c71502c06b20 {{(pid=86890) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:12:54 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-b17324fc-e629-419f-a371-8aad4d289e84 tempest-GroupSnapshotsTest-1082888639 None] snapshot_file for this snap is: volume-839dc6ed-e0cc-470a-b14b-c71502c06b20.fa9d0aa3-0ccc-4db4-b624-378269514519 {{(pid=86890) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:12:54 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[4963a1a4-bf8f-44f2-8e60-5fac78955a93]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:12:54 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-b17324fc-e629-419f-a371-8aad4d289e84 tempest-GroupSnapshotsTest-1082888639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-839dc6ed-e0cc-470a-b14b-c71502c06b20.fa9d0aa3-0ccc-4db4-b624-378269514519 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:55 devstack sudo[98186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-839dc6ed-e0cc-470a-b14b-c71502c06b20.fa9d0aa3-0ccc-4db4-b624-378269514519 Nov 02 10:12:55 devstack sudo[98186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:55 devstack sudo[98186]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:55 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-b17324fc-e629-419f-a371-8aad4d289e84 tempest-GroupSnapshotsTest-1082888639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-839dc6ed-e0cc-470a-b14b-c71502c06b20.fa9d0aa3-0ccc-4db4-b624-378269514519" returned: 0 in 0.472s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:55 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-b17324fc-e629-419f-a371-8aad4d289e84 tempest-GroupSnapshotsTest-1082888639 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-839dc6ed-e0cc-470a-b14b-c71502c06b20(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86890) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:12:55 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2802ced-49ea-44db-b07f-238d6d3bf344]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:12:55 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-b17324fc-e629-419f-a371-8aad4d289e84 tempest-GroupSnapshotsTest-1082888639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-839dc6ed-e0cc-470a-b14b-c71502c06b20 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:55 devstack sudo[98191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-839dc6ed-e0cc-470a-b14b-c71502c06b20 Nov 02 10:12:55 devstack sudo[98191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:55 devstack sudo[98191]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:55 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-b17324fc-e629-419f-a371-8aad4d289e84 tempest-GroupSnapshotsTest-1082888639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-839dc6ed-e0cc-470a-b14b-c71502c06b20" returned: 0 in 0.456s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:55 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-b17324fc-e629-419f-a371-8aad4d289e84 tempest-GroupSnapshotsTest-1082888639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-839dc6ed-e0cc-470a-b14b-c71502c06b20.fa9d0aa3-0ccc-4db4-b624-378269514519 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:55 devstack sudo[98196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-839dc6ed-e0cc-470a-b14b-c71502c06b20.fa9d0aa3-0ccc-4db4-b624-378269514519 Nov 02 10:12:55 devstack sudo[98196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:56 devstack sudo[98196]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:56 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-b17324fc-e629-419f-a371-8aad4d289e84 tempest-GroupSnapshotsTest-1082888639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-839dc6ed-e0cc-470a-b14b-c71502c06b20.fa9d0aa3-0ccc-4db4-b624-378269514519" returned: 0 in 0.507s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:56 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-b17324fc-e629-419f-a371-8aad4d289e84 tempest-GroupSnapshotsTest-1082888639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-839dc6ed-e0cc-470a-b14b-c71502c06b20.fa9d0aa3-0ccc-4db4-b624-378269514519 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:56 devstack sudo[98201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-839dc6ed-e0cc-470a-b14b-c71502c06b20.fa9d0aa3-0ccc-4db4-b624-378269514519 Nov 02 10:12:56 devstack sudo[98201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:56 devstack sudo[98201]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:56 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-b17324fc-e629-419f-a371-8aad4d289e84 tempest-GroupSnapshotsTest-1082888639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-839dc6ed-e0cc-470a-b14b-c71502c06b20.fa9d0aa3-0ccc-4db4-b624-378269514519" returned: 0 in 0.387s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:56 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-b17324fc-e629-419f-a371-8aad4d289e84 tempest-GroupSnapshotsTest-1082888639 None] Lock "cinder-quobyte-fa9d0aa3-0ccc-4db4-b624-378269514519" released by "_delete_snapshot" :: held 2.055s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:12:56 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-b17324fc-e629-419f-a371-8aad4d289e84 tempest-GroupSnapshotsTest-1082888639 None] Lock "cinder-quobyte-839dc6ed-e0cc-470a-b14b-c71502c06b20" released by "delete_snapshot" :: held 2.125s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:12:56 devstack cinder-volume[86890]: WARNING cinder.quota [None req-b17324fc-e629-419f-a371-8aad4d289e84 tempest-GroupSnapshotsTest-1082888639 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1491416730 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1491416730, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:12:56 devstack cinder-volume[86890]: WARNING cinder.quota [None req-b17324fc-e629-419f-a371-8aad4d289e84 tempest-GroupSnapshotsTest-1082888639 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1491416730 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1491416730, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:12:56 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-b17324fc-e629-419f-a371-8aad4d289e84 tempest-GroupSnapshotsTest-1082888639 None] Created reservations ['8f593198-78eb-48da-bfd7-1c31b0229955', '2b095e41-62a3-4fbc-895f-365b0b87a0b2', '7b5678ba-bb99-492c-a1a1-14f7ed1f597b', 'ef383bcb-2f76-474a-9d5e-fffef7456c09'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:12:57 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-b17324fc-e629-419f-a371-8aad4d289e84 tempest-GroupSnapshotsTest-1082888639 None] group_snapshot dd2b0505-2927-4dea-a0f6-de1076f890b2: deleted successfully Nov 02 10:12:58 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-b514c72b-c0f2-4a57-85e4-ec79d45318f5 tempest-GroupSnapshotsTest-1082888639 None] Acquiring lock "cinder-quobyte-839dc6ed-e0cc-470a-b14b-c71502c06b20" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:12:58 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-b514c72b-c0f2-4a57-85e4-ec79d45318f5 tempest-GroupSnapshotsTest-1082888639 None] Lock "cinder-quobyte-839dc6ed-e0cc-470a-b14b-c71502c06b20" acquired by "delete_volume" :: waited 0.046s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:12:58 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[f57dbb7a-054c-485f-b9fe-34536dc43ef9]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:12:58 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-b514c72b-c0f2-4a57-85e4-ec79d45318f5 tempest-GroupSnapshotsTest-1082888639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-839dc6ed-e0cc-470a-b14b-c71502c06b20 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:59 devstack sudo[98210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-839dc6ed-e0cc-470a-b14b-c71502c06b20 Nov 02 10:12:59 devstack sudo[98210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:59 devstack sudo[98210]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:59 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-b514c72b-c0f2-4a57-85e4-ec79d45318f5 tempest-GroupSnapshotsTest-1082888639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-839dc6ed-e0cc-470a-b14b-c71502c06b20" returned: 0 in 0.654s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:59 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-b514c72b-c0f2-4a57-85e4-ec79d45318f5 tempest-GroupSnapshotsTest-1082888639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-839dc6ed-e0cc-470a-b14b-c71502c06b20 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:59 devstack sudo[98225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-839dc6ed-e0cc-470a-b14b-c71502c06b20 Nov 02 10:12:59 devstack sudo[98225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:59 devstack sudo[98225]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:00 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-b514c72b-c0f2-4a57-85e4-ec79d45318f5 tempest-GroupSnapshotsTest-1082888639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-839dc6ed-e0cc-470a-b14b-c71502c06b20" returned: 0 in 0.498s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:00 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-b514c72b-c0f2-4a57-85e4-ec79d45318f5 tempest-GroupSnapshotsTest-1082888639 None] Lock "cinder-quobyte-839dc6ed-e0cc-470a-b14b-c71502c06b20" released by "delete_volume" :: held 1.291s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:13:00 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-b514c72b-c0f2-4a57-85e4-ec79d45318f5 tempest-GroupSnapshotsTest-1082888639 None] Created reservations ['57c621a1-f778-4b39-9c2e-c585b8f264f1'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:13:00 devstack cinder-volume[86890]: WARNING cinder.quota [None req-b514c72b-c0f2-4a57-85e4-ec79d45318f5 tempest-GroupSnapshotsTest-1082888639 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1491416730 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1491416730, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:13:00 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-b514c72b-c0f2-4a57-85e4-ec79d45318f5 tempest-GroupSnapshotsTest-1082888639 None] Created reservations ['acd1a649-5be1-471a-a547-2a1b41905b8b', '73e72c50-6101-4f63-aaab-6468b8536dbe', '209a370c-9c88-4caa-a0f6-3bc1416c65f9', '4a49e81d-5500-49cd-946d-4659b21b78b4'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:13:00 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-b514c72b-c0f2-4a57-85e4-ec79d45318f5 tempest-GroupSnapshotsTest-1082888639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:13:00 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-b514c72b-c0f2-4a57-85e4-ec79d45318f5 tempest-GroupSnapshotsTest-1082888639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:13:00 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-b514c72b-c0f2-4a57-85e4-ec79d45318f5 tempest-GroupSnapshotsTest-1082888639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:13:00 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-b514c72b-c0f2-4a57-85e4-ec79d45318f5 tempest-GroupSnapshotsTest-1082888639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:13:00 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-b514c72b-c0f2-4a57-85e4-ec79d45318f5 tempest-GroupSnapshotsTest-1082888639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:13:00 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-b514c72b-c0f2-4a57-85e4-ec79d45318f5 tempest-GroupSnapshotsTest-1082888639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:00 devstack sudo[98230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:13:00 devstack sudo[98230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:00 devstack sudo[98230]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:00 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-b514c72b-c0f2-4a57-85e4-ec79d45318f5 tempest-GroupSnapshotsTest-1082888639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.320s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:00 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-b514c72b-c0f2-4a57-85e4-ec79d45318f5 tempest-GroupSnapshotsTest-1082888639 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:13:00 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-b514c72b-c0f2-4a57-85e4-ec79d45318f5 tempest-GroupSnapshotsTest-1082888639 None] Delete group completed successfully. Nov 02 10:13:10 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-f0a8989c-8a77-440a-ace8-0da841f1d91b tempest-VolumesActionsTest-1577301131 None] Acquiring lock "cinder-ce1ccdf8-2ef8-469a-8a7d-862b00223a49" by "attach_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:13:10 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-f0a8989c-8a77-440a-ace8-0da841f1d91b tempest-VolumesActionsTest-1577301131 None] Lock "cinder-ce1ccdf8-2ef8-469a-8a7d-862b00223a49" acquired by "attach_volume" :: waited 0.020s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:13:10 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-f0a8989c-8a77-440a-ace8-0da841f1d91b tempest-VolumesActionsTest-1577301131 None] Attaching volume ce1ccdf8-2ef8-469a-8a7d-862b00223a49 to instance 145fc1e2-7bef-4df5-a0a4-693dfde3cecd at mountpoint /dev/vdb on host None. Nov 02 10:13:10 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-f0a8989c-8a77-440a-ace8-0da841f1d91b tempest-VolumesActionsTest-1577301131 None] Attach volume completed successfully. Nov 02 10:13:10 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-f0a8989c-8a77-440a-ace8-0da841f1d91b tempest-VolumesActionsTest-1577301131 None] Lock "cinder-ce1ccdf8-2ef8-469a-8a7d-862b00223a49" released by "attach_volume" :: held 0.224s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:13:11 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-8e6b9fd4-b125-4492-aa30-4c23b3e36d05 tempest-VolumesActionsTest-1577301131 None] Acquiring lock "cinder-ce1ccdf8-2ef8-469a-8a7d-862b00223a49-detach_volume" by "detach_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:13:11 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-8e6b9fd4-b125-4492-aa30-4c23b3e36d05 tempest-VolumesActionsTest-1577301131 None] Lock "cinder-ce1ccdf8-2ef8-469a-8a7d-862b00223a49-detach_volume" acquired by "detach_volume" :: waited 0.044s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:13:11 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-8e6b9fd4-b125-4492-aa30-4c23b3e36d05 tempest-VolumesActionsTest-1577301131 None] Detaching volume ce1ccdf8-2ef8-469a-8a7d-862b00223a49 from instance 145fc1e2-7bef-4df5-a0a4-693dfde3cecd. Nov 02 10:13:11 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb855446-138d-402c-9d51-6ac854037e61 tempest-TestImageHashVerification-1311691549 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:13:11 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-fb855446-138d-402c-9d51-6ac854037e61 tempest-TestImageHashVerification-1311691549 None] Flow 'volume_create_manager' (ad5def26-5133-4c50-a3ab-ecb8c2c88c73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:13:11 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-fb855446-138d-402c-9d51-6ac854037e61 tempest-TestImageHashVerification-1311691549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c77434a-3c20-4da5-baad-98ee4effa63a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:13:11 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-8e6b9fd4-b125-4492-aa30-4c23b3e36d05 tempest-VolumesActionsTest-1577301131 None] Detach volume completed successfully. Nov 02 10:13:11 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-fb855446-138d-402c-9d51-6ac854037e61 tempest-TestImageHashVerification-1311691549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c77434a-3c20-4da5-baad-98ee4effa63a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:13:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1749650167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fa506b9-7991-40a6-ae32-d1f9b9043630,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d8bfa306f114ba8853693e6f6dd6cc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:13:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:13:11Z,use_quota=True,user_id='7a919b98a5e24cac8cca4cf99445f334',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:13:11 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-fb855446-138d-402c-9d51-6ac854037e61 tempest-TestImageHashVerification-1311691549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75051614-3199-44b6-a7b2-ad09a22425e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:13:11 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-fb855446-138d-402c-9d51-6ac854037e61 tempest-TestImageHashVerification-1311691549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75051614-3199-44b6-a7b2-ad09a22425e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:13:11 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-fb855446-138d-402c-9d51-6ac854037e61 tempest-TestImageHashVerification-1311691549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5159eaf-fb94-438c-af4a-c3a9c048af2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:13:11 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-fb855446-138d-402c-9d51-6ac854037e61 tempest-TestImageHashVerification-1311691549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5159eaf-fb94-438c-af4a-c3a9c048af2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3fa506b9-7991-40a6-ae32-d1f9b9043630', 'volume_name': 'volume-3fa506b9-7991-40a6-ae32-d1f9b9043630', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:13:11 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-fb855446-138d-402c-9d51-6ac854037e61 tempest-TestImageHashVerification-1311691549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b9d1de2-78d7-4fc8-8633-00e085540c80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:13:11 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-fb855446-138d-402c-9d51-6ac854037e61 tempest-TestImageHashVerification-1311691549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b9d1de2-78d7-4fc8-8633-00e085540c80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:13:11 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-fb855446-138d-402c-9d51-6ac854037e61 tempest-TestImageHashVerification-1311691549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e5df1e0-e8aa-42c0-a96a-a773ea85b766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:13:11 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-fb855446-138d-402c-9d51-6ac854037e61 tempest-TestImageHashVerification-1311691549 None] Volume 3fa506b9-7991-40a6-ae32-d1f9b9043630: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3fa506b9-7991-40a6-ae32-d1f9b9043630', 'volume_size': 1} Nov 02 10:13:11 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-fb855446-138d-402c-9d51-6ac854037e61 tempest-TestImageHashVerification-1311691549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:13:11 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-fb855446-138d-402c-9d51-6ac854037e61 tempest-TestImageHashVerification-1311691549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:13:11 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-fb855446-138d-402c-9d51-6ac854037e61 tempest-TestImageHashVerification-1311691549 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:13:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1749650167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fa506b9-7991-40a6-ae32-d1f9b9043630,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d8bfa306f114ba8853693e6f6dd6cc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:13:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:13:11Z,use_quota=True,user_id='7a919b98a5e24cac8cca4cf99445f334',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:13:11 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-fb855446-138d-402c-9d51-6ac854037e61 tempest-TestImageHashVerification-1311691549 None] Creating volume 3fa506b9-7991-40a6-ae32-d1f9b9043630 {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:13:11 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-fb855446-138d-402c-9d51-6ac854037e61 tempest-TestImageHashVerification-1311691549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:13:11 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-fb855446-138d-402c-9d51-6ac854037e61 tempest-TestImageHashVerification-1311691549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:13:11 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-fb855446-138d-402c-9d51-6ac854037e61 tempest-TestImageHashVerification-1311691549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:13:11 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-fb855446-138d-402c-9d51-6ac854037e61 tempest-TestImageHashVerification-1311691549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:13:11 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-fb855446-138d-402c-9d51-6ac854037e61 tempest-TestImageHashVerification-1311691549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:13:11 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-fb855446-138d-402c-9d51-6ac854037e61 tempest-TestImageHashVerification-1311691549 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:13:11 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-fb855446-138d-402c-9d51-6ac854037e61 tempest-TestImageHashVerification-1311691549 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:13:11 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-fb855446-138d-402c-9d51-6ac854037e61 tempest-TestImageHashVerification-1311691549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3fa506b9-7991-40a6-ae32-d1f9b9043630 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:11 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-8e6b9fd4-b125-4492-aa30-4c23b3e36d05 tempest-VolumesActionsTest-1577301131 None] Lock "cinder-ce1ccdf8-2ef8-469a-8a7d-862b00223a49-detach_volume" released by "detach_volume" :: held 0.266s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:13:11 devstack sudo[98305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3fa506b9-7991-40a6-ae32-d1f9b9043630 1073741824 Nov 02 10:13:11 devstack sudo[98305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:12 devstack sudo[98305]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:12 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-fb855446-138d-402c-9d51-6ac854037e61 tempest-TestImageHashVerification-1311691549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3fa506b9-7991-40a6-ae32-d1f9b9043630 1073741824" returned: 0 in 0.726s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:12 devstack cinder-volume[86890]: DEBUG dbcounter [-] [86890] Writing DB stats cinder:UPDATE=139,cinder:SELECT=128,cinder:INSERT=27,cinder:DELETE=3 {{(pid=86890) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:13:12 devstack cinder-volume[86890]: DEBUG dbcounter [-] [86890] Writing DB stats cinder:SELECT=118,cinder:INSERT=36,cinder:UPDATE=123,cinder:DELETE=7 {{(pid=86890) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:13:12 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-fb855446-138d-402c-9d51-6ac854037e61 tempest-TestImageHashVerification-1311691549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3fa506b9-7991-40a6-ae32-d1f9b9043630 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:12 devstack sudo[98315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3fa506b9-7991-40a6-ae32-d1f9b9043630 Nov 02 10:13:12 devstack sudo[98315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:12 devstack sudo[98315]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:12 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-fb855446-138d-402c-9d51-6ac854037e61 tempest-TestImageHashVerification-1311691549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3fa506b9-7991-40a6-ae32-d1f9b9043630" returned: 0 in 0.516s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:12 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-fb855446-138d-402c-9d51-6ac854037e61 tempest-TestImageHashVerification-1311691549 None] <== create_volume: return (1339ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:13:12 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-fb855446-138d-402c-9d51-6ac854037e61 tempest-TestImageHashVerification-1311691549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.341s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:13:12 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-fb855446-138d-402c-9d51-6ac854037e61 tempest-TestImageHashVerification-1311691549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e5df1e0-e8aa-42c0-a96a-a773ea85b766) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fa506b9-7991-40a6-ae32-d1f9b9043630', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:13:12 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-fb855446-138d-402c-9d51-6ac854037e61 tempest-TestImageHashVerification-1311691549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b00378da-aefa-40c5-b2da-b93d0d7ee65e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:13:12 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-fb855446-138d-402c-9d51-6ac854037e61 tempest-TestImageHashVerification-1311691549 None] Volume volume-3fa506b9-7991-40a6-ae32-d1f9b9043630 (3fa506b9-7991-40a6-ae32-d1f9b9043630): created successfully Nov 02 10:13:12 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-fb855446-138d-402c-9d51-6ac854037e61 tempest-TestImageHashVerification-1311691549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b00378da-aefa-40c5-b2da-b93d0d7ee65e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:13:12 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-fb855446-138d-402c-9d51-6ac854037e61 tempest-TestImageHashVerification-1311691549 None] Flow 'volume_create_manager' (ad5def26-5133-4c50-a3ab-ecb8c2c88c73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:13:13 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-fb855446-138d-402c-9d51-6ac854037e61 tempest-TestImageHashVerification-1311691549 None] Created volume successfully. Nov 02 10:13:15 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-6459a58d-8eb5-428f-afee-27749bd97048 tempest-TestImageHashVerification-1311691549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:13:15 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-6459a58d-8eb5-428f-afee-27749bd97048 tempest-TestImageHashVerification-1311691549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:13:15 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[f17c18cc-ee19-43ba-9ef6-68ddc5853d52]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:13:15 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6459a58d-8eb5-428f-afee-27749bd97048 tempest-TestImageHashVerification-1311691549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3fa506b9-7991-40a6-ae32-d1f9b9043630 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:15 devstack sudo[98377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3fa506b9-7991-40a6-ae32-d1f9b9043630 Nov 02 10:13:15 devstack sudo[98377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:16 devstack sudo[98377]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:16 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6459a58d-8eb5-428f-afee-27749bd97048 tempest-TestImageHashVerification-1311691549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3fa506b9-7991-40a6-ae32-d1f9b9043630" returned: 0 in 0.492s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:16 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a682962-420e-45f9-805b-030daf506d3a]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:13:16 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6459a58d-8eb5-428f-afee-27749bd97048 tempest-TestImageHashVerification-1311691549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3fa506b9-7991-40a6-ae32-d1f9b9043630 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:16 devstack sudo[98385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3fa506b9-7991-40a6-ae32-d1f9b9043630 Nov 02 10:13:16 devstack sudo[98385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:16 devstack sudo[98385]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:16 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6459a58d-8eb5-428f-afee-27749bd97048 tempest-TestImageHashVerification-1311691549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3fa506b9-7991-40a6-ae32-d1f9b9043630" returned: 0 in 0.438s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:16 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6459a58d-8eb5-428f-afee-27749bd97048 tempest-TestImageHashVerification-1311691549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3fa506b9-7991-40a6-ae32-d1f9b9043630 /opt/stack/data/cinder/conversion/3fa506b9-7991-40a6-ae32-d1f9b9043630.temp_image.09015471-8b8e-47d4-b665-c1f939258beebx03m8ob.img {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:16 devstack sudo[98392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3fa506b9-7991-40a6-ae32-d1f9b9043630 /opt/stack/data/cinder/conversion/3fa506b9-7991-40a6-ae32-d1f9b9043630.temp_image.09015471-8b8e-47d4-b665-c1f939258beebx03m8ob.img Nov 02 10:13:16 devstack sudo[98392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:19 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-9a5e6dcb-00c1-436a-a3d7-c8dda981c36a tempest-VolumesActionsTest-1577301131 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:13:24 devstack sudo[98392]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:24 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6459a58d-8eb5-428f-afee-27749bd97048 tempest-TestImageHashVerification-1311691549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3fa506b9-7991-40a6-ae32-d1f9b9043630 /opt/stack/data/cinder/conversion/3fa506b9-7991-40a6-ae32-d1f9b9043630.temp_image.09015471-8b8e-47d4-b665-c1f939258beebx03m8ob.img" returned: 0 in 8.160s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:24 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea579c56-71b6-416b-b899-eea98e3f8612]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:13:24 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6459a58d-8eb5-428f-afee-27749bd97048 tempest-TestImageHashVerification-1311691549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3fa506b9-7991-40a6-ae32-d1f9b9043630 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:25 devstack sudo[98408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3fa506b9-7991-40a6-ae32-d1f9b9043630 Nov 02 10:13:25 devstack sudo[98408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:25 devstack sudo[98408]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:25 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6459a58d-8eb5-428f-afee-27749bd97048 tempest-TestImageHashVerification-1311691549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3fa506b9-7991-40a6-ae32-d1f9b9043630" returned: 0 in 0.564s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:25 devstack cinder-volume[86890]: DEBUG cinder.image.image_utils [None req-6459a58d-8eb5-428f-afee-27749bd97048 tempest-TestImageHashVerification-1311691549 None] Image conversion details: src /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3fa506b9-7991-40a6-ae32-d1f9b9043630, size 1024.00 MB, duration 8.16 sec, destination /opt/stack/data/cinder/conversion/3fa506b9-7991-40a6-ae32-d1f9b9043630.temp_image.09015471-8b8e-47d4-b665-c1f939258beebx03m8ob.img {{(pid=86890) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 10:13:25 devstack cinder-volume[86890]: INFO cinder.image.image_utils [None req-6459a58d-8eb5-428f-afee-27749bd97048 tempest-TestImageHashVerification-1311691549 None] Converted 1024.00 MB image at 125.47 MB/s Nov 02 10:13:25 devstack cinder-volume[86890]: DEBUG cinder.image.image_utils [None req-6459a58d-8eb5-428f-afee-27749bd97048 tempest-TestImageHashVerification-1311691549 None] 09015471-8b8e-47d4-b665-c1f939258bee was raw, no need to convert to raw {{(pid=86890) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Nov 02 10:13:25 devstack cinder-volume[86890]: DEBUG dbcounter [-] [86890] Writing DB stats cinder:UPDATE=1,cinder:DELETE=1,cinder:SELECT=1 {{(pid=86890) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:13:28 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-eaaa1621-a808-4248-b5f2-20e4c40163bb tempest-VolumeQuotasNegativeTestJSON-534752640 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:13:28 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-eaaa1621-a808-4248-b5f2-20e4c40163bb tempest-VolumeQuotasNegativeTestJSON-534752640 None] Flow 'volume_create_manager' (5cdbe17b-2815-44b9-ace5-8059bb707b18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:13:28 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-eaaa1621-a808-4248-b5f2-20e4c40163bb tempest-VolumeQuotasNegativeTestJSON-534752640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84ac673a-bd70-4900-9b87-c2f285a14454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:13:28 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-eaaa1621-a808-4248-b5f2-20e4c40163bb tempest-VolumeQuotasNegativeTestJSON-534752640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84ac673a-bd70-4900-9b87-c2f285a14454) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:13:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-665888697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=162cd9e1-904f-4d3e-8bc1-c0754497d251,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecb7d924205f413d9860de6971cf510c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:13:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:13:29Z,use_quota=True,user_id='8cb12a80018d428c8a9ba295cd7eec66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:13:28 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-eaaa1621-a808-4248-b5f2-20e4c40163bb tempest-VolumeQuotasNegativeTestJSON-534752640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (affa8224-e741-41f4-92c4-995cf1b8c0bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:13:29 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-eaaa1621-a808-4248-b5f2-20e4c40163bb tempest-VolumeQuotasNegativeTestJSON-534752640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (affa8224-e741-41f4-92c4-995cf1b8c0bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:13:29 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-eaaa1621-a808-4248-b5f2-20e4c40163bb tempest-VolumeQuotasNegativeTestJSON-534752640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3f16ede-07e2-44d2-b0a7-185cc0f36c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:13:29 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-eaaa1621-a808-4248-b5f2-20e4c40163bb tempest-VolumeQuotasNegativeTestJSON-534752640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3f16ede-07e2-44d2-b0a7-185cc0f36c34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '162cd9e1-904f-4d3e-8bc1-c0754497d251', 'volume_name': 'volume-162cd9e1-904f-4d3e-8bc1-c0754497d251', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:13:29 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-eaaa1621-a808-4248-b5f2-20e4c40163bb tempest-VolumeQuotasNegativeTestJSON-534752640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50e764c8-4b35-40ee-9153-538e235194c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:13:29 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-eaaa1621-a808-4248-b5f2-20e4c40163bb tempest-VolumeQuotasNegativeTestJSON-534752640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50e764c8-4b35-40ee-9153-538e235194c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:13:29 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-eaaa1621-a808-4248-b5f2-20e4c40163bb tempest-VolumeQuotasNegativeTestJSON-534752640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9182c65b-b6d0-421e-9da6-0e8e1985f674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:13:29 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-eaaa1621-a808-4248-b5f2-20e4c40163bb tempest-VolumeQuotasNegativeTestJSON-534752640 None] Volume 162cd9e1-904f-4d3e-8bc1-c0754497d251: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-162cd9e1-904f-4d3e-8bc1-c0754497d251', 'volume_size': 1} Nov 02 10:13:29 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-eaaa1621-a808-4248-b5f2-20e4c40163bb tempest-VolumeQuotasNegativeTestJSON-534752640 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:13:32 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5c04f6f-a3ce-42f4-8cdd-2675cf4545ba tempest-AbsoluteLimitsTests-1279869627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:13:32 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-a5c04f6f-a3ce-42f4-8cdd-2675cf4545ba tempest-AbsoluteLimitsTests-1279869627 None] Flow 'volume_create_manager' (86f59290-7514-4bf3-83f1-a1a4c504f0b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:13:32 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-a5c04f6f-a3ce-42f4-8cdd-2675cf4545ba tempest-AbsoluteLimitsTests-1279869627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdef1bfb-cbce-4a14-bec2-cd88252b0839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:13:32 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-a5c04f6f-a3ce-42f4-8cdd-2675cf4545ba tempest-AbsoluteLimitsTests-1279869627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdef1bfb-cbce-4a14-bec2-cd88252b0839) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:13:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-813635399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b942e2c-a4c4-45bb-96b8-6f6bb23f9f29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46a17e33b229435db5dd83c54b8f1baa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:13:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:13:32Z,use_quota=True,user_id='9b2f6806430a4c7e9b107eef2138465d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:13:32 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-a5c04f6f-a3ce-42f4-8cdd-2675cf4545ba tempest-AbsoluteLimitsTests-1279869627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bd9469e-8408-4aec-9c11-5f2d74019f47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:13:32 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-a5c04f6f-a3ce-42f4-8cdd-2675cf4545ba tempest-AbsoluteLimitsTests-1279869627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bd9469e-8408-4aec-9c11-5f2d74019f47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:13:32 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-a5c04f6f-a3ce-42f4-8cdd-2675cf4545ba tempest-AbsoluteLimitsTests-1279869627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73ea4b92-b621-4600-99a4-526b645a21df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:13:32 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-a5c04f6f-a3ce-42f4-8cdd-2675cf4545ba tempest-AbsoluteLimitsTests-1279869627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73ea4b92-b621-4600-99a4-526b645a21df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b942e2c-a4c4-45bb-96b8-6f6bb23f9f29', 'volume_name': 'volume-2b942e2c-a4c4-45bb-96b8-6f6bb23f9f29', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:13:32 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-a5c04f6f-a3ce-42f4-8cdd-2675cf4545ba tempest-AbsoluteLimitsTests-1279869627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bdd8a52-15bc-4c97-9eaf-be3e19cdf9c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:13:32 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-a5c04f6f-a3ce-42f4-8cdd-2675cf4545ba tempest-AbsoluteLimitsTests-1279869627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bdd8a52-15bc-4c97-9eaf-be3e19cdf9c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:13:32 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-a5c04f6f-a3ce-42f4-8cdd-2675cf4545ba tempest-AbsoluteLimitsTests-1279869627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c020b6a-d5ae-43e6-b81d-2bb9e6095423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:13:32 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-a5c04f6f-a3ce-42f4-8cdd-2675cf4545ba tempest-AbsoluteLimitsTests-1279869627 None] Volume 2b942e2c-a4c4-45bb-96b8-6f6bb23f9f29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b942e2c-a4c4-45bb-96b8-6f6bb23f9f29', 'volume_size': 1} Nov 02 10:13:32 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-a5c04f6f-a3ce-42f4-8cdd-2675cf4545ba tempest-AbsoluteLimitsTests-1279869627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:13:34 devstack cinder-volume[86890]: DEBUG oslo_service.periodic_task [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86890) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:13:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:13:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:13:34 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:13:34 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:13:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:13:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:34 devstack sudo[98415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:13:34 devstack sudo[98415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:35 devstack sudo[98415]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:35 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.280s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:35 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:13:35 devstack cinder-volume[86890]: DEBUG oslo_service.periodic_task [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Running periodic task VolumeManager._thread_info {{(pid=86890) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:13:35 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] thread count: 29 {{(pid=86890) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:13:35 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] thread info: [<_MainThread(MainThread, started 133913319395456)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86890) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:13:42 devstack cinder-volume[86890]: DEBUG dbcounter [-] [86890] Writing DB stats cinder:SELECT=5,cinder:INSERT=1,cinder:UPDATE=5 {{(pid=86890) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:13:42 devstack cinder-volume[86890]: DEBUG dbcounter [-] [86890] Writing DB stats cinder:SELECT=3 {{(pid=86890) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:13:46 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-6459a58d-8eb5-428f-afee-27749bd97048 tempest-TestImageHashVerification-1311691549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 30.671s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:13:46 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-6459a58d-8eb5-428f-afee-27749bd97048 tempest-TestImageHashVerification-1311691549 None] Uploaded volume to glance image-id: 09015471-8b8e-47d4-b665-c1f939258bee. {{(pid=86890) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 02 10:13:46 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-9a5e6dcb-00c1-436a-a3d7-c8dda981c36a tempest-VolumesActionsTest-1577301131 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 27.002s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:13:46 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c5cabd8-2a92-49e7-8c5b-40c61cf0cfa6]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:13:46 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-9a5e6dcb-00c1-436a-a3d7-c8dda981c36a tempest-VolumesActionsTest-1577301131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ce1ccdf8-2ef8-469a-8a7d-862b00223a49 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:46 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-6459a58d-8eb5-428f-afee-27749bd97048 tempest-TestImageHashVerification-1311691549 None] Copy volume to image completed successfully. Nov 02 10:13:46 devstack sudo[98419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ce1ccdf8-2ef8-469a-8a7d-862b00223a49 Nov 02 10:13:46 devstack sudo[98419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:46 devstack sudo[98419]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:46 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-9a5e6dcb-00c1-436a-a3d7-c8dda981c36a tempest-VolumesActionsTest-1577301131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ce1ccdf8-2ef8-469a-8a7d-862b00223a49" returned: 0 in 0.394s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:46 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[045c7e99-9a3a-47ed-a3a6-5e89032926d9]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:13:46 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-9a5e6dcb-00c1-436a-a3d7-c8dda981c36a tempest-VolumesActionsTest-1577301131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ce1ccdf8-2ef8-469a-8a7d-862b00223a49 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:46 devstack sudo[98424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ce1ccdf8-2ef8-469a-8a7d-862b00223a49 Nov 02 10:13:46 devstack sudo[98424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:47 devstack sudo[98424]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:47 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-9a5e6dcb-00c1-436a-a3d7-c8dda981c36a tempest-VolumesActionsTest-1577301131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ce1ccdf8-2ef8-469a-8a7d-862b00223a49" returned: 0 in 0.396s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:47 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-9a5e6dcb-00c1-436a-a3d7-c8dda981c36a tempest-VolumesActionsTest-1577301131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ce1ccdf8-2ef8-469a-8a7d-862b00223a49 /opt/stack/data/cinder/conversion/ce1ccdf8-2ef8-469a-8a7d-862b00223a49.temp_image.de1fb585-1eef-4b4f-a256-8d2c573675c93y29yhof.img {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:47 devstack sudo[98429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ce1ccdf8-2ef8-469a-8a7d-862b00223a49 /opt/stack/data/cinder/conversion/ce1ccdf8-2ef8-469a-8a7d-862b00223a49.temp_image.de1fb585-1eef-4b4f-a256-8d2c573675c93y29yhof.img Nov 02 10:13:47 devstack sudo[98429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:48 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-f83e903b-3264-42f9-be5a-3cde1470f3a8 tempest-TestImageHashVerification-1311691549 None] Acquiring lock "cinder-3fa506b9-7991-40a6-ae32-d1f9b9043630-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:13:48 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-f83e903b-3264-42f9-be5a-3cde1470f3a8 tempest-TestImageHashVerification-1311691549 None] Lock "cinder-3fa506b9-7991-40a6-ae32-d1f9b9043630-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:13:48 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-f83e903b-3264-42f9-be5a-3cde1470f3a8 tempest-TestImageHashVerification-1311691549 None] Acquiring lock "cinder-quobyte-3fa506b9-7991-40a6-ae32-d1f9b9043630" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:13:48 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-f83e903b-3264-42f9-be5a-3cde1470f3a8 tempest-TestImageHashVerification-1311691549 None] Lock "cinder-quobyte-3fa506b9-7991-40a6-ae32-d1f9b9043630" acquired by "delete_volume" :: waited 0.036s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:13:48 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd69a7c8-a049-45f9-8b74-288f6f02d4a4]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:13:48 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-f83e903b-3264-42f9-be5a-3cde1470f3a8 tempest-TestImageHashVerification-1311691549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3fa506b9-7991-40a6-ae32-d1f9b9043630 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:48 devstack sudo[98441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3fa506b9-7991-40a6-ae32-d1f9b9043630 Nov 02 10:13:48 devstack sudo[98441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:49 devstack sudo[98441]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:49 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-f83e903b-3264-42f9-be5a-3cde1470f3a8 tempest-TestImageHashVerification-1311691549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3fa506b9-7991-40a6-ae32-d1f9b9043630" returned: 0 in 0.685s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:49 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-f83e903b-3264-42f9-be5a-3cde1470f3a8 tempest-TestImageHashVerification-1311691549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3fa506b9-7991-40a6-ae32-d1f9b9043630 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:49 devstack sudo[98446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3fa506b9-7991-40a6-ae32-d1f9b9043630 Nov 02 10:13:49 devstack sudo[98446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:49 devstack sudo[98446]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:49 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-f83e903b-3264-42f9-be5a-3cde1470f3a8 tempest-TestImageHashVerification-1311691549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3fa506b9-7991-40a6-ae32-d1f9b9043630" returned: 0 in 0.473s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:49 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-f83e903b-3264-42f9-be5a-3cde1470f3a8 tempest-TestImageHashVerification-1311691549 None] Lock "cinder-quobyte-3fa506b9-7991-40a6-ae32-d1f9b9043630" released by "delete_volume" :: held 1.237s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:13:49 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-f83e903b-3264-42f9-be5a-3cde1470f3a8 tempest-TestImageHashVerification-1311691549 None] Created reservations ['1fede051-10bb-40c4-a2d5-268d986a0ea6', '9e0090dc-4681-480b-8c1a-59ffb2ff6257', '0c6f8c86-1f3c-4a7d-914b-ba02bc312904', '0ee1296e-761e-4d37-9afc-a74237941e32'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:13:49 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-f83e903b-3264-42f9-be5a-3cde1470f3a8 tempest-TestImageHashVerification-1311691549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:13:49 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-f83e903b-3264-42f9-be5a-3cde1470f3a8 tempest-TestImageHashVerification-1311691549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:13:49 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-f83e903b-3264-42f9-be5a-3cde1470f3a8 tempest-TestImageHashVerification-1311691549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:13:49 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-f83e903b-3264-42f9-be5a-3cde1470f3a8 tempest-TestImageHashVerification-1311691549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:13:49 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-f83e903b-3264-42f9-be5a-3cde1470f3a8 tempest-TestImageHashVerification-1311691549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:13:49 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-f83e903b-3264-42f9-be5a-3cde1470f3a8 tempest-TestImageHashVerification-1311691549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:49 devstack sudo[98449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:13:49 devstack sudo[98449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:50 devstack sudo[98449]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:50 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-f83e903b-3264-42f9-be5a-3cde1470f3a8 tempest-TestImageHashVerification-1311691549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.299s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:50 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-f83e903b-3264-42f9-be5a-3cde1470f3a8 tempest-TestImageHashVerification-1311691549 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:13:50 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-f83e903b-3264-42f9-be5a-3cde1470f3a8 tempest-TestImageHashVerification-1311691549 None] Deleted volume successfully. Nov 02 10:13:50 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-f83e903b-3264-42f9-be5a-3cde1470f3a8 tempest-TestImageHashVerification-1311691549 None] Lock "cinder-3fa506b9-7991-40a6-ae32-d1f9b9043630-delete_volume" released by "delete_volume" :: held 1.957s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:13:54 devstack sudo[98429]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:54 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-9a5e6dcb-00c1-436a-a3d7-c8dda981c36a tempest-VolumesActionsTest-1577301131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ce1ccdf8-2ef8-469a-8a7d-862b00223a49 /opt/stack/data/cinder/conversion/ce1ccdf8-2ef8-469a-8a7d-862b00223a49.temp_image.de1fb585-1eef-4b4f-a256-8d2c573675c93y29yhof.img" returned: 0 in 7.155s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:54 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[86c3c6e1-ddea-4c40-8093-4684f2cc10dc]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:13:54 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-9a5e6dcb-00c1-436a-a3d7-c8dda981c36a tempest-VolumesActionsTest-1577301131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ce1ccdf8-2ef8-469a-8a7d-862b00223a49 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:54 devstack sudo[98455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ce1ccdf8-2ef8-469a-8a7d-862b00223a49 Nov 02 10:13:54 devstack sudo[98455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:55 devstack sudo[98455]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:55 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-9a5e6dcb-00c1-436a-a3d7-c8dda981c36a tempest-VolumesActionsTest-1577301131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ce1ccdf8-2ef8-469a-8a7d-862b00223a49" returned: 0 in 0.613s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:55 devstack cinder-volume[86890]: DEBUG cinder.image.image_utils [None req-9a5e6dcb-00c1-436a-a3d7-c8dda981c36a tempest-VolumesActionsTest-1577301131 None] Image conversion details: src /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ce1ccdf8-2ef8-469a-8a7d-862b00223a49, size 1024.00 MB, duration 7.16 sec, destination /opt/stack/data/cinder/conversion/ce1ccdf8-2ef8-469a-8a7d-862b00223a49.temp_image.de1fb585-1eef-4b4f-a256-8d2c573675c93y29yhof.img {{(pid=86890) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 10:13:55 devstack cinder-volume[86890]: INFO cinder.image.image_utils [None req-9a5e6dcb-00c1-436a-a3d7-c8dda981c36a tempest-VolumesActionsTest-1577301131 None] Converted 1024.00 MB image at 143.08 MB/s Nov 02 10:13:55 devstack cinder-volume[86890]: DEBUG cinder.image.image_utils [None req-9a5e6dcb-00c1-436a-a3d7-c8dda981c36a tempest-VolumesActionsTest-1577301131 None] de1fb585-1eef-4b4f-a256-8d2c573675c9 was raw, no need to convert to raw {{(pid=86890) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Nov 02 10:14:00 devstack cinder-volume[86890]: DEBUG dbcounter [-] [86890] Writing DB stats cinder:UPDATE=10,cinder:SELECT=4,cinder:INSERT=2,cinder:DELETE=1 {{(pid=86890) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:14:05 devstack cinder-volume[86890]: DEBUG dbcounter [-] [86890] Writing DB stats cinder:SELECT=9,cinder:UPDATE=7,cinder:INSERT=2 {{(pid=86890) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:14:07 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-27febfb9-a92c-48ef-ac8e-c33d4d8cab1f tempest-VolumeDependencyTests-1091358234 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:14:07 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-27febfb9-a92c-48ef-ac8e-c33d4d8cab1f tempest-VolumeDependencyTests-1091358234 None] Flow 'volume_create_manager' (6c8853c6-b4be-421e-9207-a8127125a030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:14:07 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-27febfb9-a92c-48ef-ac8e-c33d4d8cab1f tempest-VolumeDependencyTests-1091358234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6443210d-9e65-4e2f-ae43-1089ee2fe5c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:14:07 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-27febfb9-a92c-48ef-ac8e-c33d4d8cab1f tempest-VolumeDependencyTests-1091358234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6443210d-9e65-4e2f-ae43-1089ee2fe5c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:14:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1412884285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25f2b8b3-0f12-47bc-88c6-f08e32b109ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='802a9e6f1bb548a0a5274c530d187dcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:14:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:14:08Z,use_quota=True,user_id='31f1592350b84948bb97b3b3c0ac723f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:14:07 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-27febfb9-a92c-48ef-ac8e-c33d4d8cab1f tempest-VolumeDependencyTests-1091358234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0ff09c9-a40e-488f-b91e-4e387d70fcff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:14:07 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-27febfb9-a92c-48ef-ac8e-c33d4d8cab1f tempest-VolumeDependencyTests-1091358234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0ff09c9-a40e-488f-b91e-4e387d70fcff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:14:07 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-27febfb9-a92c-48ef-ac8e-c33d4d8cab1f tempest-VolumeDependencyTests-1091358234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (739d1d81-11b0-4274-b8d8-3cfdaa19dad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:14:07 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-27febfb9-a92c-48ef-ac8e-c33d4d8cab1f tempest-VolumeDependencyTests-1091358234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (739d1d81-11b0-4274-b8d8-3cfdaa19dad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25f2b8b3-0f12-47bc-88c6-f08e32b109ca', 'volume_name': 'volume-25f2b8b3-0f12-47bc-88c6-f08e32b109ca', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:14:07 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-27febfb9-a92c-48ef-ac8e-c33d4d8cab1f tempest-VolumeDependencyTests-1091358234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6d971eb-3b0e-4e52-9a0c-913d4e26b368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:14:07 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-27febfb9-a92c-48ef-ac8e-c33d4d8cab1f tempest-VolumeDependencyTests-1091358234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6d971eb-3b0e-4e52-9a0c-913d4e26b368) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:14:07 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-27febfb9-a92c-48ef-ac8e-c33d4d8cab1f tempest-VolumeDependencyTests-1091358234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8aa3f115-b472-4177-af42-69cb55a054c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:14:07 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-27febfb9-a92c-48ef-ac8e-c33d4d8cab1f tempest-VolumeDependencyTests-1091358234 None] Volume 25f2b8b3-0f12-47bc-88c6-f08e32b109ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25f2b8b3-0f12-47bc-88c6-f08e32b109ca', 'volume_size': 1} Nov 02 10:14:07 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-27febfb9-a92c-48ef-ac8e-c33d4d8cab1f tempest-VolumeDependencyTests-1091358234 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:14:16 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-9a5e6dcb-00c1-436a-a3d7-c8dda981c36a tempest-VolumesActionsTest-1577301131 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 29.754s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:14:16 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-9a5e6dcb-00c1-436a-a3d7-c8dda981c36a tempest-VolumesActionsTest-1577301131 None] Uploaded volume to glance image-id: de1fb585-1eef-4b4f-a256-8d2c573675c9. {{(pid=86890) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 02 10:14:16 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-eaaa1621-a808-4248-b5f2-20e4c40163bb tempest-VolumeQuotasNegativeTestJSON-534752640 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 47.151s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:14:16 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-eaaa1621-a808-4248-b5f2-20e4c40163bb tempest-VolumeQuotasNegativeTestJSON-534752640 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:13:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-665888697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=162cd9e1-904f-4d3e-8bc1-c0754497d251,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecb7d924205f413d9860de6971cf510c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:13:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:13:29Z,use_quota=True,user_id='8cb12a80018d428c8a9ba295cd7eec66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:14:16 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-eaaa1621-a808-4248-b5f2-20e4c40163bb tempest-VolumeQuotasNegativeTestJSON-534752640 None] Creating volume 162cd9e1-904f-4d3e-8bc1-c0754497d251 {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:14:16 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-eaaa1621-a808-4248-b5f2-20e4c40163bb tempest-VolumeQuotasNegativeTestJSON-534752640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:14:16 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-eaaa1621-a808-4248-b5f2-20e4c40163bb tempest-VolumeQuotasNegativeTestJSON-534752640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:14:16 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-eaaa1621-a808-4248-b5f2-20e4c40163bb tempest-VolumeQuotasNegativeTestJSON-534752640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:14:16 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-eaaa1621-a808-4248-b5f2-20e4c40163bb tempest-VolumeQuotasNegativeTestJSON-534752640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:14:16 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-eaaa1621-a808-4248-b5f2-20e4c40163bb tempest-VolumeQuotasNegativeTestJSON-534752640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:14:16 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-eaaa1621-a808-4248-b5f2-20e4c40163bb tempest-VolumeQuotasNegativeTestJSON-534752640 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:14:16 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-eaaa1621-a808-4248-b5f2-20e4c40163bb tempest-VolumeQuotasNegativeTestJSON-534752640 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:14:16 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-eaaa1621-a808-4248-b5f2-20e4c40163bb tempest-VolumeQuotasNegativeTestJSON-534752640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-162cd9e1-904f-4d3e-8bc1-c0754497d251 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:16 devstack sudo[98510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-162cd9e1-904f-4d3e-8bc1-c0754497d251 1073741824 Nov 02 10:14:16 devstack sudo[98510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:16 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-9a5e6dcb-00c1-436a-a3d7-c8dda981c36a tempest-VolumesActionsTest-1577301131 None] Copy volume to image completed successfully. Nov 02 10:14:16 devstack sudo[98510]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:16 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-eaaa1621-a808-4248-b5f2-20e4c40163bb tempest-VolumeQuotasNegativeTestJSON-534752640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-162cd9e1-904f-4d3e-8bc1-c0754497d251 1073741824" returned: 0 in 0.440s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:16 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-eaaa1621-a808-4248-b5f2-20e4c40163bb tempest-VolumeQuotasNegativeTestJSON-534752640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-162cd9e1-904f-4d3e-8bc1-c0754497d251 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:16 devstack sudo[98518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-162cd9e1-904f-4d3e-8bc1-c0754497d251 Nov 02 10:14:16 devstack sudo[98518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:16 devstack sudo[98518]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:16 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-eaaa1621-a808-4248-b5f2-20e4c40163bb tempest-VolumeQuotasNegativeTestJSON-534752640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-162cd9e1-904f-4d3e-8bc1-c0754497d251" returned: 0 in 0.260s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:16 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-eaaa1621-a808-4248-b5f2-20e4c40163bb tempest-VolumeQuotasNegativeTestJSON-534752640 None] <== create_volume: return (740ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:14:16 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-eaaa1621-a808-4248-b5f2-20e4c40163bb tempest-VolumeQuotasNegativeTestJSON-534752640 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.743s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:14:16 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-a5c04f6f-a3ce-42f4-8cdd-2675cf4545ba tempest-AbsoluteLimitsTests-1279869627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 44.626s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:14:16 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-a5c04f6f-a3ce-42f4-8cdd-2675cf4545ba tempest-AbsoluteLimitsTests-1279869627 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:13:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-813635399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b942e2c-a4c4-45bb-96b8-6f6bb23f9f29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46a17e33b229435db5dd83c54b8f1baa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:13:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:13:32Z,use_quota=True,user_id='9b2f6806430a4c7e9b107eef2138465d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:14:16 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-a5c04f6f-a3ce-42f4-8cdd-2675cf4545ba tempest-AbsoluteLimitsTests-1279869627 None] Creating volume 2b942e2c-a4c4-45bb-96b8-6f6bb23f9f29 {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:14:16 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-a5c04f6f-a3ce-42f4-8cdd-2675cf4545ba tempest-AbsoluteLimitsTests-1279869627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:14:16 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-a5c04f6f-a3ce-42f4-8cdd-2675cf4545ba tempest-AbsoluteLimitsTests-1279869627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:14:16 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-a5c04f6f-a3ce-42f4-8cdd-2675cf4545ba tempest-AbsoluteLimitsTests-1279869627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:14:16 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-a5c04f6f-a3ce-42f4-8cdd-2675cf4545ba tempest-AbsoluteLimitsTests-1279869627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:14:16 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-a5c04f6f-a3ce-42f4-8cdd-2675cf4545ba tempest-AbsoluteLimitsTests-1279869627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:14:16 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-a5c04f6f-a3ce-42f4-8cdd-2675cf4545ba tempest-AbsoluteLimitsTests-1279869627 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:14:16 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-a5c04f6f-a3ce-42f4-8cdd-2675cf4545ba tempest-AbsoluteLimitsTests-1279869627 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:14:16 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a5c04f6f-a3ce-42f4-8cdd-2675cf4545ba tempest-AbsoluteLimitsTests-1279869627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-2b942e2c-a4c4-45bb-96b8-6f6bb23f9f29 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:16 devstack sudo[98521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-2b942e2c-a4c4-45bb-96b8-6f6bb23f9f29 1073741824 Nov 02 10:14:16 devstack sudo[98521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:16 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-eaaa1621-a808-4248-b5f2-20e4c40163bb tempest-VolumeQuotasNegativeTestJSON-534752640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9182c65b-b6d0-421e-9da6-0e8e1985f674) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-162cd9e1-904f-4d3e-8bc1-c0754497d251', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:14:16 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-eaaa1621-a808-4248-b5f2-20e4c40163bb tempest-VolumeQuotasNegativeTestJSON-534752640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3962dbe-dd5d-473e-9ae4-7016232610a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:14:16 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-eaaa1621-a808-4248-b5f2-20e4c40163bb tempest-VolumeQuotasNegativeTestJSON-534752640 None] Volume volume-162cd9e1-904f-4d3e-8bc1-c0754497d251 (162cd9e1-904f-4d3e-8bc1-c0754497d251): created successfully Nov 02 10:14:17 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-eaaa1621-a808-4248-b5f2-20e4c40163bb tempest-VolumeQuotasNegativeTestJSON-534752640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3962dbe-dd5d-473e-9ae4-7016232610a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:14:17 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-eaaa1621-a808-4248-b5f2-20e4c40163bb tempest-VolumeQuotasNegativeTestJSON-534752640 None] Flow 'volume_create_manager' (5cdbe17b-2815-44b9-ace5-8059bb707b18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:14:17 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-eaaa1621-a808-4248-b5f2-20e4c40163bb tempest-VolumeQuotasNegativeTestJSON-534752640 None] Created volume successfully. Nov 02 10:14:17 devstack sudo[98521]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:17 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a5c04f6f-a3ce-42f4-8cdd-2675cf4545ba tempest-AbsoluteLimitsTests-1279869627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-2b942e2c-a4c4-45bb-96b8-6f6bb23f9f29 1073741824" returned: 0 in 0.540s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:17 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a5c04f6f-a3ce-42f4-8cdd-2675cf4545ba tempest-AbsoluteLimitsTests-1279869627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-2b942e2c-a4c4-45bb-96b8-6f6bb23f9f29 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:17 devstack sudo[98527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-2b942e2c-a4c4-45bb-96b8-6f6bb23f9f29 Nov 02 10:14:17 devstack sudo[98527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:17 devstack sudo[98527]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:17 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a5c04f6f-a3ce-42f4-8cdd-2675cf4545ba tempest-AbsoluteLimitsTests-1279869627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-2b942e2c-a4c4-45bb-96b8-6f6bb23f9f29" returned: 0 in 0.354s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:17 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-a5c04f6f-a3ce-42f4-8cdd-2675cf4545ba tempest-AbsoluteLimitsTests-1279869627 None] <== create_volume: return (948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:14:17 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-a5c04f6f-a3ce-42f4-8cdd-2675cf4545ba tempest-AbsoluteLimitsTests-1279869627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.952s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:14:17 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-27febfb9-a92c-48ef-ac8e-c33d4d8cab1f tempest-VolumeDependencyTests-1091358234 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.896s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:14:17 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-27febfb9-a92c-48ef-ac8e-c33d4d8cab1f tempest-VolumeDependencyTests-1091358234 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:14:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1412884285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25f2b8b3-0f12-47bc-88c6-f08e32b109ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='802a9e6f1bb548a0a5274c530d187dcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:14:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:14:08Z,use_quota=True,user_id='31f1592350b84948bb97b3b3c0ac723f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:14:17 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-27febfb9-a92c-48ef-ac8e-c33d4d8cab1f tempest-VolumeDependencyTests-1091358234 None] Creating volume 25f2b8b3-0f12-47bc-88c6-f08e32b109ca {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:14:17 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-27febfb9-a92c-48ef-ac8e-c33d4d8cab1f tempest-VolumeDependencyTests-1091358234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:14:17 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-27febfb9-a92c-48ef-ac8e-c33d4d8cab1f tempest-VolumeDependencyTests-1091358234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:14:17 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-27febfb9-a92c-48ef-ac8e-c33d4d8cab1f tempest-VolumeDependencyTests-1091358234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:14:17 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-27febfb9-a92c-48ef-ac8e-c33d4d8cab1f tempest-VolumeDependencyTests-1091358234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:14:17 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-27febfb9-a92c-48ef-ac8e-c33d4d8cab1f tempest-VolumeDependencyTests-1091358234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:14:17 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-27febfb9-a92c-48ef-ac8e-c33d4d8cab1f tempest-VolumeDependencyTests-1091358234 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:14:17 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-27febfb9-a92c-48ef-ac8e-c33d4d8cab1f tempest-VolumeDependencyTests-1091358234 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:14:17 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-27febfb9-a92c-48ef-ac8e-c33d4d8cab1f tempest-VolumeDependencyTests-1091358234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-25f2b8b3-0f12-47bc-88c6-f08e32b109ca 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:17 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-a5c04f6f-a3ce-42f4-8cdd-2675cf4545ba tempest-AbsoluteLimitsTests-1279869627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c020b6a-d5ae-43e6-b81d-2bb9e6095423) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b942e2c-a4c4-45bb-96b8-6f6bb23f9f29', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:14:17 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-a5c04f6f-a3ce-42f4-8cdd-2675cf4545ba tempest-AbsoluteLimitsTests-1279869627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b381c3c-df5d-47f5-b2ea-52d84f4ca500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:14:17 devstack sudo[98530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-25f2b8b3-0f12-47bc-88c6-f08e32b109ca 1073741824 Nov 02 10:14:17 devstack sudo[98530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:17 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-a5c04f6f-a3ce-42f4-8cdd-2675cf4545ba tempest-AbsoluteLimitsTests-1279869627 None] Volume volume-2b942e2c-a4c4-45bb-96b8-6f6bb23f9f29 (2b942e2c-a4c4-45bb-96b8-6f6bb23f9f29): created successfully Nov 02 10:14:17 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-a5c04f6f-a3ce-42f4-8cdd-2675cf4545ba tempest-AbsoluteLimitsTests-1279869627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b381c3c-df5d-47f5-b2ea-52d84f4ca500) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:14:17 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-a5c04f6f-a3ce-42f4-8cdd-2675cf4545ba tempest-AbsoluteLimitsTests-1279869627 None] Flow 'volume_create_manager' (86f59290-7514-4bf3-83f1-a1a4c504f0b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:14:17 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-a5c04f6f-a3ce-42f4-8cdd-2675cf4545ba tempest-AbsoluteLimitsTests-1279869627 None] Created volume successfully. Nov 02 10:14:18 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-8d3e4a5e-011c-4fe0-856c-47e4713234f2 tempest-VolumesActionsTest-1577301131 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:14:18 devstack sudo[98530]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:18 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-27febfb9-a92c-48ef-ac8e-c33d4d8cab1f tempest-VolumeDependencyTests-1091358234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-25f2b8b3-0f12-47bc-88c6-f08e32b109ca 1073741824" returned: 0 in 0.577s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:18 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-27febfb9-a92c-48ef-ac8e-c33d4d8cab1f tempest-VolumeDependencyTests-1091358234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-25f2b8b3-0f12-47bc-88c6-f08e32b109ca {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:18 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-9d4a1d57-24cc-4a97-8ad3-6fa4a3dfaf81 tempest-AbsoluteLimitsTests-1279869627 None] Acquiring lock "cinder-2b942e2c-a4c4-45bb-96b8-6f6bb23f9f29-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:14:18 devstack sudo[98537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-25f2b8b3-0f12-47bc-88c6-f08e32b109ca Nov 02 10:14:18 devstack sudo[98537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:18 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-9d4a1d57-24cc-4a97-8ad3-6fa4a3dfaf81 tempest-AbsoluteLimitsTests-1279869627 None] Lock "cinder-2b942e2c-a4c4-45bb-96b8-6f6bb23f9f29-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:14:18 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-9d4a1d57-24cc-4a97-8ad3-6fa4a3dfaf81 tempest-AbsoluteLimitsTests-1279869627 None] Acquiring lock "cinder-quobyte-2b942e2c-a4c4-45bb-96b8-6f6bb23f9f29" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:14:18 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-9d4a1d57-24cc-4a97-8ad3-6fa4a3dfaf81 tempest-AbsoluteLimitsTests-1279869627 None] Lock "cinder-quobyte-2b942e2c-a4c4-45bb-96b8-6f6bb23f9f29" acquired by "delete_volume" :: waited 0.028s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:14:18 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-16dfd1b6-d790-4fa0-a25a-fc3d7365953a tempest-VolumeQuotasNegativeTestJSON-534752640 None] Acquiring lock "cinder-162cd9e1-904f-4d3e-8bc1-c0754497d251-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:14:18 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ee14a44-c24b-4163-a920-b50d83ea03bf]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:14:18 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-9d4a1d57-24cc-4a97-8ad3-6fa4a3dfaf81 tempest-AbsoluteLimitsTests-1279869627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-2b942e2c-a4c4-45bb-96b8-6f6bb23f9f29 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:18 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-16dfd1b6-d790-4fa0-a25a-fc3d7365953a tempest-VolumeQuotasNegativeTestJSON-534752640 None] Lock "cinder-162cd9e1-904f-4d3e-8bc1-c0754497d251-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:14:18 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-16dfd1b6-d790-4fa0-a25a-fc3d7365953a tempest-VolumeQuotasNegativeTestJSON-534752640 None] Acquiring lock "cinder-quobyte-162cd9e1-904f-4d3e-8bc1-c0754497d251" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:14:18 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-16dfd1b6-d790-4fa0-a25a-fc3d7365953a tempest-VolumeQuotasNegativeTestJSON-534752640 None] Lock "cinder-quobyte-162cd9e1-904f-4d3e-8bc1-c0754497d251" acquired by "delete_volume" :: waited 0.014s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:14:18 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e28ea3f-ab4a-4f8d-a888-98719a9048c3]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:14:18 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-16dfd1b6-d790-4fa0-a25a-fc3d7365953a tempest-VolumeQuotasNegativeTestJSON-534752640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-162cd9e1-904f-4d3e-8bc1-c0754497d251 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:18 devstack sudo[98539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-2b942e2c-a4c4-45bb-96b8-6f6bb23f9f29 Nov 02 10:14:18 devstack sudo[98539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:18 devstack sudo[98537]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:18 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-27febfb9-a92c-48ef-ac8e-c33d4d8cab1f tempest-VolumeDependencyTests-1091358234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-25f2b8b3-0f12-47bc-88c6-f08e32b109ca" returned: 0 in 0.316s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:18 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-27febfb9-a92c-48ef-ac8e-c33d4d8cab1f tempest-VolumeDependencyTests-1091358234 None] <== create_volume: return (962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:14:18 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-27febfb9-a92c-48ef-ac8e-c33d4d8cab1f tempest-VolumeDependencyTests-1091358234 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.966s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:14:18 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-8d3e4a5e-011c-4fe0-856c-47e4713234f2 tempest-VolumesActionsTest-1577301131 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.835s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:14:18 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-27febfb9-a92c-48ef-ac8e-c33d4d8cab1f tempest-VolumeDependencyTests-1091358234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8aa3f115-b472-4177-af42-69cb55a054c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25f2b8b3-0f12-47bc-88c6-f08e32b109ca', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:14:18 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-27febfb9-a92c-48ef-ac8e-c33d4d8cab1f tempest-VolumeDependencyTests-1091358234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (300fe9c5-d49b-478b-91a9-4db18fb7ac78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:14:18 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ea508da-fe80-4d8f-8951-7a5c41f10c3c]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:14:18 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8d3e4a5e-011c-4fe0-856c-47e4713234f2 tempest-VolumesActionsTest-1577301131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ce1ccdf8-2ef8-469a-8a7d-862b00223a49 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:18 devstack sudo[98541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-162cd9e1-904f-4d3e-8bc1-c0754497d251 Nov 02 10:14:18 devstack sudo[98541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:18 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-27febfb9-a92c-48ef-ac8e-c33d4d8cab1f tempest-VolumeDependencyTests-1091358234 None] Volume volume-25f2b8b3-0f12-47bc-88c6-f08e32b109ca (25f2b8b3-0f12-47bc-88c6-f08e32b109ca): created successfully Nov 02 10:14:18 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-27febfb9-a92c-48ef-ac8e-c33d4d8cab1f tempest-VolumeDependencyTests-1091358234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (300fe9c5-d49b-478b-91a9-4db18fb7ac78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:14:18 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-27febfb9-a92c-48ef-ac8e-c33d4d8cab1f tempest-VolumeDependencyTests-1091358234 None] Flow 'volume_create_manager' (6c8853c6-b4be-421e-9207-a8127125a030) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:14:19 devstack sudo[98543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ce1ccdf8-2ef8-469a-8a7d-862b00223a49 Nov 02 10:14:19 devstack sudo[98543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:19 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-27febfb9-a92c-48ef-ac8e-c33d4d8cab1f tempest-VolumeDependencyTests-1091358234 None] Created volume successfully. Nov 02 10:14:19 devstack sudo[98539]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:19 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-9d4a1d57-24cc-4a97-8ad3-6fa4a3dfaf81 tempest-AbsoluteLimitsTests-1279869627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-2b942e2c-a4c4-45bb-96b8-6f6bb23f9f29" returned: 0 in 0.445s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:19 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-9d4a1d57-24cc-4a97-8ad3-6fa4a3dfaf81 tempest-AbsoluteLimitsTests-1279869627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-2b942e2c-a4c4-45bb-96b8-6f6bb23f9f29 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:19 devstack sudo[98549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-2b942e2c-a4c4-45bb-96b8-6f6bb23f9f29 Nov 02 10:14:19 devstack sudo[98549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:19 devstack sudo[98541]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:19 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-16dfd1b6-d790-4fa0-a25a-fc3d7365953a tempest-VolumeQuotasNegativeTestJSON-534752640 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-162cd9e1-904f-4d3e-8bc1-c0754497d251" returned: 0 in 0.451s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:19 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-16dfd1b6-d790-4fa0-a25a-fc3d7365953a tempest-VolumeQuotasNegativeTestJSON-534752640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-162cd9e1-904f-4d3e-8bc1-c0754497d251 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:19 devstack sudo[98556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-162cd9e1-904f-4d3e-8bc1-c0754497d251 Nov 02 10:14:19 devstack sudo[98556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:19 devstack sudo[98543]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:19 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8d3e4a5e-011c-4fe0-856c-47e4713234f2 tempest-VolumesActionsTest-1577301131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ce1ccdf8-2ef8-469a-8a7d-862b00223a49" returned: 0 in 0.436s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:19 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[1025b0a2-3017-474e-9bd9-521a7684872b]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:14:19 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8d3e4a5e-011c-4fe0-856c-47e4713234f2 tempest-VolumesActionsTest-1577301131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ce1ccdf8-2ef8-469a-8a7d-862b00223a49 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:19 devstack sudo[98549]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:19 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-9d4a1d57-24cc-4a97-8ad3-6fa4a3dfaf81 tempest-AbsoluteLimitsTests-1279869627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-2b942e2c-a4c4-45bb-96b8-6f6bb23f9f29" returned: 0 in 0.273s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:19 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-9d4a1d57-24cc-4a97-8ad3-6fa4a3dfaf81 tempest-AbsoluteLimitsTests-1279869627 None] Lock "cinder-quobyte-2b942e2c-a4c4-45bb-96b8-6f6bb23f9f29" released by "delete_volume" :: held 0.770s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:14:19 devstack sudo[98559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ce1ccdf8-2ef8-469a-8a7d-862b00223a49 Nov 02 10:14:19 devstack sudo[98559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:19 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-9d4a1d57-24cc-4a97-8ad3-6fa4a3dfaf81 tempest-AbsoluteLimitsTests-1279869627 None] Created reservations ['c4dd81fe-ecb0-4e88-ad5d-e955482ed602', 'b22dd7f5-19ae-4470-9356-9a3321259889', 'e52d72bd-b805-441f-a9d4-f2372ad16932', '115e1381-8aff-4385-a36f-94bb1c418474'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:14:19 devstack sudo[98556]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:19 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-16dfd1b6-d790-4fa0-a25a-fc3d7365953a tempest-VolumeQuotasNegativeTestJSON-534752640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-162cd9e1-904f-4d3e-8bc1-c0754497d251" returned: 0 in 0.311s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:19 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-9d4a1d57-24cc-4a97-8ad3-6fa4a3dfaf81 tempest-AbsoluteLimitsTests-1279869627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:14:19 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-9d4a1d57-24cc-4a97-8ad3-6fa4a3dfaf81 tempest-AbsoluteLimitsTests-1279869627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:14:19 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-9d4a1d57-24cc-4a97-8ad3-6fa4a3dfaf81 tempest-AbsoluteLimitsTests-1279869627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:14:19 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-9d4a1d57-24cc-4a97-8ad3-6fa4a3dfaf81 tempest-AbsoluteLimitsTests-1279869627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:14:19 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-9d4a1d57-24cc-4a97-8ad3-6fa4a3dfaf81 tempest-AbsoluteLimitsTests-1279869627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:14:19 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-9d4a1d57-24cc-4a97-8ad3-6fa4a3dfaf81 tempest-AbsoluteLimitsTests-1279869627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:19 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-16dfd1b6-d790-4fa0-a25a-fc3d7365953a tempest-VolumeQuotasNegativeTestJSON-534752640 None] Lock "cinder-quobyte-162cd9e1-904f-4d3e-8bc1-c0754497d251" released by "delete_volume" :: held 0.852s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:14:19 devstack sudo[98563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:14:19 devstack sudo[98563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:19 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-16dfd1b6-d790-4fa0-a25a-fc3d7365953a tempest-VolumeQuotasNegativeTestJSON-534752640 None] Created reservations ['a4adace6-897c-428d-b6b7-a4f50e6258d2', '531e798e-96a3-43c8-b968-1e56907731bf', 'a4ac77e3-e309-4a80-b483-55962d8f942f', '90579a9a-7908-4b50-9f43-0aba387e03cd'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:14:19 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-16dfd1b6-d790-4fa0-a25a-fc3d7365953a tempest-VolumeQuotasNegativeTestJSON-534752640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:14:19 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-16dfd1b6-d790-4fa0-a25a-fc3d7365953a tempest-VolumeQuotasNegativeTestJSON-534752640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:14:19 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-16dfd1b6-d790-4fa0-a25a-fc3d7365953a tempest-VolumeQuotasNegativeTestJSON-534752640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:14:19 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-16dfd1b6-d790-4fa0-a25a-fc3d7365953a tempest-VolumeQuotasNegativeTestJSON-534752640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:14:19 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-16dfd1b6-d790-4fa0-a25a-fc3d7365953a tempest-VolumeQuotasNegativeTestJSON-534752640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:14:19 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-16dfd1b6-d790-4fa0-a25a-fc3d7365953a tempest-VolumeQuotasNegativeTestJSON-534752640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:19 devstack sudo[98569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:14:19 devstack sudo[98569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:19 devstack sudo[98559]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:19 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8d3e4a5e-011c-4fe0-856c-47e4713234f2 tempest-VolumesActionsTest-1577301131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ce1ccdf8-2ef8-469a-8a7d-862b00223a49" returned: 0 in 0.523s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:19 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8d3e4a5e-011c-4fe0-856c-47e4713234f2 tempest-VolumesActionsTest-1577301131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ce1ccdf8-2ef8-469a-8a7d-862b00223a49 /opt/stack/data/cinder/conversion/ce1ccdf8-2ef8-469a-8a7d-862b00223a49.temp_image.881cdee8-dd19-4e84-8041-7a6d0c6664fa2oe9rqa5.img {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:19 devstack sudo[98571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ce1ccdf8-2ef8-469a-8a7d-862b00223a49 /opt/stack/data/cinder/conversion/ce1ccdf8-2ef8-469a-8a7d-862b00223a49.temp_image.881cdee8-dd19-4e84-8041-7a6d0c6664fa2oe9rqa5.img Nov 02 10:14:19 devstack sudo[98571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:20 devstack sudo[98563]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:20 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-9d4a1d57-24cc-4a97-8ad3-6fa4a3dfaf81 tempest-AbsoluteLimitsTests-1279869627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.521s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:20 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-9d4a1d57-24cc-4a97-8ad3-6fa4a3dfaf81 tempest-AbsoluteLimitsTests-1279869627 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:14:20 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-9d4a1d57-24cc-4a97-8ad3-6fa4a3dfaf81 tempest-AbsoluteLimitsTests-1279869627 None] Deleted volume successfully. Nov 02 10:14:20 devstack sudo[98569]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:20 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-16dfd1b6-d790-4fa0-a25a-fc3d7365953a tempest-VolumeQuotasNegativeTestJSON-534752640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.363s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:20 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-16dfd1b6-d790-4fa0-a25a-fc3d7365953a tempest-VolumeQuotasNegativeTestJSON-534752640 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:14:20 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-16dfd1b6-d790-4fa0-a25a-fc3d7365953a tempest-VolumeQuotasNegativeTestJSON-534752640 None] Deleted volume successfully. Nov 02 10:14:20 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-9d4a1d57-24cc-4a97-8ad3-6fa4a3dfaf81 tempest-AbsoluteLimitsTests-1279869627 None] Lock "cinder-2b942e2c-a4c4-45bb-96b8-6f6bb23f9f29-delete_volume" released by "delete_volume" :: held 1.622s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:14:20 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-16dfd1b6-d790-4fa0-a25a-fc3d7365953a tempest-VolumeQuotasNegativeTestJSON-534752640 None] Lock "cinder-162cd9e1-904f-4d3e-8bc1-c0754497d251-delete_volume" released by "delete_volume" :: held 1.520s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:14:20 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-3db9f6f7-0328-49c3-8566-93d1fcab06eb tempest-VolumeDependencyTests-1091358234 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:14:27 devstack sudo[98571]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:27 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8d3e4a5e-011c-4fe0-856c-47e4713234f2 tempest-VolumesActionsTest-1577301131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ce1ccdf8-2ef8-469a-8a7d-862b00223a49 /opt/stack/data/cinder/conversion/ce1ccdf8-2ef8-469a-8a7d-862b00223a49.temp_image.881cdee8-dd19-4e84-8041-7a6d0c6664fa2oe9rqa5.img" returned: 0 in 8.021s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:27 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8b8ea81-5587-421a-be11-c65040ab9376]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:14:27 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8d3e4a5e-011c-4fe0-856c-47e4713234f2 tempest-VolumesActionsTest-1577301131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ce1ccdf8-2ef8-469a-8a7d-862b00223a49 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:28 devstack sudo[98588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ce1ccdf8-2ef8-469a-8a7d-862b00223a49 Nov 02 10:14:28 devstack sudo[98588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:28 devstack sudo[98588]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:28 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8d3e4a5e-011c-4fe0-856c-47e4713234f2 tempest-VolumesActionsTest-1577301131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ce1ccdf8-2ef8-469a-8a7d-862b00223a49" returned: 0 in 0.652s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:28 devstack cinder-volume[86890]: DEBUG cinder.image.image_utils [None req-8d3e4a5e-011c-4fe0-856c-47e4713234f2 tempest-VolumesActionsTest-1577301131 None] Image conversion details: src /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ce1ccdf8-2ef8-469a-8a7d-862b00223a49, size 1024.00 MB, duration 8.02 sec, destination /opt/stack/data/cinder/conversion/ce1ccdf8-2ef8-469a-8a7d-862b00223a49.temp_image.881cdee8-dd19-4e84-8041-7a6d0c6664fa2oe9rqa5.img {{(pid=86890) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 10:14:28 devstack cinder-volume[86890]: INFO cinder.image.image_utils [None req-8d3e4a5e-011c-4fe0-856c-47e4713234f2 tempest-VolumesActionsTest-1577301131 None] Converted 1024.00 MB image at 127.61 MB/s Nov 02 10:14:28 devstack cinder-volume[86890]: DEBUG cinder.image.image_utils [None req-8d3e4a5e-011c-4fe0-856c-47e4713234f2 tempest-VolumesActionsTest-1577301131 None] 881cdee8-dd19-4e84-8041-7a6d0c6664fa was raw, converting to qcow2 {{(pid=86890) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}} Nov 02 10:14:28 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfe7d1c4-b3fe-42b2-b873-a29d1cd71bb2]: (4, 'raw') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:14:28 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8d3e4a5e-011c-4fe0-856c-47e4713234f2 tempest-VolumesActionsTest-1577301131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/ce1ccdf8-2ef8-469a-8a7d-862b00223a49.temp_image.881cdee8-dd19-4e84-8041-7a6d0c6664fa2oe9rqa5.img {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:28 devstack sudo[98593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/ce1ccdf8-2ef8-469a-8a7d-862b00223a49.temp_image.881cdee8-dd19-4e84-8041-7a6d0c6664fa2oe9rqa5.img Nov 02 10:14:28 devstack sudo[98593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:29 devstack sudo[98593]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:29 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8d3e4a5e-011c-4fe0-856c-47e4713234f2 tempest-VolumesActionsTest-1577301131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/ce1ccdf8-2ef8-469a-8a7d-862b00223a49.temp_image.881cdee8-dd19-4e84-8041-7a6d0c6664fa2oe9rqa5.img" returned: 0 in 0.453s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:29 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8d3e4a5e-011c-4fe0-856c-47e4713234f2 tempest-VolumesActionsTest-1577301131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/ce1ccdf8-2ef8-469a-8a7d-862b00223a49.temp_image.881cdee8-dd19-4e84-8041-7a6d0c6664fa2oe9rqa5.img {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:29 devstack sudo[98597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/ce1ccdf8-2ef8-469a-8a7d-862b00223a49.temp_image.881cdee8-dd19-4e84-8041-7a6d0c6664fa2oe9rqa5.img Nov 02 10:14:29 devstack sudo[98597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:29 devstack sudo[98597]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:29 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8d3e4a5e-011c-4fe0-856c-47e4713234f2 tempest-VolumesActionsTest-1577301131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/ce1ccdf8-2ef8-469a-8a7d-862b00223a49.temp_image.881cdee8-dd19-4e84-8041-7a6d0c6664fa2oe9rqa5.img" returned: 1 in 0.360s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:29 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8d3e4a5e-011c-4fe0-856c-47e4713234f2 tempest-VolumesActionsTest-1577301131 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/ce1ccdf8-2ef8-469a-8a7d-862b00223a49.temp_image.881cdee8-dd19-4e84-8041-7a6d0c6664fa2oe9rqa5.img' failed. Not Retrying. {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 10:14:29 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8d3e4a5e-011c-4fe0-856c-47e4713234f2 tempest-VolumesActionsTest-1577301131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/ce1ccdf8-2ef8-469a-8a7d-862b00223a49.temp_image.881cdee8-dd19-4e84-8041-7a6d0c6664fa2oe9rqa5.img /opt/stack/data/cinder/conversion/vol_upload_rfq8mohg {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:29 devstack sudo[98602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/ce1ccdf8-2ef8-469a-8a7d-862b00223a49.temp_image.881cdee8-dd19-4e84-8041-7a6d0c6664fa2oe9rqa5.img /opt/stack/data/cinder/conversion/vol_upload_rfq8mohg Nov 02 10:14:29 devstack sudo[98602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:29 devstack sudo[98602]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:29 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8d3e4a5e-011c-4fe0-856c-47e4713234f2 tempest-VolumesActionsTest-1577301131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/ce1ccdf8-2ef8-469a-8a7d-862b00223a49.temp_image.881cdee8-dd19-4e84-8041-7a6d0c6664fa2oe9rqa5.img /opt/stack/data/cinder/conversion/vol_upload_rfq8mohg" returned: 0 in 0.307s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:29 devstack cinder-volume[86890]: DEBUG cinder.image.image_utils [None req-8d3e4a5e-011c-4fe0-856c-47e4713234f2 tempest-VolumesActionsTest-1577301131 None] Image conversion details: src /opt/stack/data/cinder/conversion/ce1ccdf8-2ef8-469a-8a7d-862b00223a49.temp_image.881cdee8-dd19-4e84-8041-7a6d0c6664fa2oe9rqa5.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_rfq8mohg {{(pid=86890) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 10:14:29 devstack cinder-volume[86890]: INFO cinder.image.image_utils [None req-8d3e4a5e-011c-4fe0-856c-47e4713234f2 tempest-VolumesActionsTest-1577301131 None] Converted 1024.00 MB image at 1024.00 MB/s Nov 02 10:14:29 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[98b7fdcc-54cd-4f2d-9e5d-fb57b6b22e5e]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:14:29 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8d3e4a5e-011c-4fe0-856c-47e4713234f2 tempest-VolumesActionsTest-1577301131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_rfq8mohg {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:29 devstack sudo[98608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_rfq8mohg Nov 02 10:14:29 devstack sudo[98608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:30 devstack sudo[98608]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:30 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8d3e4a5e-011c-4fe0-856c-47e4713234f2 tempest-VolumesActionsTest-1577301131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_rfq8mohg" returned: 0 in 0.372s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:30 devstack cinder-volume[86890]: DEBUG dbcounter [-] [86890] Writing DB stats cinder:UPDATE=25,cinder:SELECT=14,cinder:DELETE=3,cinder:INSERT=6 {{(pid=86890) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:14:31 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-57c94b99-f7cc-40a6-83fa-64433feafd51 tempest-VolumeRetypeWithoutMigrationTest-6285476 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:14:31 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-57c94b99-f7cc-40a6-83fa-64433feafd51 tempest-VolumeRetypeWithoutMigrationTest-6285476 None] Flow 'volume_create_manager' (ff2395d7-75f8-4426-a4b6-ded8c96bbe12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:14:31 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-57c94b99-f7cc-40a6-83fa-64433feafd51 tempest-VolumeRetypeWithoutMigrationTest-6285476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24416342-44ab-4fe6-8145-327cb612acf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:14:31 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-57c94b99-f7cc-40a6-83fa-64433feafd51 tempest-VolumeRetypeWithoutMigrationTest-6285476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24416342-44ab-4fe6-8145-327cb612acf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:14:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1412715267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a242f98-eb6f-431b-87c8-f3684409e8e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5af183af49894dc289d8d23124187a53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:14:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:14:32Z,use_quota=True,user_id='c60f243a8a7a49d080a9c2d5703873e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4435aff4-e122-42ff-a37f-6e9af7f126c3),volume_type_id=4435aff4-e122-42ff-a37f-6e9af7f126c3)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:14:31 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-57c94b99-f7cc-40a6-83fa-64433feafd51 tempest-VolumeRetypeWithoutMigrationTest-6285476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fdeddb1-8c87-40b2-be29-da26cb73046a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:14:31 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-57c94b99-f7cc-40a6-83fa-64433feafd51 tempest-VolumeRetypeWithoutMigrationTest-6285476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fdeddb1-8c87-40b2-be29-da26cb73046a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:14:31 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-57c94b99-f7cc-40a6-83fa-64433feafd51 tempest-VolumeRetypeWithoutMigrationTest-6285476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb1f6d91-a884-4a85-b055-db8832b48ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:14:31 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-57c94b99-f7cc-40a6-83fa-64433feafd51 tempest-VolumeRetypeWithoutMigrationTest-6285476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb1f6d91-a884-4a85-b055-db8832b48ab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a242f98-eb6f-431b-87c8-f3684409e8e3', 'volume_name': 'volume-7a242f98-eb6f-431b-87c8-f3684409e8e3', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:14:31 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-57c94b99-f7cc-40a6-83fa-64433feafd51 tempest-VolumeRetypeWithoutMigrationTest-6285476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a09f7ed3-8193-4fe7-a8d7-12694d04858a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:14:31 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-57c94b99-f7cc-40a6-83fa-64433feafd51 tempest-VolumeRetypeWithoutMigrationTest-6285476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a09f7ed3-8193-4fe7-a8d7-12694d04858a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:14:31 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-57c94b99-f7cc-40a6-83fa-64433feafd51 tempest-VolumeRetypeWithoutMigrationTest-6285476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8eeb26e-e3cf-4db6-a07e-5c8789c4b057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:14:31 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-57c94b99-f7cc-40a6-83fa-64433feafd51 tempest-VolumeRetypeWithoutMigrationTest-6285476 None] Volume 7a242f98-eb6f-431b-87c8-f3684409e8e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a242f98-eb6f-431b-87c8-f3684409e8e3', 'volume_size': 1} Nov 02 10:14:31 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-57c94b99-f7cc-40a6-83fa-64433feafd51 tempest-VolumeRetypeWithoutMigrationTest-6285476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:14:32 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-8d3e4a5e-011c-4fe0-856c-47e4713234f2 tempest-VolumesActionsTest-1577301131 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 13.187s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:14:32 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-8d3e4a5e-011c-4fe0-856c-47e4713234f2 tempest-VolumesActionsTest-1577301131 None] Uploaded volume to glance image-id: 881cdee8-dd19-4e84-8041-7a6d0c6664fa. {{(pid=86890) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 02 10:14:32 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-3db9f6f7-0328-49c3-8566-93d1fcab06eb tempest-VolumeDependencyTests-1091358234 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 11.796s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:14:32 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-3db9f6f7-0328-49c3-8566-93d1fcab06eb tempest-VolumeDependencyTests-1091358234 None] Creating offline snapshot 79ce875e-5d87-4cc7-b6f3-367d6290909d of volume 25f2b8b3-0f12-47bc-88c6-f08e32b109ca {{(pid=86890) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:14:32 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-8d3e4a5e-011c-4fe0-856c-47e4713234f2 tempest-VolumesActionsTest-1577301131 None] Copy volume to image completed successfully. Nov 02 10:14:32 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfd4b92d-0d92-4761-a766-7520e55ff405]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:14:32 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-3db9f6f7-0328-49c3-8566-93d1fcab06eb tempest-VolumeDependencyTests-1091358234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-25f2b8b3-0f12-47bc-88c6-f08e32b109ca {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:32 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-8cc6730b-e339-4bcc-ba2a-76c2b6633df2 tempest-VolumesTransfersV355Test-966853260 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:14:32 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-8cc6730b-e339-4bcc-ba2a-76c2b6633df2 tempest-VolumesTransfersV355Test-966853260 None] Flow 'volume_create_manager' (953c72e5-75ad-4540-9ec8-6c0cd816a7df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:14:32 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-8cc6730b-e339-4bcc-ba2a-76c2b6633df2 tempest-VolumesTransfersV355Test-966853260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89751114-4c49-4445-aaee-eed9aa28d3f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:14:32 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-8cc6730b-e339-4bcc-ba2a-76c2b6633df2 tempest-VolumesTransfersV355Test-966853260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89751114-4c49-4445-aaee-eed9aa28d3f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:14:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-943333600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fc2926b-488c-4e42-abf6-18434671962c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cc7b5f2d6394ac79e865a76605b5a9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:14:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:14:32Z,use_quota=True,user_id='d061c0cdd2014c68a58d6bfb1e901fd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:14:32 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-8cc6730b-e339-4bcc-ba2a-76c2b6633df2 tempest-VolumesTransfersV355Test-966853260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (310e7d6f-c86a-4c67-a284-3deebc3f38ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:14:32 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-8cc6730b-e339-4bcc-ba2a-76c2b6633df2 tempest-VolumesTransfersV355Test-966853260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (310e7d6f-c86a-4c67-a284-3deebc3f38ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:14:32 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-8cc6730b-e339-4bcc-ba2a-76c2b6633df2 tempest-VolumesTransfersV355Test-966853260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa6bd648-c9a6-4d93-8c4d-a99021c30fd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:14:32 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-8cc6730b-e339-4bcc-ba2a-76c2b6633df2 tempest-VolumesTransfersV355Test-966853260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa6bd648-c9a6-4d93-8c4d-a99021c30fd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8fc2926b-488c-4e42-abf6-18434671962c', 'volume_name': 'volume-8fc2926b-488c-4e42-abf6-18434671962c', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:14:32 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-8cc6730b-e339-4bcc-ba2a-76c2b6633df2 tempest-VolumesTransfersV355Test-966853260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b9aee4d-f022-4010-9b99-94ba1c86d574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:14:32 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-8cc6730b-e339-4bcc-ba2a-76c2b6633df2 tempest-VolumesTransfersV355Test-966853260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b9aee4d-f022-4010-9b99-94ba1c86d574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:14:32 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-8cc6730b-e339-4bcc-ba2a-76c2b6633df2 tempest-VolumesTransfersV355Test-966853260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1956422-ce41-4341-ad29-1bce58fcfc1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:14:32 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-8cc6730b-e339-4bcc-ba2a-76c2b6633df2 tempest-VolumesTransfersV355Test-966853260 None] Volume 8fc2926b-488c-4e42-abf6-18434671962c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8fc2926b-488c-4e42-abf6-18434671962c', 'volume_size': 1} Nov 02 10:14:32 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-8cc6730b-e339-4bcc-ba2a-76c2b6633df2 tempest-VolumesTransfersV355Test-966853260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:14:32 devstack sudo[98613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-25f2b8b3-0f12-47bc-88c6-f08e32b109ca Nov 02 10:14:32 devstack sudo[98613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:32 devstack sudo[98613]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:32 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-3db9f6f7-0328-49c3-8566-93d1fcab06eb tempest-VolumeDependencyTests-1091358234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-25f2b8b3-0f12-47bc-88c6-f08e32b109ca" returned: 0 in 0.357s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:32 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-3db9f6f7-0328-49c3-8566-93d1fcab06eb tempest-VolumeDependencyTests-1091358234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-25f2b8b3-0f12-47bc-88c6-f08e32b109ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-25f2b8b3-0f12-47bc-88c6-f08e32b109ca.79ce875e-5d87-4cc7-b6f3-367d6290909d 1G {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:32 devstack sudo[98618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-25f2b8b3-0f12-47bc-88c6-f08e32b109ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-25f2b8b3-0f12-47bc-88c6-f08e32b109ca.79ce875e-5d87-4cc7-b6f3-367d6290909d 1G Nov 02 10:14:32 devstack sudo[98618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:32 devstack sudo[98618]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:32 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-3db9f6f7-0328-49c3-8566-93d1fcab06eb tempest-VolumeDependencyTests-1091358234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-25f2b8b3-0f12-47bc-88c6-f08e32b109ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-25f2b8b3-0f12-47bc-88c6-f08e32b109ca.79ce875e-5d87-4cc7-b6f3-367d6290909d 1G" returned: 0 in 0.432s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:32 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-3db9f6f7-0328-49c3-8566-93d1fcab06eb tempest-VolumeDependencyTests-1091358234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25f2b8b3-0f12-47bc-88c6-f08e32b109ca -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-25f2b8b3-0f12-47bc-88c6-f08e32b109ca.79ce875e-5d87-4cc7-b6f3-367d6290909d {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:32 devstack sudo[98624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25f2b8b3-0f12-47bc-88c6-f08e32b109ca -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-25f2b8b3-0f12-47bc-88c6-f08e32b109ca.79ce875e-5d87-4cc7-b6f3-367d6290909d Nov 02 10:14:32 devstack sudo[98624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:33 devstack sudo[98624]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:33 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-3db9f6f7-0328-49c3-8566-93d1fcab06eb tempest-VolumeDependencyTests-1091358234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25f2b8b3-0f12-47bc-88c6-f08e32b109ca -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-25f2b8b3-0f12-47bc-88c6-f08e32b109ca.79ce875e-5d87-4cc7-b6f3-367d6290909d" returned: 0 in 0.322s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:33 devstack cinder-volume[86890]: WARNING cinder.volume.drivers.remotefs [None req-3db9f6f7-0328-49c3-8566-93d1fcab06eb tempest-VolumeDependencyTests-1091358234 None] /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-25f2b8b3-0f12-47bc-88c6-f08e32b109ca.79ce875e-5d87-4cc7-b6f3-367d6290909d is being set with open permissions: ugo+rw Nov 02 10:14:33 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-3db9f6f7-0328-49c3-8566-93d1fcab06eb tempest-VolumeDependencyTests-1091358234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-25f2b8b3-0f12-47bc-88c6-f08e32b109ca.79ce875e-5d87-4cc7-b6f3-367d6290909d {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:33 devstack sudo[98629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-25f2b8b3-0f12-47bc-88c6-f08e32b109ca.79ce875e-5d87-4cc7-b6f3-367d6290909d Nov 02 10:14:33 devstack sudo[98629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:33 devstack sudo[98629]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:33 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-3db9f6f7-0328-49c3-8566-93d1fcab06eb tempest-VolumeDependencyTests-1091358234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-25f2b8b3-0f12-47bc-88c6-f08e32b109ca.79ce875e-5d87-4cc7-b6f3-367d6290909d" returned: 0 in 0.251s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:33 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-3db9f6f7-0328-49c3-8566-93d1fcab06eb tempest-VolumeDependencyTests-1091358234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-25f2b8b3-0f12-47bc-88c6-f08e32b109ca.info {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:33 devstack sudo[98633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-25f2b8b3-0f12-47bc-88c6-f08e32b109ca.info Nov 02 10:14:33 devstack sudo[98633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:33 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-5b18cf77-f795-4664-ace9-af3d744c3b34 tempest-VolumesActionsTest-1577301131 None] Acquiring lock "cinder-ce1ccdf8-2ef8-469a-8a7d-862b00223a49-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:14:33 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-5b18cf77-f795-4664-ace9-af3d744c3b34 tempest-VolumesActionsTest-1577301131 None] Lock "cinder-ce1ccdf8-2ef8-469a-8a7d-862b00223a49-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:14:33 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-5b18cf77-f795-4664-ace9-af3d744c3b34 tempest-VolumesActionsTest-1577301131 None] Acquiring lock "cinder-quobyte-ce1ccdf8-2ef8-469a-8a7d-862b00223a49" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:14:33 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-5b18cf77-f795-4664-ace9-af3d744c3b34 tempest-VolumesActionsTest-1577301131 None] Lock "cinder-quobyte-ce1ccdf8-2ef8-469a-8a7d-862b00223a49" acquired by "delete_volume" :: waited 0.019s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:14:33 devstack sudo[98633]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:33 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-3db9f6f7-0328-49c3-8566-93d1fcab06eb tempest-VolumeDependencyTests-1091358234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-25f2b8b3-0f12-47bc-88c6-f08e32b109ca.info" returned: 0 in 0.285s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:33 devstack cinder-volume[86890]: WARNING cinder.volume.drivers.remotefs [None req-3db9f6f7-0328-49c3-8566-93d1fcab06eb tempest-VolumeDependencyTests-1091358234 None] /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-25f2b8b3-0f12-47bc-88c6-f08e32b109ca.info is being set with open permissions: ugo+rw Nov 02 10:14:33 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-3db9f6f7-0328-49c3-8566-93d1fcab06eb tempest-VolumeDependencyTests-1091358234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-25f2b8b3-0f12-47bc-88c6-f08e32b109ca.info {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:33 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1b037f5-95c4-4fee-af91-113ab9c6621b]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:14:33 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-5b18cf77-f795-4664-ace9-af3d744c3b34 tempest-VolumesActionsTest-1577301131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ce1ccdf8-2ef8-469a-8a7d-862b00223a49 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:33 devstack sudo[98636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-25f2b8b3-0f12-47bc-88c6-f08e32b109ca.info Nov 02 10:14:33 devstack sudo[98636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:33 devstack sudo[98637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ce1ccdf8-2ef8-469a-8a7d-862b00223a49 Nov 02 10:14:33 devstack sudo[98637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:34 devstack sudo[98636]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-3db9f6f7-0328-49c3-8566-93d1fcab06eb tempest-VolumeDependencyTests-1091358234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-25f2b8b3-0f12-47bc-88c6-f08e32b109ca.info" returned: 0 in 0.282s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-3db9f6f7-0328-49c3-8566-93d1fcab06eb tempest-VolumeDependencyTests-1091358234 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.065s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:14:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-57c94b99-f7cc-40a6-83fa-64433feafd51 tempest-VolumeRetypeWithoutMigrationTest-6285476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.393s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:14:34 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-57c94b99-f7cc-40a6-83fa-64433feafd51 tempest-VolumeRetypeWithoutMigrationTest-6285476 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:14:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1412715267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a242f98-eb6f-431b-87c8-f3684409e8e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5af183af49894dc289d8d23124187a53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:14:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:14:32Z,use_quota=True,user_id='c60f243a8a7a49d080a9c2d5703873e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4435aff4-e122-42ff-a37f-6e9af7f126c3),volume_type_id=4435aff4-e122-42ff-a37f-6e9af7f126c3)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:14:34 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-57c94b99-f7cc-40a6-83fa-64433feafd51 tempest-VolumeRetypeWithoutMigrationTest-6285476 None] Creating volume 7a242f98-eb6f-431b-87c8-f3684409e8e3 {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:14:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-57c94b99-f7cc-40a6-83fa-64433feafd51 tempest-VolumeRetypeWithoutMigrationTest-6285476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:14:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-57c94b99-f7cc-40a6-83fa-64433feafd51 tempest-VolumeRetypeWithoutMigrationTest-6285476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:14:34 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-57c94b99-f7cc-40a6-83fa-64433feafd51 tempest-VolumeRetypeWithoutMigrationTest-6285476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:14:34 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-57c94b99-f7cc-40a6-83fa-64433feafd51 tempest-VolumeRetypeWithoutMigrationTest-6285476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:14:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-57c94b99-f7cc-40a6-83fa-64433feafd51 tempest-VolumeRetypeWithoutMigrationTest-6285476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:14:34 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-57c94b99-f7cc-40a6-83fa-64433feafd51 tempest-VolumeRetypeWithoutMigrationTest-6285476 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:14:34 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-57c94b99-f7cc-40a6-83fa-64433feafd51 tempest-VolumeRetypeWithoutMigrationTest-6285476 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:14:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-57c94b99-f7cc-40a6-83fa-64433feafd51 tempest-VolumeRetypeWithoutMigrationTest-6285476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-7a242f98-eb6f-431b-87c8-f3684409e8e3 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:34 devstack sudo[98643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-7a242f98-eb6f-431b-87c8-f3684409e8e3 1073741824 Nov 02 10:14:34 devstack sudo[98643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:34 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-3db9f6f7-0328-49c3-8566-93d1fcab06eb tempest-VolumeDependencyTests-1091358234 None] Create snapshot completed successfully Nov 02 10:14:34 devstack sudo[98637]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-5b18cf77-f795-4664-ace9-af3d744c3b34 tempest-VolumesActionsTest-1577301131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ce1ccdf8-2ef8-469a-8a7d-862b00223a49" returned: 0 in 0.405s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-5b18cf77-f795-4664-ace9-af3d744c3b34 tempest-VolumesActionsTest-1577301131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ce1ccdf8-2ef8-469a-8a7d-862b00223a49 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:34 devstack sudo[98646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ce1ccdf8-2ef8-469a-8a7d-862b00223a49 Nov 02 10:14:34 devstack sudo[98646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:34 devstack sudo[98646]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-5b18cf77-f795-4664-ace9-af3d744c3b34 tempest-VolumesActionsTest-1577301131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-ce1ccdf8-2ef8-469a-8a7d-862b00223a49" returned: 0 in 0.254s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:34 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-5b18cf77-f795-4664-ace9-af3d744c3b34 tempest-VolumesActionsTest-1577301131 None] Lock "cinder-quobyte-ce1ccdf8-2ef8-469a-8a7d-862b00223a49" released by "delete_volume" :: held 0.707s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:14:34 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-5b18cf77-f795-4664-ace9-af3d744c3b34 tempest-VolumesActionsTest-1577301131 None] Created reservations ['48ac588e-bddc-47fa-bed3-018f1f83b0dc', 'c4a008b8-965f-461e-9957-14f93863686d', 'be1be1df-d10b-47e5-8a74-5c7299006acc', '66351062-a742-4660-bed3-99663cddb12d'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:14:34 devstack sudo[98643]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-57c94b99-f7cc-40a6-83fa-64433feafd51 tempest-VolumeRetypeWithoutMigrationTest-6285476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-7a242f98-eb6f-431b-87c8-f3684409e8e3 1073741824" returned: 0 in 0.498s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-5b18cf77-f795-4664-ace9-af3d744c3b34 tempest-VolumesActionsTest-1577301131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:14:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-5b18cf77-f795-4664-ace9-af3d744c3b34 tempest-VolumesActionsTest-1577301131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:14:34 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-5b18cf77-f795-4664-ace9-af3d744c3b34 tempest-VolumesActionsTest-1577301131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:14:34 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-5b18cf77-f795-4664-ace9-af3d744c3b34 tempest-VolumesActionsTest-1577301131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:14:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-5b18cf77-f795-4664-ace9-af3d744c3b34 tempest-VolumesActionsTest-1577301131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:14:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-5b18cf77-f795-4664-ace9-af3d744c3b34 tempest-VolumesActionsTest-1577301131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:34 devstack sudo[98653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:14:34 devstack sudo[98653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-57c94b99-f7cc-40a6-83fa-64433feafd51 tempest-VolumeRetypeWithoutMigrationTest-6285476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-7a242f98-eb6f-431b-87c8-f3684409e8e3 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:34 devstack sudo[98655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-7a242f98-eb6f-431b-87c8-f3684409e8e3 Nov 02 10:14:34 devstack sudo[98655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:34 devstack cinder-volume[86890]: DEBUG oslo_service.periodic_task [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86890) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:14:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:14:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:14:34 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:14:34 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:14:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:14:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:34 devstack sudo[98657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:14:34 devstack sudo[98657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:34 devstack sudo[98653]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-5b18cf77-f795-4664-ace9-af3d744c3b34 tempest-VolumesActionsTest-1577301131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.293s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:34 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-5b18cf77-f795-4664-ace9-af3d744c3b34 tempest-VolumesActionsTest-1577301131 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:14:34 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-5b18cf77-f795-4664-ace9-af3d744c3b34 tempest-VolumesActionsTest-1577301131 None] Deleted volume successfully. Nov 02 10:14:34 devstack sudo[98655]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-57c94b99-f7cc-40a6-83fa-64433feafd51 tempest-VolumeRetypeWithoutMigrationTest-6285476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-7a242f98-eb6f-431b-87c8-f3684409e8e3" returned: 0 in 0.288s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:34 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-57c94b99-f7cc-40a6-83fa-64433feafd51 tempest-VolumeRetypeWithoutMigrationTest-6285476 None] <== create_volume: return (860ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:14:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-57c94b99-f7cc-40a6-83fa-64433feafd51 tempest-VolumeRetypeWithoutMigrationTest-6285476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.863s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:14:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-8cc6730b-e339-4bcc-ba2a-76c2b6633df2 tempest-VolumesTransfersV355Test-966853260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.786s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:14:34 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-8cc6730b-e339-4bcc-ba2a-76c2b6633df2 tempest-VolumesTransfersV355Test-966853260 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:14:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-943333600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fc2926b-488c-4e42-abf6-18434671962c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cc7b5f2d6394ac79e865a76605b5a9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:14:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:14:32Z,use_quota=True,user_id='d061c0cdd2014c68a58d6bfb1e901fd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:14:34 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-8cc6730b-e339-4bcc-ba2a-76c2b6633df2 tempest-VolumesTransfersV355Test-966853260 None] Creating volume 8fc2926b-488c-4e42-abf6-18434671962c {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:14:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-8cc6730b-e339-4bcc-ba2a-76c2b6633df2 tempest-VolumesTransfersV355Test-966853260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:14:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-8cc6730b-e339-4bcc-ba2a-76c2b6633df2 tempest-VolumesTransfersV355Test-966853260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:14:34 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-8cc6730b-e339-4bcc-ba2a-76c2b6633df2 tempest-VolumesTransfersV355Test-966853260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:14:34 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-8cc6730b-e339-4bcc-ba2a-76c2b6633df2 tempest-VolumesTransfersV355Test-966853260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:14:35 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-8cc6730b-e339-4bcc-ba2a-76c2b6633df2 tempest-VolumesTransfersV355Test-966853260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:14:35 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-8cc6730b-e339-4bcc-ba2a-76c2b6633df2 tempest-VolumesTransfersV355Test-966853260 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:14:35 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-8cc6730b-e339-4bcc-ba2a-76c2b6633df2 tempest-VolumesTransfersV355Test-966853260 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:14:35 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8cc6730b-e339-4bcc-ba2a-76c2b6633df2 tempest-VolumesTransfersV355Test-966853260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-8fc2926b-488c-4e42-abf6-18434671962c 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:35 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-5b18cf77-f795-4664-ace9-af3d744c3b34 tempest-VolumesActionsTest-1577301131 None] Lock "cinder-ce1ccdf8-2ef8-469a-8a7d-862b00223a49-delete_volume" released by "delete_volume" :: held 1.293s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:14:35 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-57c94b99-f7cc-40a6-83fa-64433feafd51 tempest-VolumeRetypeWithoutMigrationTest-6285476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8eeb26e-e3cf-4db6-a07e-5c8789c4b057) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a242f98-eb6f-431b-87c8-f3684409e8e3', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:14:35 devstack sudo[98661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-8fc2926b-488c-4e42-abf6-18434671962c 1073741824 Nov 02 10:14:35 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-57c94b99-f7cc-40a6-83fa-64433feafd51 tempest-VolumeRetypeWithoutMigrationTest-6285476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7cff7fe-61d4-4419-8be7-ae5ee807fff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:14:35 devstack sudo[98661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:35 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-57c94b99-f7cc-40a6-83fa-64433feafd51 tempest-VolumeRetypeWithoutMigrationTest-6285476 None] Volume volume-7a242f98-eb6f-431b-87c8-f3684409e8e3 (7a242f98-eb6f-431b-87c8-f3684409e8e3): created successfully Nov 02 10:14:35 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-57c94b99-f7cc-40a6-83fa-64433feafd51 tempest-VolumeRetypeWithoutMigrationTest-6285476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7cff7fe-61d4-4419-8be7-ae5ee807fff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:14:35 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-57c94b99-f7cc-40a6-83fa-64433feafd51 tempest-VolumeRetypeWithoutMigrationTest-6285476 None] Flow 'volume_create_manager' (ff2395d7-75f8-4426-a4b6-ded8c96bbe12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:14:35 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-57c94b99-f7cc-40a6-83fa-64433feafd51 tempest-VolumeRetypeWithoutMigrationTest-6285476 None] Created volume successfully. Nov 02 10:14:35 devstack sudo[98657]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:35 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.343s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:35 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:14:35 devstack cinder-volume[86890]: DEBUG oslo_service.periodic_task [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Running periodic task VolumeManager._thread_info {{(pid=86890) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:14:35 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] thread count: 29 {{(pid=86890) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:14:35 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] thread info: [<_MainThread(MainThread, started 133913319395456)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86890) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:14:35 devstack sudo[98661]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:35 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8cc6730b-e339-4bcc-ba2a-76c2b6633df2 tempest-VolumesTransfersV355Test-966853260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-8fc2926b-488c-4e42-abf6-18434671962c 1073741824" returned: 0 in 0.567s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:35 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8cc6730b-e339-4bcc-ba2a-76c2b6633df2 tempest-VolumesTransfersV355Test-966853260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-8fc2926b-488c-4e42-abf6-18434671962c {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:35 devstack sudo[98668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-8fc2926b-488c-4e42-abf6-18434671962c Nov 02 10:14:35 devstack sudo[98668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:35 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-391ccd75-5ce9-449a-a872-5d6e477f931f tempest-VolumeDependencyTests-1091358234 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:14:35 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-391ccd75-5ce9-449a-a872-5d6e477f931f tempest-VolumeDependencyTests-1091358234 None] Flow 'volume_create_manager' (e8061008-8cad-4c69-ac02-05e2234070f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:14:35 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-391ccd75-5ce9-449a-a872-5d6e477f931f tempest-VolumeDependencyTests-1091358234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55093041-287b-4d4a-9336-a5599476ef54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:14:35 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-391ccd75-5ce9-449a-a872-5d6e477f931f tempest-VolumeDependencyTests-1091358234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55093041-287b-4d4a-9336-a5599476ef54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:14:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-63869120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49c66d3b-652c-46ee-a4bf-18eb337449d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='802a9e6f1bb548a0a5274c530d187dcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:14:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=79ce875e-5d87-4cc7-b6f3-367d6290909d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:14:36Z,use_quota=True,user_id='31f1592350b84948bb97b3b3c0ac723f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:14:35 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-391ccd75-5ce9-449a-a872-5d6e477f931f tempest-VolumeDependencyTests-1091358234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6c6450d-83f9-42e2-bd5e-711c09aa6387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:14:35 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-391ccd75-5ce9-449a-a872-5d6e477f931f tempest-VolumeDependencyTests-1091358234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6c6450d-83f9-42e2-bd5e-711c09aa6387) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:14:35 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-391ccd75-5ce9-449a-a872-5d6e477f931f tempest-VolumeDependencyTests-1091358234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6c64580-ab37-4d17-816c-e0385b784dc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:14:35 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-391ccd75-5ce9-449a-a872-5d6e477f931f tempest-VolumeDependencyTests-1091358234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6c64580-ab37-4d17-816c-e0385b784dc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '49c66d3b-652c-46ee-a4bf-18eb337449d9', 'volume_name': 'volume-49c66d3b-652c-46ee-a4bf-18eb337449d9', 'volume_size': 1, 'snapshot_id': '79ce875e-5d87-4cc7-b6f3-367d6290909d'}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:14:35 devstack sudo[98668]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:36 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-391ccd75-5ce9-449a-a872-5d6e477f931f tempest-VolumeDependencyTests-1091358234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (190d4278-1085-417a-a561-cb98580e1cd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:14:36 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-391ccd75-5ce9-449a-a872-5d6e477f931f tempest-VolumeDependencyTests-1091358234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (190d4278-1085-417a-a561-cb98580e1cd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:14:36 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-391ccd75-5ce9-449a-a872-5d6e477f931f tempest-VolumeDependencyTests-1091358234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab280c32-5b59-4f6e-8386-401f0d3a86cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:14:36 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-391ccd75-5ce9-449a-a872-5d6e477f931f tempest-VolumeDependencyTests-1091358234 None] Volume 49c66d3b-652c-46ee-a4bf-18eb337449d9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-49c66d3b-652c-46ee-a4bf-18eb337449d9', 'volume_size': 1, 'snapshot_id': '79ce875e-5d87-4cc7-b6f3-367d6290909d'} Nov 02 10:14:36 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8cc6730b-e339-4bcc-ba2a-76c2b6633df2 tempest-VolumesTransfersV355Test-966853260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-8fc2926b-488c-4e42-abf6-18434671962c" returned: 0 in 0.392s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:36 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-8cc6730b-e339-4bcc-ba2a-76c2b6633df2 tempest-VolumesTransfersV355Test-966853260 None] <== create_volume: return (1039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:14:36 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-8cc6730b-e339-4bcc-ba2a-76c2b6633df2 tempest-VolumesTransfersV355Test-966853260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.043s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:14:36 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-8cc6730b-e339-4bcc-ba2a-76c2b6633df2 tempest-VolumesTransfersV355Test-966853260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1956422-ce41-4341-ad29-1bce58fcfc1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fc2926b-488c-4e42-abf6-18434671962c', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:14:36 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-8cc6730b-e339-4bcc-ba2a-76c2b6633df2 tempest-VolumesTransfersV355Test-966853260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1a40e1a-fe3e-45cf-a177-9b51a0f08991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:14:36 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-391ccd75-5ce9-449a-a872-5d6e477f931f tempest-VolumeDependencyTests-1091358234 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:14:36 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-391ccd75-5ce9-449a-a872-5d6e477f931f tempest-VolumeDependencyTests-1091358234 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:14:36 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-391ccd75-5ce9-449a-a872-5d6e477f931f tempest-VolumeDependencyTests-1091358234 None] Acquiring lock "cinder-quobyte-79ce875e-5d87-4cc7-b6f3-367d6290909d-49c66d3b-652c-46ee-a4bf-18eb337449d9" by "_create_volume_from_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:14:36 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-8cc6730b-e339-4bcc-ba2a-76c2b6633df2 tempest-VolumesTransfersV355Test-966853260 None] Volume volume-8fc2926b-488c-4e42-abf6-18434671962c (8fc2926b-488c-4e42-abf6-18434671962c): created successfully Nov 02 10:14:36 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-8cc6730b-e339-4bcc-ba2a-76c2b6633df2 tempest-VolumesTransfersV355Test-966853260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1a40e1a-fe3e-45cf-a177-9b51a0f08991) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:14:36 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-8cc6730b-e339-4bcc-ba2a-76c2b6633df2 tempest-VolumesTransfersV355Test-966853260 None] Flow 'volume_create_manager' (953c72e5-75ad-4540-9ec8-6c0cd816a7df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:14:36 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-391ccd75-5ce9-449a-a872-5d6e477f931f tempest-VolumeDependencyTests-1091358234 None] Lock "cinder-quobyte-79ce875e-5d87-4cc7-b6f3-367d6290909d-49c66d3b-652c-46ee-a4bf-18eb337449d9" acquired by "_create_volume_from_snapshot" :: waited 0.032s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:14:36 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-391ccd75-5ce9-449a-a872-5d6e477f931f tempest-VolumeDependencyTests-1091358234 None] Creating volume 49c66d3b-652c-46ee-a4bf-18eb337449d9 from snapshot 79ce875e-5d87-4cc7-b6f3-367d6290909d {{(pid=86890) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 02 10:14:36 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-391ccd75-5ce9-449a-a872-5d6e477f931f tempest-VolumeDependencyTests-1091358234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:14:36 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-391ccd75-5ce9-449a-a872-5d6e477f931f tempest-VolumeDependencyTests-1091358234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:14:36 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-391ccd75-5ce9-449a-a872-5d6e477f931f tempest-VolumeDependencyTests-1091358234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:14:36 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-391ccd75-5ce9-449a-a872-5d6e477f931f tempest-VolumeDependencyTests-1091358234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:14:36 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-391ccd75-5ce9-449a-a872-5d6e477f931f tempest-VolumeDependencyTests-1091358234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:14:36 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-391ccd75-5ce9-449a-a872-5d6e477f931f tempest-VolumeDependencyTests-1091358234 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:14:36 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-391ccd75-5ce9-449a-a872-5d6e477f931f tempest-VolumeDependencyTests-1091358234 None] Acquiring lock "cinder-quobyte-49c66d3b-652c-46ee-a4bf-18eb337449d9" by "_copy_volume_from_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:14:36 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-8cc6730b-e339-4bcc-ba2a-76c2b6633df2 tempest-VolumesTransfersV355Test-966853260 None] Created volume successfully. Nov 02 10:14:36 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-391ccd75-5ce9-449a-a872-5d6e477f931f tempest-VolumeDependencyTests-1091358234 None] Lock "cinder-quobyte-49c66d3b-652c-46ee-a4bf-18eb337449d9" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:14:36 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-391ccd75-5ce9-449a-a872-5d6e477f931f tempest-VolumeDependencyTests-1091358234 None] snapshot: 79ce875e-5d87-4cc7-b6f3-367d6290909d, volume: 49c66d3b-652c-46ee-a4bf-18eb337449d9, {{(pid=86890) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 10:14:36 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-391ccd75-5ce9-449a-a872-5d6e477f931f tempest-VolumeDependencyTests-1091358234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:14:36 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-391ccd75-5ce9-449a-a872-5d6e477f931f tempest-VolumeDependencyTests-1091358234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:14:36 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-391ccd75-5ce9-449a-a872-5d6e477f931f tempest-VolumeDependencyTests-1091358234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:14:36 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-391ccd75-5ce9-449a-a872-5d6e477f931f tempest-VolumeDependencyTests-1091358234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:14:36 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-391ccd75-5ce9-449a-a872-5d6e477f931f tempest-VolumeDependencyTests-1091358234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:14:36 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed5ccc3e-8f15-4da1-ac19-8f35673238d4]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:14:36 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-391ccd75-5ce9-449a-a872-5d6e477f931f tempest-VolumeDependencyTests-1091358234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-25f2b8b3-0f12-47bc-88c6-f08e32b109ca.79ce875e-5d87-4cc7-b6f3-367d6290909d {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:36 devstack sudo[98671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-25f2b8b3-0f12-47bc-88c6-f08e32b109ca.79ce875e-5d87-4cc7-b6f3-367d6290909d Nov 02 10:14:36 devstack sudo[98671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:36 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-2354f144-a153-4318-ab93-7f964ab0d304 tempest-VolumeRetypeWithoutMigrationTest-6285476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:14:36 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-2354f144-a153-4318-ab93-7f964ab0d304 tempest-VolumeRetypeWithoutMigrationTest-6285476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:14:36 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-2354f144-a153-4318-ab93-7f964ab0d304 tempest-VolumeRetypeWithoutMigrationTest-6285476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:14:36 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-2354f144-a153-4318-ab93-7f964ab0d304 tempest-VolumeRetypeWithoutMigrationTest-6285476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:14:36 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-2354f144-a153-4318-ab93-7f964ab0d304 tempest-VolumeRetypeWithoutMigrationTest-6285476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:14:36 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-2354f144-a153-4318-ab93-7f964ab0d304 tempest-VolumeRetypeWithoutMigrationTest-6285476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:36 devstack sudo[98673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:14:36 devstack sudo[98673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:36 devstack sudo[98673]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:36 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-2354f144-a153-4318-ab93-7f964ab0d304 tempest-VolumeRetypeWithoutMigrationTest-6285476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.321s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:36 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-2354f144-a153-4318-ab93-7f964ab0d304 tempest-VolumeRetypeWithoutMigrationTest-6285476 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:14:36 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-2354f144-a153-4318-ab93-7f964ab0d304 tempest-VolumeRetypeWithoutMigrationTest-6285476 None] Retype volume completed successfully. Nov 02 10:14:36 devstack sudo[98671]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:36 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-391ccd75-5ce9-449a-a872-5d6e477f931f tempest-VolumeDependencyTests-1091358234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-25f2b8b3-0f12-47bc-88c6-f08e32b109ca.79ce875e-5d87-4cc7-b6f3-367d6290909d" returned: 0 in 0.545s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:36 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-391ccd75-5ce9-449a-a872-5d6e477f931f tempest-VolumeDependencyTests-1091358234 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-25f2b8b3-0f12-47bc-88c6-f08e32b109ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86890) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:14:36 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ec32979-029d-4f61-897e-b6a2f7b00e46]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:14:36 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-391ccd75-5ce9-449a-a872-5d6e477f931f tempest-VolumeDependencyTests-1091358234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-25f2b8b3-0f12-47bc-88c6-f08e32b109ca {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:36 devstack sudo[98680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-25f2b8b3-0f12-47bc-88c6-f08e32b109ca Nov 02 10:14:36 devstack sudo[98680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:37 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-58cf80c6-575f-485c-ab47-22efcbdaec81 tempest-VolumesTransfersV355Test-1166650307 None] Transfer volume completed successfully. Nov 02 10:14:37 devstack sudo[98680]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:37 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-391ccd75-5ce9-449a-a872-5d6e477f931f tempest-VolumeDependencyTests-1091358234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-25f2b8b3-0f12-47bc-88c6-f08e32b109ca" returned: 0 in 0.420s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:37 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-391ccd75-5ce9-449a-a872-5d6e477f931f tempest-VolumeDependencyTests-1091358234 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-25f2b8b3-0f12-47bc-88c6-f08e32b109ca {{(pid=86890) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 10:14:37 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-391ccd75-5ce9-449a-a872-5d6e477f931f tempest-VolumeDependencyTests-1091358234 None] Creating direct copy from snapshot {{(pid=86890) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 10:14:37 devstack cinder-volume[86890]: DEBUG cinder.utils [None req-391ccd75-5ce9-449a-a872-5d6e477f931f tempest-VolumeDependencyTests-1091358234 None] Path /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-49c66d3b-652c-46ee-a4bf-18eb337449d9 not found in is_blk_device check {{(pid=86890) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 10:14:37 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-391ccd75-5ce9-449a-a872-5d6e477f931f tempest-VolumeDependencyTests-1091358234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-25f2b8b3-0f12-47bc-88c6-f08e32b109ca /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-49c66d3b-652c-46ee-a4bf-18eb337449d9 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:37 devstack sudo[98685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-25f2b8b3-0f12-47bc-88c6-f08e32b109ca /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-49c66d3b-652c-46ee-a4bf-18eb337449d9 Nov 02 10:14:37 devstack sudo[98685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:37 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-b7b998e1-86f3-4c86-af7e-080f0637a28d tempest-VolumeRetypeWithoutMigrationTest-6285476 None] Acquiring lock "cinder-7a242f98-eb6f-431b-87c8-f3684409e8e3-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:14:37 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-b7b998e1-86f3-4c86-af7e-080f0637a28d tempest-VolumeRetypeWithoutMigrationTest-6285476 None] Lock "cinder-7a242f98-eb6f-431b-87c8-f3684409e8e3-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:14:37 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-c2458990-0f35-4c59-9eae-e54aa8e5be94 tempest-VolumesTransfersV355Test-1844895643 None] Acquiring lock "cinder-8fc2926b-488c-4e42-abf6-18434671962c-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:14:37 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-b7b998e1-86f3-4c86-af7e-080f0637a28d tempest-VolumeRetypeWithoutMigrationTest-6285476 None] Acquiring lock "cinder-quobyte-7a242f98-eb6f-431b-87c8-f3684409e8e3" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:14:37 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-c2458990-0f35-4c59-9eae-e54aa8e5be94 tempest-VolumesTransfersV355Test-1844895643 None] Lock "cinder-8fc2926b-488c-4e42-abf6-18434671962c-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:14:38 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-b7b998e1-86f3-4c86-af7e-080f0637a28d tempest-VolumeRetypeWithoutMigrationTest-6285476 None] Lock "cinder-quobyte-7a242f98-eb6f-431b-87c8-f3684409e8e3" acquired by "delete_volume" :: waited 0.064s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:14:38 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fe33ed8-4b1f-4052-98f5-0c4d9aa1cb20]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:14:38 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-b7b998e1-86f3-4c86-af7e-080f0637a28d tempest-VolumeRetypeWithoutMigrationTest-6285476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-7a242f98-eb6f-431b-87c8-f3684409e8e3 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:38 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-c2458990-0f35-4c59-9eae-e54aa8e5be94 tempest-VolumesTransfersV355Test-1844895643 None] Acquiring lock "cinder-quobyte-8fc2926b-488c-4e42-abf6-18434671962c" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:14:38 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-c2458990-0f35-4c59-9eae-e54aa8e5be94 tempest-VolumesTransfersV355Test-1844895643 None] Lock "cinder-quobyte-8fc2926b-488c-4e42-abf6-18434671962c" acquired by "delete_volume" :: waited 0.046s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:14:38 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[c193cf90-dbdc-4e99-88b0-51474842327d]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:14:38 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c2458990-0f35-4c59-9eae-e54aa8e5be94 tempest-VolumesTransfersV355Test-1844895643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-8fc2926b-488c-4e42-abf6-18434671962c {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:38 devstack sudo[98698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-7a242f98-eb6f-431b-87c8-f3684409e8e3 Nov 02 10:14:38 devstack sudo[98698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:38 devstack sudo[98699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-8fc2926b-488c-4e42-abf6-18434671962c Nov 02 10:14:38 devstack sudo[98699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:39 devstack sudo[98698]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:39 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-b7b998e1-86f3-4c86-af7e-080f0637a28d tempest-VolumeRetypeWithoutMigrationTest-6285476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-7a242f98-eb6f-431b-87c8-f3684409e8e3" returned: 0 in 0.895s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:39 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-b7b998e1-86f3-4c86-af7e-080f0637a28d tempest-VolumeRetypeWithoutMigrationTest-6285476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-7a242f98-eb6f-431b-87c8-f3684409e8e3 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:39 devstack sudo[98707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-7a242f98-eb6f-431b-87c8-f3684409e8e3 Nov 02 10:14:39 devstack sudo[98707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:39 devstack sudo[98699]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:39 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c2458990-0f35-4c59-9eae-e54aa8e5be94 tempest-VolumesTransfersV355Test-1844895643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-8fc2926b-488c-4e42-abf6-18434671962c" returned: 0 in 0.850s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:39 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c2458990-0f35-4c59-9eae-e54aa8e5be94 tempest-VolumesTransfersV355Test-1844895643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-8fc2926b-488c-4e42-abf6-18434671962c {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:39 devstack sudo[98710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-8fc2926b-488c-4e42-abf6-18434671962c Nov 02 10:14:39 devstack sudo[98710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:39 devstack sudo[98707]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:39 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-b7b998e1-86f3-4c86-af7e-080f0637a28d tempest-VolumeRetypeWithoutMigrationTest-6285476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-7a242f98-eb6f-431b-87c8-f3684409e8e3" returned: 0 in 0.435s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:39 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-b7b998e1-86f3-4c86-af7e-080f0637a28d tempest-VolumeRetypeWithoutMigrationTest-6285476 None] Lock "cinder-quobyte-7a242f98-eb6f-431b-87c8-f3684409e8e3" released by "delete_volume" :: held 1.472s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:14:39 devstack cinder-volume[86890]: WARNING cinder.quota [None req-b7b998e1-86f3-4c86-af7e-080f0637a28d tempest-VolumeRetypeWithoutMigrationTest-6285476 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:14:39 devstack cinder-volume[86890]: WARNING cinder.quota [None req-b7b998e1-86f3-4c86-af7e-080f0637a28d tempest-VolumeRetypeWithoutMigrationTest-6285476 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:14:39 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-b7b998e1-86f3-4c86-af7e-080f0637a28d tempest-VolumeRetypeWithoutMigrationTest-6285476 None] Created reservations ['7b93a9dd-a916-441e-be18-55c182d84527', '605aec71-ec20-4f5e-ab4c-66cbbc896fdf', '49f7870a-03d1-4569-9937-d40ad6f82660', 'b0b7ca95-c039-487a-9459-871bac3530ab'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:14:39 devstack sudo[98710]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:39 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c2458990-0f35-4c59-9eae-e54aa8e5be94 tempest-VolumesTransfersV355Test-1844895643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-8fc2926b-488c-4e42-abf6-18434671962c" returned: 0 in 0.588s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:39 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-c2458990-0f35-4c59-9eae-e54aa8e5be94 tempest-VolumesTransfersV355Test-1844895643 None] Lock "cinder-quobyte-8fc2926b-488c-4e42-abf6-18434671962c" released by "delete_volume" :: held 1.576s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:14:39 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-b7b998e1-86f3-4c86-af7e-080f0637a28d tempest-VolumeRetypeWithoutMigrationTest-6285476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:14:39 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-b7b998e1-86f3-4c86-af7e-080f0637a28d tempest-VolumeRetypeWithoutMigrationTest-6285476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:14:39 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-b7b998e1-86f3-4c86-af7e-080f0637a28d tempest-VolumeRetypeWithoutMigrationTest-6285476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:14:39 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-b7b998e1-86f3-4c86-af7e-080f0637a28d tempest-VolumeRetypeWithoutMigrationTest-6285476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:14:39 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-b7b998e1-86f3-4c86-af7e-080f0637a28d tempest-VolumeRetypeWithoutMigrationTest-6285476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:14:39 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-b7b998e1-86f3-4c86-af7e-080f0637a28d tempest-VolumeRetypeWithoutMigrationTest-6285476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:39 devstack sudo[98714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:14:39 devstack sudo[98714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:40 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-c2458990-0f35-4c59-9eae-e54aa8e5be94 tempest-VolumesTransfersV355Test-1844895643 None] Created reservations ['04227baa-436f-4ba5-b8b4-e817cf032114', '3b82cf93-fbb8-46d0-a638-6dcc63171e77', '4a4cb914-a0e1-4d1e-8a3c-766cf47d6309', '29dcef4d-0ea0-4bed-aa51-f3b9673efaee'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:14:40 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c2458990-0f35-4c59-9eae-e54aa8e5be94 tempest-VolumesTransfersV355Test-1844895643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:14:40 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c2458990-0f35-4c59-9eae-e54aa8e5be94 tempest-VolumesTransfersV355Test-1844895643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:14:40 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c2458990-0f35-4c59-9eae-e54aa8e5be94 tempest-VolumesTransfersV355Test-1844895643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:14:40 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c2458990-0f35-4c59-9eae-e54aa8e5be94 tempest-VolumesTransfersV355Test-1844895643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:14:40 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c2458990-0f35-4c59-9eae-e54aa8e5be94 tempest-VolumesTransfersV355Test-1844895643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:14:40 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c2458990-0f35-4c59-9eae-e54aa8e5be94 tempest-VolumesTransfersV355Test-1844895643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:40 devstack sudo[98717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:14:40 devstack sudo[98717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:40 devstack sudo[98714]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:40 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-b7b998e1-86f3-4c86-af7e-080f0637a28d tempest-VolumeRetypeWithoutMigrationTest-6285476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.718s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:40 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-b7b998e1-86f3-4c86-af7e-080f0637a28d tempest-VolumeRetypeWithoutMigrationTest-6285476 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:14:40 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-b7b998e1-86f3-4c86-af7e-080f0637a28d tempest-VolumeRetypeWithoutMigrationTest-6285476 None] Deleted volume successfully. Nov 02 10:14:40 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-b7b998e1-86f3-4c86-af7e-080f0637a28d tempest-VolumeRetypeWithoutMigrationTest-6285476 None] Lock "cinder-7a242f98-eb6f-431b-87c8-f3684409e8e3-delete_volume" released by "delete_volume" :: held 2.851s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:14:41 devstack sudo[98717]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:41 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c2458990-0f35-4c59-9eae-e54aa8e5be94 tempest-VolumesTransfersV355Test-1844895643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.754s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:41 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-c2458990-0f35-4c59-9eae-e54aa8e5be94 tempest-VolumesTransfersV355Test-1844895643 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:14:41 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-c2458990-0f35-4c59-9eae-e54aa8e5be94 tempest-VolumesTransfersV355Test-1844895643 None] Deleted volume successfully. Nov 02 10:14:41 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-c2458990-0f35-4c59-9eae-e54aa8e5be94 tempest-VolumesTransfersV355Test-1844895643 None] Lock "cinder-8fc2926b-488c-4e42-abf6-18434671962c-delete_volume" released by "delete_volume" :: held 3.119s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:14:41 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-37c99c8d-6767-4848-bf82-f01c1f3140ec tempest-VolumesTransfersV355Test-966853260 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:14:42 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-37c99c8d-6767-4848-bf82-f01c1f3140ec tempest-VolumesTransfersV355Test-966853260 None] Flow 'volume_create_manager' (a5d362e6-306e-463d-8b8f-97c101596d79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:14:42 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-37c99c8d-6767-4848-bf82-f01c1f3140ec tempest-VolumesTransfersV355Test-966853260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b11fe810-5263-4c10-9c1e-314afca2f6b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:14:42 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-37c99c8d-6767-4848-bf82-f01c1f3140ec tempest-VolumesTransfersV355Test-966853260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b11fe810-5263-4c10-9c1e-314afca2f6b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:14:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1313317584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0dc030b-f22c-4565-aa63-ff3c557faa66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cc7b5f2d6394ac79e865a76605b5a9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:14:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:14:42Z,use_quota=True,user_id='d061c0cdd2014c68a58d6bfb1e901fd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:14:42 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-37c99c8d-6767-4848-bf82-f01c1f3140ec tempest-VolumesTransfersV355Test-966853260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b61bc9d-d3b3-490b-9296-0753a3094356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:14:42 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-37c99c8d-6767-4848-bf82-f01c1f3140ec tempest-VolumesTransfersV355Test-966853260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b61bc9d-d3b3-490b-9296-0753a3094356) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:14:42 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-37c99c8d-6767-4848-bf82-f01c1f3140ec tempest-VolumesTransfersV355Test-966853260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ef89f4c-2e9d-48fc-a1d4-b58ce963bc24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:14:42 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-37c99c8d-6767-4848-bf82-f01c1f3140ec tempest-VolumesTransfersV355Test-966853260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ef89f4c-2e9d-48fc-a1d4-b58ce963bc24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0dc030b-f22c-4565-aa63-ff3c557faa66', 'volume_name': 'volume-e0dc030b-f22c-4565-aa63-ff3c557faa66', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:14:42 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-37c99c8d-6767-4848-bf82-f01c1f3140ec tempest-VolumesTransfersV355Test-966853260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a2744df-a81b-4e4b-983f-f4419a361ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:14:42 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-37c99c8d-6767-4848-bf82-f01c1f3140ec tempest-VolumesTransfersV355Test-966853260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a2744df-a81b-4e4b-983f-f4419a361ba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:14:42 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-37c99c8d-6767-4848-bf82-f01c1f3140ec tempest-VolumesTransfersV355Test-966853260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (597279f3-b08f-437e-9839-207ad1129267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:14:42 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-37c99c8d-6767-4848-bf82-f01c1f3140ec tempest-VolumesTransfersV355Test-966853260 None] Volume e0dc030b-f22c-4565-aa63-ff3c557faa66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0dc030b-f22c-4565-aa63-ff3c557faa66', 'volume_size': 1} Nov 02 10:14:42 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-37c99c8d-6767-4848-bf82-f01c1f3140ec tempest-VolumesTransfersV355Test-966853260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:14:46 devstack sudo[98685]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:46 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-391ccd75-5ce9-449a-a872-5d6e477f931f tempest-VolumeDependencyTests-1091358234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-25f2b8b3-0f12-47bc-88c6-f08e32b109ca /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-49c66d3b-652c-46ee-a4bf-18eb337449d9" returned: 0 in 8.867s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:46 devstack cinder-volume[86890]: DEBUG cinder.image.image_utils [None req-391ccd75-5ce9-449a-a872-5d6e477f931f tempest-VolumeDependencyTests-1091358234 None] Image conversion details: src /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-25f2b8b3-0f12-47bc-88c6-f08e32b109ca, size 1024.00 MB, duration 8.87 sec, destination /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-49c66d3b-652c-46ee-a4bf-18eb337449d9 {{(pid=86890) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 10:14:46 devstack cinder-volume[86890]: INFO cinder.image.image_utils [None req-391ccd75-5ce9-449a-a872-5d6e477f931f tempest-VolumeDependencyTests-1091358234 None] Converted 1024.00 MB image at 115.48 MB/s Nov 02 10:14:46 devstack cinder-volume[86890]: WARNING cinder.volume.drivers.remotefs [None req-391ccd75-5ce9-449a-a872-5d6e477f931f tempest-VolumeDependencyTests-1091358234 None] /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-49c66d3b-652c-46ee-a4bf-18eb337449d9 is being set with open permissions: ugo+rw Nov 02 10:14:46 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-391ccd75-5ce9-449a-a872-5d6e477f931f tempest-VolumeDependencyTests-1091358234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-49c66d3b-652c-46ee-a4bf-18eb337449d9 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:46 devstack sudo[98723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-49c66d3b-652c-46ee-a4bf-18eb337449d9 Nov 02 10:14:46 devstack sudo[98723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:46 devstack sudo[98723]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:46 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-391ccd75-5ce9-449a-a872-5d6e477f931f tempest-VolumeDependencyTests-1091358234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-49c66d3b-652c-46ee-a4bf-18eb337449d9" returned: 0 in 0.288s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:46 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-391ccd75-5ce9-449a-a872-5d6e477f931f tempest-VolumeDependencyTests-1091358234 None] Lock "cinder-quobyte-49c66d3b-652c-46ee-a4bf-18eb337449d9" released by "_copy_volume_from_snapshot" :: held 10.258s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:14:46 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-391ccd75-5ce9-449a-a872-5d6e477f931f tempest-VolumeDependencyTests-1091358234 None] Lock "cinder-quobyte-79ce875e-5d87-4cc7-b6f3-367d6290909d-49c66d3b-652c-46ee-a4bf-18eb337449d9" released by "_create_volume_from_snapshot" :: held 10.344s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:14:46 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-391ccd75-5ce9-449a-a872-5d6e477f931f tempest-VolumeDependencyTests-1091358234 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.378s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:14:46 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-37c99c8d-6767-4848-bf82-f01c1f3140ec tempest-VolumesTransfersV355Test-966853260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.195s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:14:46 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-37c99c8d-6767-4848-bf82-f01c1f3140ec tempest-VolumesTransfersV355Test-966853260 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:14:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1313317584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0dc030b-f22c-4565-aa63-ff3c557faa66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cc7b5f2d6394ac79e865a76605b5a9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:14:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:14:42Z,use_quota=True,user_id='d061c0cdd2014c68a58d6bfb1e901fd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:14:46 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-37c99c8d-6767-4848-bf82-f01c1f3140ec tempest-VolumesTransfersV355Test-966853260 None] Creating volume e0dc030b-f22c-4565-aa63-ff3c557faa66 {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:14:46 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-37c99c8d-6767-4848-bf82-f01c1f3140ec tempest-VolumesTransfersV355Test-966853260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:14:46 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-37c99c8d-6767-4848-bf82-f01c1f3140ec tempest-VolumesTransfersV355Test-966853260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:14:46 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-37c99c8d-6767-4848-bf82-f01c1f3140ec tempest-VolumesTransfersV355Test-966853260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:14:46 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-37c99c8d-6767-4848-bf82-f01c1f3140ec tempest-VolumesTransfersV355Test-966853260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:14:46 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-37c99c8d-6767-4848-bf82-f01c1f3140ec tempest-VolumesTransfersV355Test-966853260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:14:46 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-37c99c8d-6767-4848-bf82-f01c1f3140ec tempest-VolumesTransfersV355Test-966853260 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:14:46 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-37c99c8d-6767-4848-bf82-f01c1f3140ec tempest-VolumesTransfersV355Test-966853260 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:14:46 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-37c99c8d-6767-4848-bf82-f01c1f3140ec tempest-VolumesTransfersV355Test-966853260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e0dc030b-f22c-4565-aa63-ff3c557faa66 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:46 devstack sudo[98726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e0dc030b-f22c-4565-aa63-ff3c557faa66 1073741824 Nov 02 10:14:46 devstack sudo[98726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:46 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-391ccd75-5ce9-449a-a872-5d6e477f931f tempest-VolumeDependencyTests-1091358234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab280c32-5b59-4f6e-8386-401f0d3a86cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49c66d3b-652c-46ee-a4bf-18eb337449d9', 'volume_size': 1, 'snapshot_id': '79ce875e-5d87-4cc7-b6f3-367d6290909d'}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:14:46 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-391ccd75-5ce9-449a-a872-5d6e477f931f tempest-VolumeDependencyTests-1091358234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f93cf533-08f5-45e0-bb34-ae1e0086c3ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:14:46 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-391ccd75-5ce9-449a-a872-5d6e477f931f tempest-VolumeDependencyTests-1091358234 None] Volume volume-49c66d3b-652c-46ee-a4bf-18eb337449d9 (49c66d3b-652c-46ee-a4bf-18eb337449d9): created successfully Nov 02 10:14:46 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-391ccd75-5ce9-449a-a872-5d6e477f931f tempest-VolumeDependencyTests-1091358234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f93cf533-08f5-45e0-bb34-ae1e0086c3ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:14:46 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-391ccd75-5ce9-449a-a872-5d6e477f931f tempest-VolumeDependencyTests-1091358234 None] Flow 'volume_create_manager' (e8061008-8cad-4c69-ac02-05e2234070f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:14:46 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-391ccd75-5ce9-449a-a872-5d6e477f931f tempest-VolumeDependencyTests-1091358234 None] Created volume successfully. Nov 02 10:14:47 devstack sudo[98726]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:47 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-37c99c8d-6767-4848-bf82-f01c1f3140ec tempest-VolumesTransfersV355Test-966853260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e0dc030b-f22c-4565-aa63-ff3c557faa66 1073741824" returned: 0 in 0.564s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:47 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-37c99c8d-6767-4848-bf82-f01c1f3140ec tempest-VolumesTransfersV355Test-966853260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e0dc030b-f22c-4565-aa63-ff3c557faa66 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:47 devstack sudo[98732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e0dc030b-f22c-4565-aa63-ff3c557faa66 Nov 02 10:14:47 devstack sudo[98732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:47 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-5ebcd742-3ea5-4bc0-8731-89286b3ce029 tempest-VolumeDependencyTests-1091358234 None] Acquiring lock "cinder-79ce875e-5d87-4cc7-b6f3-367d6290909d-delete_snapshot" by "delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:14:47 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-5ebcd742-3ea5-4bc0-8731-89286b3ce029 tempest-VolumeDependencyTests-1091358234 None] Lock "cinder-79ce875e-5d87-4cc7-b6f3-367d6290909d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:14:47 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-5ebcd742-3ea5-4bc0-8731-89286b3ce029 tempest-VolumeDependencyTests-1091358234 None] Acquiring lock "cinder-quobyte-25f2b8b3-0f12-47bc-88c6-f08e32b109ca" by "delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:14:47 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-5ebcd742-3ea5-4bc0-8731-89286b3ce029 tempest-VolumeDependencyTests-1091358234 None] Lock "cinder-quobyte-25f2b8b3-0f12-47bc-88c6-f08e32b109ca" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:14:47 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-5ebcd742-3ea5-4bc0-8731-89286b3ce029 tempest-VolumeDependencyTests-1091358234 None] Acquiring lock "cinder-quobyte-79ce875e-5d87-4cc7-b6f3-367d6290909d" by "_delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:14:47 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-5ebcd742-3ea5-4bc0-8731-89286b3ce029 tempest-VolumeDependencyTests-1091358234 None] Lock "cinder-quobyte-79ce875e-5d87-4cc7-b6f3-367d6290909d" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:14:47 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-5ebcd742-3ea5-4bc0-8731-89286b3ce029 tempest-VolumeDependencyTests-1091358234 None] Deleting offline snapshot 79ce875e-5d87-4cc7-b6f3-367d6290909d of volume 25f2b8b3-0f12-47bc-88c6-f08e32b109ca {{(pid=86890) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:14:47 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-5ebcd742-3ea5-4bc0-8731-89286b3ce029 tempest-VolumeDependencyTests-1091358234 None] snapshot_file for this snap is: volume-25f2b8b3-0f12-47bc-88c6-f08e32b109ca.79ce875e-5d87-4cc7-b6f3-367d6290909d {{(pid=86890) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:14:47 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6e3ad91-6f1d-4a84-b871-87d78b93a09b]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:14:47 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-5ebcd742-3ea5-4bc0-8731-89286b3ce029 tempest-VolumeDependencyTests-1091358234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-25f2b8b3-0f12-47bc-88c6-f08e32b109ca.79ce875e-5d87-4cc7-b6f3-367d6290909d {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:47 devstack sudo[98732]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:47 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-37c99c8d-6767-4848-bf82-f01c1f3140ec tempest-VolumesTransfersV355Test-966853260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e0dc030b-f22c-4565-aa63-ff3c557faa66" returned: 0 in 0.368s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:47 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-37c99c8d-6767-4848-bf82-f01c1f3140ec tempest-VolumesTransfersV355Test-966853260 None] <== create_volume: return (986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:14:47 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-37c99c8d-6767-4848-bf82-f01c1f3140ec tempest-VolumesTransfersV355Test-966853260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.989s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:14:47 devstack sudo[98734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-25f2b8b3-0f12-47bc-88c6-f08e32b109ca.79ce875e-5d87-4cc7-b6f3-367d6290909d Nov 02 10:14:47 devstack sudo[98734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:47 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-37c99c8d-6767-4848-bf82-f01c1f3140ec tempest-VolumesTransfersV355Test-966853260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (597279f3-b08f-437e-9839-207ad1129267) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0dc030b-f22c-4565-aa63-ff3c557faa66', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:14:47 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-37c99c8d-6767-4848-bf82-f01c1f3140ec tempest-VolumesTransfersV355Test-966853260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d39bbb9-2d2a-40e5-8eb9-479f599c8d2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:14:47 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-37c99c8d-6767-4848-bf82-f01c1f3140ec tempest-VolumesTransfersV355Test-966853260 None] Volume volume-e0dc030b-f22c-4565-aa63-ff3c557faa66 (e0dc030b-f22c-4565-aa63-ff3c557faa66): created successfully Nov 02 10:14:47 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-37c99c8d-6767-4848-bf82-f01c1f3140ec tempest-VolumesTransfersV355Test-966853260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d39bbb9-2d2a-40e5-8eb9-479f599c8d2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:14:47 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-37c99c8d-6767-4848-bf82-f01c1f3140ec tempest-VolumesTransfersV355Test-966853260 None] Flow 'volume_create_manager' (a5d362e6-306e-463d-8b8f-97c101596d79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:14:47 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-37c99c8d-6767-4848-bf82-f01c1f3140ec tempest-VolumesTransfersV355Test-966853260 None] Created volume successfully. Nov 02 10:14:47 devstack sudo[98734]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:47 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-5ebcd742-3ea5-4bc0-8731-89286b3ce029 tempest-VolumeDependencyTests-1091358234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-25f2b8b3-0f12-47bc-88c6-f08e32b109ca.79ce875e-5d87-4cc7-b6f3-367d6290909d" returned: 0 in 0.458s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:47 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-5ebcd742-3ea5-4bc0-8731-89286b3ce029 tempest-VolumeDependencyTests-1091358234 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-25f2b8b3-0f12-47bc-88c6-f08e32b109ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86890) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:14:47 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6a012fb-7271-423e-bbad-9456ca12efaf]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:14:47 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-5ebcd742-3ea5-4bc0-8731-89286b3ce029 tempest-VolumeDependencyTests-1091358234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-25f2b8b3-0f12-47bc-88c6-f08e32b109ca {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:47 devstack sudo[98740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-25f2b8b3-0f12-47bc-88c6-f08e32b109ca Nov 02 10:14:47 devstack sudo[98740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:48 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-813c0be4-3381-438a-a3be-3223aa733bf8 tempest-VolumesExtendTest-1257807882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:14:48 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-813c0be4-3381-438a-a3be-3223aa733bf8 tempest-VolumesExtendTest-1257807882 None] Flow 'volume_create_manager' (f20c7b74-1754-4eac-a114-04dbbff99047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:14:48 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-813c0be4-3381-438a-a3be-3223aa733bf8 tempest-VolumesExtendTest-1257807882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf2df18d-dc55-4938-b5a7-90dae610fd8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:14:48 devstack sudo[98740]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:48 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-5ebcd742-3ea5-4bc0-8731-89286b3ce029 tempest-VolumeDependencyTests-1091358234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-25f2b8b3-0f12-47bc-88c6-f08e32b109ca" returned: 0 in 0.723s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:48 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-5ebcd742-3ea5-4bc0-8731-89286b3ce029 tempest-VolumeDependencyTests-1091358234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-25f2b8b3-0f12-47bc-88c6-f08e32b109ca.79ce875e-5d87-4cc7-b6f3-367d6290909d {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:48 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-813c0be4-3381-438a-a3be-3223aa733bf8 tempest-VolumesExtendTest-1257807882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf2df18d-dc55-4938-b5a7-90dae610fd8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:14:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-594164156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be8f3e05-f24d-41dd-8001-891488fbc966,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c57ea8090d854f5ea2d08d7f8d6d32b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:14:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:14:48Z,use_quota=True,user_id='2dc6eca44ea9448f84c1278930fc43b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:14:48 devstack sudo[98745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-25f2b8b3-0f12-47bc-88c6-f08e32b109ca.79ce875e-5d87-4cc7-b6f3-367d6290909d Nov 02 10:14:48 devstack sudo[98745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:48 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-813c0be4-3381-438a-a3be-3223aa733bf8 tempest-VolumesExtendTest-1257807882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (284cfadf-b9f6-42df-9d58-2e0eb678c8b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:14:48 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-813c0be4-3381-438a-a3be-3223aa733bf8 tempest-VolumesExtendTest-1257807882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (284cfadf-b9f6-42df-9d58-2e0eb678c8b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:14:48 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-813c0be4-3381-438a-a3be-3223aa733bf8 tempest-VolumesExtendTest-1257807882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4fe81eb-6035-4fe0-9367-2858ceb0d83c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:14:48 devstack cinder-volume[86890]: DEBUG cinder.image.glance [None req-813c0be4-3381-438a-a3be-3223aa733bf8 tempest-VolumesExtendTest-1257807882 None] Creating Keystone auth plugin from conf {{(pid=86890) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 10:14:48 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-91986162-087b-4f2c-81b1-6d39d5a518c6 tempest-VolumesTransfersV355Test-1844895643 None] Acquiring lock "cinder-e0dc030b-f22c-4565-aa63-ff3c557faa66-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:14:48 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-91986162-087b-4f2c-81b1-6d39d5a518c6 tempest-VolumesTransfersV355Test-1844895643 None] Lock "cinder-e0dc030b-f22c-4565-aa63-ff3c557faa66-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:14:48 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-91986162-087b-4f2c-81b1-6d39d5a518c6 tempest-VolumesTransfersV355Test-1844895643 None] Acquiring lock "cinder-quobyte-e0dc030b-f22c-4565-aa63-ff3c557faa66" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:14:48 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-91986162-087b-4f2c-81b1-6d39d5a518c6 tempest-VolumesTransfersV355Test-1844895643 None] Lock "cinder-quobyte-e0dc030b-f22c-4565-aa63-ff3c557faa66" acquired by "delete_volume" :: waited 0.025s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:14:49 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[68cc2170-2e8b-47a4-a52e-1739c19e376b]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:14:49 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-91986162-087b-4f2c-81b1-6d39d5a518c6 tempest-VolumesTransfersV355Test-1844895643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e0dc030b-f22c-4565-aa63-ff3c557faa66 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:49 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-813c0be4-3381-438a-a3be-3223aa733bf8 tempest-VolumesExtendTest-1257807882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4fe81eb-6035-4fe0-9367-2858ceb0d83c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'be8f3e05-f24d-41dd-8001-891488fbc966', 'volume_name': 'volume-be8f3e05-f24d-41dd-8001-891488fbc966', 'volume_size': 1, 'image_id': '7a393fa7-4879-486c-8216-4d35448485cf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7a393fa7-4879-486c-8216-4d35448485cf', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '606cf27a36794aa3805ebe6d987aa1a4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7a393fa7-4879-486c-8216-4d35448485cf', 'created_at': datetime.datetime(2026, 11, 2, 8, 55, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 8, 55, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7a393fa7-4879-486c-8216-4d35448485cf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:14:49 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-813c0be4-3381-438a-a3be-3223aa733bf8 tempest-VolumesExtendTest-1257807882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b78cba1-70e7-4244-9c29-83c8381a7662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:14:49 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-813c0be4-3381-438a-a3be-3223aa733bf8 tempest-VolumesExtendTest-1257807882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b78cba1-70e7-4244-9c29-83c8381a7662) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:14:49 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-813c0be4-3381-438a-a3be-3223aa733bf8 tempest-VolumesExtendTest-1257807882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df181781-989b-4324-a5bb-a26befc91e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:14:49 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-813c0be4-3381-438a-a3be-3223aa733bf8 tempest-VolumesExtendTest-1257807882 None] Volume be8f3e05-f24d-41dd-8001-891488fbc966: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-be8f3e05-f24d-41dd-8001-891488fbc966', 'volume_size': 1, 'image_id': '7a393fa7-4879-486c-8216-4d35448485cf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7a393fa7-4879-486c-8216-4d35448485cf', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '606cf27a36794aa3805ebe6d987aa1a4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7a393fa7-4879-486c-8216-4d35448485cf', 'created_at': datetime.datetime(2026, 11, 2, 8, 55, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 8, 55, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7a393fa7-4879-486c-8216-4d35448485cf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 02 10:14:49 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-813c0be4-3381-438a-a3be-3223aa733bf8 tempest-VolumesExtendTest-1257807882 None] Trying to clone be8f3e05-f24d-41dd-8001-891488fbc966 from image 7a393fa7-4879-486c-8216-4d35448485cf at location (None, [{'url': 'file:///opt/stack/data/glance/images/7a393fa7-4879-486c-8216-4d35448485cf', 'metadata': {}}]). {{(pid=86890) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 02 10:14:49 devstack sudo[98745]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:49 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-5ebcd742-3ea5-4bc0-8731-89286b3ce029 tempest-VolumeDependencyTests-1091358234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-25f2b8b3-0f12-47bc-88c6-f08e32b109ca.79ce875e-5d87-4cc7-b6f3-367d6290909d" returned: 0 in 0.551s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:49 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-5ebcd742-3ea5-4bc0-8731-89286b3ce029 tempest-VolumeDependencyTests-1091358234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-25f2b8b3-0f12-47bc-88c6-f08e32b109ca.79ce875e-5d87-4cc7-b6f3-367d6290909d {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:49 devstack sudo[98752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-25f2b8b3-0f12-47bc-88c6-f08e32b109ca.79ce875e-5d87-4cc7-b6f3-367d6290909d Nov 02 10:14:49 devstack sudo[98752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:49 devstack sudo[98751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e0dc030b-f22c-4565-aa63-ff3c557faa66 Nov 02 10:14:49 devstack sudo[98751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:49 devstack sudo[98752]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:49 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-5ebcd742-3ea5-4bc0-8731-89286b3ce029 tempest-VolumeDependencyTests-1091358234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-25f2b8b3-0f12-47bc-88c6-f08e32b109ca.79ce875e-5d87-4cc7-b6f3-367d6290909d" returned: 0 in 0.382s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:49 devstack sudo[98751]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:49 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-5ebcd742-3ea5-4bc0-8731-89286b3ce029 tempest-VolumeDependencyTests-1091358234 None] Lock "cinder-quobyte-79ce875e-5d87-4cc7-b6f3-367d6290909d" released by "_delete_snapshot" :: held 2.312s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:14:49 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-91986162-087b-4f2c-81b1-6d39d5a518c6 tempest-VolumesTransfersV355Test-1844895643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e0dc030b-f22c-4565-aa63-ff3c557faa66" returned: 0 in 0.542s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:49 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-91986162-087b-4f2c-81b1-6d39d5a518c6 tempest-VolumesTransfersV355Test-1844895643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e0dc030b-f22c-4565-aa63-ff3c557faa66 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:49 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-5ebcd742-3ea5-4bc0-8731-89286b3ce029 tempest-VolumeDependencyTests-1091358234 None] Lock "cinder-quobyte-25f2b8b3-0f12-47bc-88c6-f08e32b109ca" released by "delete_snapshot" :: held 2.366s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:14:49 devstack sudo[98760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e0dc030b-f22c-4565-aa63-ff3c557faa66 Nov 02 10:14:49 devstack sudo[98760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:49 devstack cinder-volume[86890]: DEBUG cinder.image.image_utils [None req-813c0be4-3381-438a-a3be-3223aa733bf8 tempest-VolumesExtendTest-1257807882 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7a393fa7-4879-486c-8216-4d35448485cf_pbapoqmodevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86890) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 02 10:14:49 devstack cinder-volume[86890]: INFO cinder.image.image_utils [None req-813c0be4-3381-438a-a3be-3223aa733bf8 tempest-VolumesExtendTest-1257807882 None] Image download 20.69 MB at 20.69 MB/s Nov 02 10:14:49 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-5ebcd742-3ea5-4bc0-8731-89286b3ce029 tempest-VolumeDependencyTests-1091358234 None] Created reservations ['d3831050-3537-45b0-8ca8-4180b0989bec', '9fe56c5c-f883-43d5-9956-a92ef0305d70', '5a44011c-c65a-4b64-8b7f-a943b042b7cd', '7ce7764d-ea4a-4a19-b62a-5ce9f2986ca7'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:14:49 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[39687f38-a72e-426d-8dcb-bbf46ecab783]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:14:49 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-813c0be4-3381-438a-a3be-3223aa733bf8 tempest-VolumesExtendTest-1257807882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7a393fa7-4879-486c-8216-4d35448485cf_pbapoqmodevstack@QuobyteHD {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:49 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-5ebcd742-3ea5-4bc0-8731-89286b3ce029 tempest-VolumeDependencyTests-1091358234 None] Delete snapshot completed successfully. Nov 02 10:14:49 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-5ebcd742-3ea5-4bc0-8731-89286b3ce029 tempest-VolumeDependencyTests-1091358234 None] Lock "cinder-79ce875e-5d87-4cc7-b6f3-367d6290909d-delete_snapshot" released by "delete_snapshot" :: held 2.642s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:14:49 devstack sudo[98762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7a393fa7-4879-486c-8216-4d35448485cf_pbapoqmodevstack@QuobyteHD Nov 02 10:14:49 devstack sudo[98762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:49 devstack sudo[98760]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:49 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-91986162-087b-4f2c-81b1-6d39d5a518c6 tempest-VolumesTransfersV355Test-1844895643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e0dc030b-f22c-4565-aa63-ff3c557faa66" returned: 0 in 0.331s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:49 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-91986162-087b-4f2c-81b1-6d39d5a518c6 tempest-VolumesTransfersV355Test-1844895643 None] Lock "cinder-quobyte-e0dc030b-f22c-4565-aa63-ff3c557faa66" released by "delete_volume" :: held 0.943s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:14:49 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-91986162-087b-4f2c-81b1-6d39d5a518c6 tempest-VolumesTransfersV355Test-1844895643 None] Created reservations ['6c38e3b1-7856-45c6-98dc-146355b0c4d9', 'ab83281d-f266-469b-a76e-a7230e629625', '8a9b3cec-5118-4748-a792-86b213cc898b', 'eea9adbe-a407-40d3-a4d4-89c185e5713a'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:14:50 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-91986162-087b-4f2c-81b1-6d39d5a518c6 tempest-VolumesTransfersV355Test-1844895643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:14:50 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-91986162-087b-4f2c-81b1-6d39d5a518c6 tempest-VolumesTransfersV355Test-1844895643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:14:50 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-91986162-087b-4f2c-81b1-6d39d5a518c6 tempest-VolumesTransfersV355Test-1844895643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:14:50 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-91986162-087b-4f2c-81b1-6d39d5a518c6 tempest-VolumesTransfersV355Test-1844895643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:14:50 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-91986162-087b-4f2c-81b1-6d39d5a518c6 tempest-VolumesTransfersV355Test-1844895643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:14:50 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-91986162-087b-4f2c-81b1-6d39d5a518c6 tempest-VolumesTransfersV355Test-1844895643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:50 devstack sudo[98765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:14:50 devstack sudo[98765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:50 devstack sudo[98762]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:50 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-813c0be4-3381-438a-a3be-3223aa733bf8 tempest-VolumesExtendTest-1257807882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7a393fa7-4879-486c-8216-4d35448485cf_pbapoqmodevstack@QuobyteHD" returned: 0 in 0.427s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:50 devstack cinder-volume[86890]: DEBUG cinder.image.image_utils [None req-813c0be4-3381-438a-a3be-3223aa733bf8 tempest-VolumesExtendTest-1257807882 None] Temporary image 7a393fa7-4879-486c-8216-4d35448485cf is fetched for user 2dc6eca44ea9448f84c1278930fc43b9. {{(pid=86890) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 02 10:14:50 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[72ba02df-5b0d-4be4-bfbd-717b6b51f355]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:14:50 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-813c0be4-3381-438a-a3be-3223aa733bf8 tempest-VolumesExtendTest-1257807882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7a393fa7-4879-486c-8216-4d35448485cf_pbapoqmodevstack@QuobyteHD {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:50 devstack sudo[98770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7a393fa7-4879-486c-8216-4d35448485cf_pbapoqmodevstack@QuobyteHD Nov 02 10:14:50 devstack sudo[98770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:50 devstack sudo[98765]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:50 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-91986162-087b-4f2c-81b1-6d39d5a518c6 tempest-VolumesTransfersV355Test-1844895643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.286s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:50 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-91986162-087b-4f2c-81b1-6d39d5a518c6 tempest-VolumesTransfersV355Test-1844895643 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:14:50 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-91986162-087b-4f2c-81b1-6d39d5a518c6 tempest-VolumesTransfersV355Test-1844895643 None] Deleted volume successfully. Nov 02 10:14:50 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-91986162-087b-4f2c-81b1-6d39d5a518c6 tempest-VolumesTransfersV355Test-1844895643 None] Lock "cinder-e0dc030b-f22c-4565-aa63-ff3c557faa66-delete_volume" released by "delete_volume" :: held 1.530s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:14:50 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-57364c9d-e540-43fe-9112-6b3456fe8aec tempest-VolumeDependencyTests-1091358234 None] Acquiring lock "cinder-25f2b8b3-0f12-47bc-88c6-f08e32b109ca-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:14:50 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-57364c9d-e540-43fe-9112-6b3456fe8aec tempest-VolumeDependencyTests-1091358234 None] Lock "cinder-25f2b8b3-0f12-47bc-88c6-f08e32b109ca-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:14:50 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-57364c9d-e540-43fe-9112-6b3456fe8aec tempest-VolumeDependencyTests-1091358234 None] Acquiring lock "cinder-quobyte-25f2b8b3-0f12-47bc-88c6-f08e32b109ca" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:14:50 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-57364c9d-e540-43fe-9112-6b3456fe8aec tempest-VolumeDependencyTests-1091358234 None] Lock "cinder-quobyte-25f2b8b3-0f12-47bc-88c6-f08e32b109ca" acquired by "delete_volume" :: waited 0.025s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:14:50 devstack sudo[98770]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:50 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-813c0be4-3381-438a-a3be-3223aa733bf8 tempest-VolumesExtendTest-1257807882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7a393fa7-4879-486c-8216-4d35448485cf_pbapoqmodevstack@QuobyteHD" returned: 0 in 0.401s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:50 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-813c0be4-3381-438a-a3be-3223aa733bf8 tempest-VolumesExtendTest-1257807882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:14:50 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-813c0be4-3381-438a-a3be-3223aa733bf8 tempest-VolumesExtendTest-1257807882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:14:50 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-813c0be4-3381-438a-a3be-3223aa733bf8 tempest-VolumesExtendTest-1257807882 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:14:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-594164156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be8f3e05-f24d-41dd-8001-891488fbc966,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c57ea8090d854f5ea2d08d7f8d6d32b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:14:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:14:48Z,use_quota=True,user_id='2dc6eca44ea9448f84c1278930fc43b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:14:50 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-813c0be4-3381-438a-a3be-3223aa733bf8 tempest-VolumesExtendTest-1257807882 None] Creating volume be8f3e05-f24d-41dd-8001-891488fbc966 {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:14:50 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-813c0be4-3381-438a-a3be-3223aa733bf8 tempest-VolumesExtendTest-1257807882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:14:50 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-813c0be4-3381-438a-a3be-3223aa733bf8 tempest-VolumesExtendTest-1257807882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:14:50 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-813c0be4-3381-438a-a3be-3223aa733bf8 tempest-VolumesExtendTest-1257807882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:14:50 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-813c0be4-3381-438a-a3be-3223aa733bf8 tempest-VolumesExtendTest-1257807882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:14:50 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-813c0be4-3381-438a-a3be-3223aa733bf8 tempest-VolumesExtendTest-1257807882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:14:50 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-813c0be4-3381-438a-a3be-3223aa733bf8 tempest-VolumesExtendTest-1257807882 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:14:50 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-813c0be4-3381-438a-a3be-3223aa733bf8 tempest-VolumesExtendTest-1257807882 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:14:50 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-813c0be4-3381-438a-a3be-3223aa733bf8 tempest-VolumesExtendTest-1257807882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-be8f3e05-f24d-41dd-8001-891488fbc966 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:50 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[da8ac872-3d42-42d4-a2eb-801fc5891271]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:14:50 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-57364c9d-e540-43fe-9112-6b3456fe8aec tempest-VolumeDependencyTests-1091358234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-25f2b8b3-0f12-47bc-88c6-f08e32b109ca {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:50 devstack sudo[98776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-be8f3e05-f24d-41dd-8001-891488fbc966 1073741824 Nov 02 10:14:50 devstack sudo[98776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:50 devstack sudo[98777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-25f2b8b3-0f12-47bc-88c6-f08e32b109ca Nov 02 10:14:50 devstack sudo[98777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:51 devstack sudo[98777]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:51 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-57364c9d-e540-43fe-9112-6b3456fe8aec tempest-VolumeDependencyTests-1091358234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-25f2b8b3-0f12-47bc-88c6-f08e32b109ca" returned: 0 in 0.469s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:51 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-57364c9d-e540-43fe-9112-6b3456fe8aec tempest-VolumeDependencyTests-1091358234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-25f2b8b3-0f12-47bc-88c6-f08e32b109ca {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:51 devstack sudo[98787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-25f2b8b3-0f12-47bc-88c6-f08e32b109ca Nov 02 10:14:51 devstack sudo[98787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:51 devstack sudo[98776]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:51 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-813c0be4-3381-438a-a3be-3223aa733bf8 tempest-VolumesExtendTest-1257807882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-be8f3e05-f24d-41dd-8001-891488fbc966 1073741824" returned: 0 in 0.544s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:51 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-60ce0f57-4d22-460f-b394-5ce66780e6c8 tempest-VolumeTypesAccessTest-1894750554 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:14:51 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-60ce0f57-4d22-460f-b394-5ce66780e6c8 tempest-VolumeTypesAccessTest-1894750554 None] Flow 'volume_create_manager' (7c41f874-ca3c-4694-8358-2d35e497ea48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:14:51 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-60ce0f57-4d22-460f-b394-5ce66780e6c8 tempest-VolumeTypesAccessTest-1894750554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c9ca860-9161-415a-9b6a-b2f6ddffddb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:14:51 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-813c0be4-3381-438a-a3be-3223aa733bf8 tempest-VolumesExtendTest-1257807882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-be8f3e05-f24d-41dd-8001-891488fbc966 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:51 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-60ce0f57-4d22-460f-b394-5ce66780e6c8 tempest-VolumeTypesAccessTest-1894750554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c9ca860-9161-415a-9b6a-b2f6ddffddb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:14:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-134241870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e05137fd-2348-4b9e-bab1-21d136a324bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d9936a6d4424bf887d632b0cd46ea29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:14:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:14:51Z,use_quota=True,user_id='538833731b9b413da0868b3e0466bfb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(997668f4-b51c-4320-a784-7e183e326334),volume_type_id=997668f4-b51c-4320-a784-7e183e326334)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:14:51 devstack sudo[98789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-be8f3e05-f24d-41dd-8001-891488fbc966 Nov 02 10:14:51 devstack sudo[98789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:51 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-60ce0f57-4d22-460f-b394-5ce66780e6c8 tempest-VolumeTypesAccessTest-1894750554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5b9164f-77a3-41fc-8365-c1327e16f8ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:14:51 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-60ce0f57-4d22-460f-b394-5ce66780e6c8 tempest-VolumeTypesAccessTest-1894750554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5b9164f-77a3-41fc-8365-c1327e16f8ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:14:51 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-60ce0f57-4d22-460f-b394-5ce66780e6c8 tempest-VolumeTypesAccessTest-1894750554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3e117c4-91d5-403d-91ea-b40c7e8bf0c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:14:51 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-60ce0f57-4d22-460f-b394-5ce66780e6c8 tempest-VolumeTypesAccessTest-1894750554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3e117c4-91d5-403d-91ea-b40c7e8bf0c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e05137fd-2348-4b9e-bab1-21d136a324bd', 'volume_name': 'volume-e05137fd-2348-4b9e-bab1-21d136a324bd', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:14:51 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-60ce0f57-4d22-460f-b394-5ce66780e6c8 tempest-VolumeTypesAccessTest-1894750554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfff8ccd-a74e-460c-84ed-6e851b0e4262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:14:51 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-60ce0f57-4d22-460f-b394-5ce66780e6c8 tempest-VolumeTypesAccessTest-1894750554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfff8ccd-a74e-460c-84ed-6e851b0e4262) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:14:51 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-60ce0f57-4d22-460f-b394-5ce66780e6c8 tempest-VolumeTypesAccessTest-1894750554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78f1edcc-fc9e-45a9-954c-bbf1fd8ae2e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:14:51 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-60ce0f57-4d22-460f-b394-5ce66780e6c8 tempest-VolumeTypesAccessTest-1894750554 None] Volume e05137fd-2348-4b9e-bab1-21d136a324bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e05137fd-2348-4b9e-bab1-21d136a324bd', 'volume_size': 1} Nov 02 10:14:51 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-60ce0f57-4d22-460f-b394-5ce66780e6c8 tempest-VolumeTypesAccessTest-1894750554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:14:51 devstack sudo[98787]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:51 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-57364c9d-e540-43fe-9112-6b3456fe8aec tempest-VolumeDependencyTests-1091358234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-25f2b8b3-0f12-47bc-88c6-f08e32b109ca" returned: 0 in 0.289s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:51 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-57364c9d-e540-43fe-9112-6b3456fe8aec tempest-VolumeDependencyTests-1091358234 None] Lock "cinder-quobyte-25f2b8b3-0f12-47bc-88c6-f08e32b109ca" released by "delete_volume" :: held 0.862s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:14:51 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-57364c9d-e540-43fe-9112-6b3456fe8aec tempest-VolumeDependencyTests-1091358234 None] Created reservations ['5d405104-1520-41cc-bb65-fc9c7b6ad424', 'a2551638-0749-4c0e-96ff-67eab91df74a', '6bfa9cb2-9b4f-498f-85dd-7fec86b80424', 'f85e0986-d32c-421a-8df4-464b33b73e19'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:14:51 devstack sudo[98789]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:51 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-813c0be4-3381-438a-a3be-3223aa733bf8 tempest-VolumesExtendTest-1257807882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-be8f3e05-f24d-41dd-8001-891488fbc966" returned: 0 in 0.326s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:51 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-813c0be4-3381-438a-a3be-3223aa733bf8 tempest-VolumesExtendTest-1257807882 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:14:51 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-813c0be4-3381-438a-a3be-3223aa733bf8 tempest-VolumesExtendTest-1257807882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.970s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:14:51 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-60ce0f57-4d22-460f-b394-5ce66780e6c8 tempest-VolumeTypesAccessTest-1894750554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.265s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:14:51 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-60ce0f57-4d22-460f-b394-5ce66780e6c8 tempest-VolumeTypesAccessTest-1894750554 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:14:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-134241870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e05137fd-2348-4b9e-bab1-21d136a324bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d9936a6d4424bf887d632b0cd46ea29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:14:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:14:51Z,use_quota=True,user_id='538833731b9b413da0868b3e0466bfb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(997668f4-b51c-4320-a784-7e183e326334),volume_type_id=997668f4-b51c-4320-a784-7e183e326334)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:14:51 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-60ce0f57-4d22-460f-b394-5ce66780e6c8 tempest-VolumeTypesAccessTest-1894750554 None] Creating volume e05137fd-2348-4b9e-bab1-21d136a324bd {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:14:51 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-60ce0f57-4d22-460f-b394-5ce66780e6c8 tempest-VolumeTypesAccessTest-1894750554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:14:51 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-60ce0f57-4d22-460f-b394-5ce66780e6c8 tempest-VolumeTypesAccessTest-1894750554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:14:51 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-60ce0f57-4d22-460f-b394-5ce66780e6c8 tempest-VolumeTypesAccessTest-1894750554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:14:51 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-60ce0f57-4d22-460f-b394-5ce66780e6c8 tempest-VolumeTypesAccessTest-1894750554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:14:51 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-60ce0f57-4d22-460f-b394-5ce66780e6c8 tempest-VolumeTypesAccessTest-1894750554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:14:51 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-60ce0f57-4d22-460f-b394-5ce66780e6c8 tempest-VolumeTypesAccessTest-1894750554 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:14:51 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-60ce0f57-4d22-460f-b394-5ce66780e6c8 tempest-VolumeTypesAccessTest-1894750554 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:14:51 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-60ce0f57-4d22-460f-b394-5ce66780e6c8 tempest-VolumeTypesAccessTest-1894750554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e05137fd-2348-4b9e-bab1-21d136a324bd 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:51 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-57364c9d-e540-43fe-9112-6b3456fe8aec tempest-VolumeDependencyTests-1091358234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:14:51 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-57364c9d-e540-43fe-9112-6b3456fe8aec tempest-VolumeDependencyTests-1091358234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:14:51 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-57364c9d-e540-43fe-9112-6b3456fe8aec tempest-VolumeDependencyTests-1091358234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:14:51 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-57364c9d-e540-43fe-9112-6b3456fe8aec tempest-VolumeDependencyTests-1091358234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:14:51 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-57364c9d-e540-43fe-9112-6b3456fe8aec tempest-VolumeDependencyTests-1091358234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:14:51 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-57364c9d-e540-43fe-9112-6b3456fe8aec tempest-VolumeDependencyTests-1091358234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:51 devstack sudo[98793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e05137fd-2348-4b9e-bab1-21d136a324bd 1073741824 Nov 02 10:14:51 devstack sudo[98793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:51 devstack cinder-volume[86890]: DEBUG cinder.volume.volume_utils [None req-813c0be4-3381-438a-a3be-3223aa733bf8 tempest-VolumesExtendTest-1257807882 None] Attempting download of 7a393fa7-4879-486c-8216-4d35448485cf ((None, [{'url': 'file:///opt/stack/data/glance/images/7a393fa7-4879-486c-8216-4d35448485cf', 'metadata': {}}])) to volume be8f3e05-f24d-41dd-8001-891488fbc966. {{(pid=86890) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 02 10:14:51 devstack sudo[98794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:14:51 devstack sudo[98794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:51 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-70bae615-8736-4969-946c-0af13108f43c tempest-VolumeDependencyTests-1091358234 None] Acquiring lock "cinder-49c66d3b-652c-46ee-a4bf-18eb337449d9-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:14:51 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-70bae615-8736-4969-946c-0af13108f43c tempest-VolumeDependencyTests-1091358234 None] Lock "cinder-49c66d3b-652c-46ee-a4bf-18eb337449d9-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:14:51 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8e75257-1dbe-4273-9adf-a4a187bb7bfa]: (4, 'raw') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:14:51 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-813c0be4-3381-438a-a3be-3223aa733bf8 tempest-VolumesExtendTest-1257807882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7a393fa7-4879-486c-8216-4d35448485cf_e8i8pqi1 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:51 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-70bae615-8736-4969-946c-0af13108f43c tempest-VolumeDependencyTests-1091358234 None] Acquiring lock "cinder-quobyte-49c66d3b-652c-46ee-a4bf-18eb337449d9" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:14:51 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-70bae615-8736-4969-946c-0af13108f43c tempest-VolumeDependencyTests-1091358234 None] Lock "cinder-quobyte-49c66d3b-652c-46ee-a4bf-18eb337449d9" acquired by "delete_volume" :: waited 0.019s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:14:51 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[89501925-bcd7-452a-8789-e8b86e0daa24]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:14:51 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-70bae615-8736-4969-946c-0af13108f43c tempest-VolumeDependencyTests-1091358234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-49c66d3b-652c-46ee-a4bf-18eb337449d9 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:52 devstack sudo[98797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7a393fa7-4879-486c-8216-4d35448485cf_e8i8pqi1 Nov 02 10:14:52 devstack sudo[98797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:52 devstack sudo[98794]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:52 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-57364c9d-e540-43fe-9112-6b3456fe8aec tempest-VolumeDependencyTests-1091358234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.375s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:52 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-57364c9d-e540-43fe-9112-6b3456fe8aec tempest-VolumeDependencyTests-1091358234 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:14:52 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-57364c9d-e540-43fe-9112-6b3456fe8aec tempest-VolumeDependencyTests-1091358234 None] Deleted volume successfully. Nov 02 10:14:52 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-57364c9d-e540-43fe-9112-6b3456fe8aec tempest-VolumeDependencyTests-1091358234 None] Lock "cinder-25f2b8b3-0f12-47bc-88c6-f08e32b109ca-delete_volume" released by "delete_volume" :: held 1.586s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:14:52 devstack sudo[98798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-49c66d3b-652c-46ee-a4bf-18eb337449d9 Nov 02 10:14:52 devstack sudo[98798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:52 devstack sudo[98793]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:52 devstack sudo[98797]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:52 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-60ce0f57-4d22-460f-b394-5ce66780e6c8 tempest-VolumeTypesAccessTest-1894750554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e05137fd-2348-4b9e-bab1-21d136a324bd 1073741824" returned: 0 in 0.670s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:52 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-813c0be4-3381-438a-a3be-3223aa733bf8 tempest-VolumesExtendTest-1257807882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7a393fa7-4879-486c-8216-4d35448485cf_e8i8pqi1" returned: 0 in 0.486s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:52 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-813c0be4-3381-438a-a3be-3223aa733bf8 tempest-VolumesExtendTest-1257807882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7a393fa7-4879-486c-8216-4d35448485cf_e8i8pqi1 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:52 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-60ce0f57-4d22-460f-b394-5ce66780e6c8 tempest-VolumeTypesAccessTest-1894750554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e05137fd-2348-4b9e-bab1-21d136a324bd {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:52 devstack sudo[98810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e05137fd-2348-4b9e-bab1-21d136a324bd Nov 02 10:14:52 devstack sudo[98810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:52 devstack sudo[98807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7a393fa7-4879-486c-8216-4d35448485cf_e8i8pqi1 Nov 02 10:14:52 devstack sudo[98807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:52 devstack sudo[98798]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:52 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-70bae615-8736-4969-946c-0af13108f43c tempest-VolumeDependencyTests-1091358234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-49c66d3b-652c-46ee-a4bf-18eb337449d9" returned: 0 in 0.507s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:52 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-70bae615-8736-4969-946c-0af13108f43c tempest-VolumeDependencyTests-1091358234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-49c66d3b-652c-46ee-a4bf-18eb337449d9 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:52 devstack sudo[98814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-49c66d3b-652c-46ee-a4bf-18eb337449d9 Nov 02 10:14:52 devstack sudo[98814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:52 devstack sudo[98810]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:52 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-60ce0f57-4d22-460f-b394-5ce66780e6c8 tempest-VolumeTypesAccessTest-1894750554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e05137fd-2348-4b9e-bab1-21d136a324bd" returned: 0 in 0.327s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:52 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-60ce0f57-4d22-460f-b394-5ce66780e6c8 tempest-VolumeTypesAccessTest-1894750554 None] <== create_volume: return (1085ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:14:52 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-60ce0f57-4d22-460f-b394-5ce66780e6c8 tempest-VolumeTypesAccessTest-1894750554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.089s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:14:52 devstack sudo[98807]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:52 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-813c0be4-3381-438a-a3be-3223aa733bf8 tempest-VolumesExtendTest-1257807882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7a393fa7-4879-486c-8216-4d35448485cf_e8i8pqi1" returned: 1 in 0.387s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:52 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-813c0be4-3381-438a-a3be-3223aa733bf8 tempest-VolumesExtendTest-1257807882 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7a393fa7-4879-486c-8216-4d35448485cf_e8i8pqi1' failed. Not Retrying. {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 10:14:52 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[d629b225-618d-408e-9cf5-925656982917]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:14:52 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-813c0be4-3381-438a-a3be-3223aa733bf8 tempest-VolumesExtendTest-1257807882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7a393fa7-4879-486c-8216-4d35448485cf_pbapoqmodevstack@QuobyteHD {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:52 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-60ce0f57-4d22-460f-b394-5ce66780e6c8 tempest-VolumeTypesAccessTest-1894750554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78f1edcc-fc9e-45a9-954c-bbf1fd8ae2e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e05137fd-2348-4b9e-bab1-21d136a324bd', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:14:52 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-60ce0f57-4d22-460f-b394-5ce66780e6c8 tempest-VolumeTypesAccessTest-1894750554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (344616ba-45f6-4f71-a51a-d73ad6a1d6b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:14:52 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-60ce0f57-4d22-460f-b394-5ce66780e6c8 tempest-VolumeTypesAccessTest-1894750554 None] Volume volume-e05137fd-2348-4b9e-bab1-21d136a324bd (e05137fd-2348-4b9e-bab1-21d136a324bd): created successfully Nov 02 10:14:52 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-60ce0f57-4d22-460f-b394-5ce66780e6c8 tempest-VolumeTypesAccessTest-1894750554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (344616ba-45f6-4f71-a51a-d73ad6a1d6b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:14:52 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-60ce0f57-4d22-460f-b394-5ce66780e6c8 tempest-VolumeTypesAccessTest-1894750554 None] Flow 'volume_create_manager' (7c41f874-ca3c-4694-8358-2d35e497ea48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:14:52 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-60ce0f57-4d22-460f-b394-5ce66780e6c8 tempest-VolumeTypesAccessTest-1894750554 None] Created volume successfully. Nov 02 10:14:52 devstack sudo[98814]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:52 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-70bae615-8736-4969-946c-0af13108f43c tempest-VolumeDependencyTests-1091358234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-49c66d3b-652c-46ee-a4bf-18eb337449d9" returned: 0 in 0.333s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:52 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-70bae615-8736-4969-946c-0af13108f43c tempest-VolumeDependencyTests-1091358234 None] Lock "cinder-quobyte-49c66d3b-652c-46ee-a4bf-18eb337449d9" released by "delete_volume" :: held 0.907s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:14:52 devstack sudo[98819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7a393fa7-4879-486c-8216-4d35448485cf_pbapoqmodevstack@QuobyteHD Nov 02 10:14:52 devstack sudo[98819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:52 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-70bae615-8736-4969-946c-0af13108f43c tempest-VolumeDependencyTests-1091358234 None] Created reservations ['62cfed45-5e14-44de-ae82-21ea09f67a50', '6b13fc7d-7259-47e3-b248-660156a5e5c8', 'dbdb1599-955f-4a73-87f4-2e708ac3080d', 'e29ff07b-d1e2-482c-ac92-c73c14043d12'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:14:52 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-70bae615-8736-4969-946c-0af13108f43c tempest-VolumeDependencyTests-1091358234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:14:52 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-70bae615-8736-4969-946c-0af13108f43c tempest-VolumeDependencyTests-1091358234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:14:52 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-70bae615-8736-4969-946c-0af13108f43c tempest-VolumeDependencyTests-1091358234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:14:53 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-70bae615-8736-4969-946c-0af13108f43c tempest-VolumeDependencyTests-1091358234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:14:53 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-70bae615-8736-4969-946c-0af13108f43c tempest-VolumeDependencyTests-1091358234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:14:53 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-70bae615-8736-4969-946c-0af13108f43c tempest-VolumeDependencyTests-1091358234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:53 devstack sudo[98822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:14:53 devstack sudo[98822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:53 devstack sudo[98819]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:53 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-813c0be4-3381-438a-a3be-3223aa733bf8 tempest-VolumesExtendTest-1257807882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7a393fa7-4879-486c-8216-4d35448485cf_pbapoqmodevstack@QuobyteHD" returned: 0 in 0.473s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:53 devstack cinder-volume[86890]: DEBUG cinder.image.image_utils [None req-813c0be4-3381-438a-a3be-3223aa733bf8 tempest-VolumesExtendTest-1257807882 None] 7a393fa7-4879-486c-8216-4d35448485cf was qcow2, converting to qcow2 {{(pid=86890) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 02 10:14:53 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-813c0be4-3381-438a-a3be-3223aa733bf8 tempest-VolumesExtendTest-1257807882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7a393fa7-4879-486c-8216-4d35448485cf_pbapoqmodevstack@QuobyteHD /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-be8f3e05-f24d-41dd-8001-891488fbc966 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:53 devstack sudo[98827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7a393fa7-4879-486c-8216-4d35448485cf_pbapoqmodevstack@QuobyteHD /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-be8f3e05-f24d-41dd-8001-891488fbc966 Nov 02 10:14:53 devstack sudo[98827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:53 devstack sudo[98822]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:53 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-70bae615-8736-4969-946c-0af13108f43c tempest-VolumeDependencyTests-1091358234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.409s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:53 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-70bae615-8736-4969-946c-0af13108f43c tempest-VolumeDependencyTests-1091358234 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:14:53 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-70bae615-8736-4969-946c-0af13108f43c tempest-VolumeDependencyTests-1091358234 None] Deleted volume successfully. Nov 02 10:14:53 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-70bae615-8736-4969-946c-0af13108f43c tempest-VolumeDependencyTests-1091358234 None] Lock "cinder-49c66d3b-652c-46ee-a4bf-18eb337449d9-delete_volume" released by "delete_volume" :: held 1.708s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:14:53 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-00fd5681-1744-4147-a18e-7e51ebc26ec0 tempest-VolumeTypesAccessTest-1894750554 None] Acquiring lock "cinder-e05137fd-2348-4b9e-bab1-21d136a324bd-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:14:53 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-00fd5681-1744-4147-a18e-7e51ebc26ec0 tempest-VolumeTypesAccessTest-1894750554 None] Lock "cinder-e05137fd-2348-4b9e-bab1-21d136a324bd-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:14:53 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-00fd5681-1744-4147-a18e-7e51ebc26ec0 tempest-VolumeTypesAccessTest-1894750554 None] Acquiring lock "cinder-quobyte-e05137fd-2348-4b9e-bab1-21d136a324bd" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:14:53 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-00fd5681-1744-4147-a18e-7e51ebc26ec0 tempest-VolumeTypesAccessTest-1894750554 None] Lock "cinder-quobyte-e05137fd-2348-4b9e-bab1-21d136a324bd" acquired by "delete_volume" :: waited 0.024s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:14:53 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d5e893f-7ab7-4ece-bfd0-6c870ab7ff0c]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:14:53 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-00fd5681-1744-4147-a18e-7e51ebc26ec0 tempest-VolumeTypesAccessTest-1894750554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e05137fd-2348-4b9e-bab1-21d136a324bd {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:53 devstack sudo[98834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e05137fd-2348-4b9e-bab1-21d136a324bd Nov 02 10:14:53 devstack sudo[98834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:54 devstack sudo[98834]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:54 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-00fd5681-1744-4147-a18e-7e51ebc26ec0 tempest-VolumeTypesAccessTest-1894750554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e05137fd-2348-4b9e-bab1-21d136a324bd" returned: 0 in 0.482s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:54 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-00fd5681-1744-4147-a18e-7e51ebc26ec0 tempest-VolumeTypesAccessTest-1894750554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e05137fd-2348-4b9e-bab1-21d136a324bd {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:54 devstack sudo[98841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e05137fd-2348-4b9e-bab1-21d136a324bd Nov 02 10:14:54 devstack sudo[98841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:54 devstack sudo[98841]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:54 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-00fd5681-1744-4147-a18e-7e51ebc26ec0 tempest-VolumeTypesAccessTest-1894750554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e05137fd-2348-4b9e-bab1-21d136a324bd" returned: 0 in 0.339s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:54 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-00fd5681-1744-4147-a18e-7e51ebc26ec0 tempest-VolumeTypesAccessTest-1894750554 None] Lock "cinder-quobyte-e05137fd-2348-4b9e-bab1-21d136a324bd" released by "delete_volume" :: held 0.898s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:14:54 devstack cinder-volume[86890]: WARNING cinder.quota [None req-00fd5681-1744-4147-a18e-7e51ebc26ec0 tempest-VolumeTypesAccessTest-1894750554 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1286950865 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1286950865, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:14:54 devstack cinder-volume[86890]: WARNING cinder.quota [None req-00fd5681-1744-4147-a18e-7e51ebc26ec0 tempest-VolumeTypesAccessTest-1894750554 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1286950865 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1286950865, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:14:54 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-00fd5681-1744-4147-a18e-7e51ebc26ec0 tempest-VolumeTypesAccessTest-1894750554 None] Created reservations ['2ef3903f-2487-4e9a-8aaa-a4b2d9e6b5f4', '8195126b-24eb-4eb1-9a2d-76a56a95158a', 'c24c52b2-96c8-4fcc-9a49-db73761b63a3', 'c58999b6-c3c7-4068-a589-8ab0d525b4ee'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:14:54 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-00fd5681-1744-4147-a18e-7e51ebc26ec0 tempest-VolumeTypesAccessTest-1894750554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:14:54 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-00fd5681-1744-4147-a18e-7e51ebc26ec0 tempest-VolumeTypesAccessTest-1894750554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:14:54 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-00fd5681-1744-4147-a18e-7e51ebc26ec0 tempest-VolumeTypesAccessTest-1894750554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:14:54 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-00fd5681-1744-4147-a18e-7e51ebc26ec0 tempest-VolumeTypesAccessTest-1894750554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:14:54 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-00fd5681-1744-4147-a18e-7e51ebc26ec0 tempest-VolumeTypesAccessTest-1894750554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:14:54 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-00fd5681-1744-4147-a18e-7e51ebc26ec0 tempest-VolumeTypesAccessTest-1894750554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:54 devstack sudo[98845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:14:54 devstack sudo[98845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:55 devstack sudo[98845]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:55 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-00fd5681-1744-4147-a18e-7e51ebc26ec0 tempest-VolumeTypesAccessTest-1894750554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.528s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:55 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-00fd5681-1744-4147-a18e-7e51ebc26ec0 tempest-VolumeTypesAccessTest-1894750554 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:14:55 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-00fd5681-1744-4147-a18e-7e51ebc26ec0 tempest-VolumeTypesAccessTest-1894750554 None] Deleted volume successfully. Nov 02 10:14:55 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-00fd5681-1744-4147-a18e-7e51ebc26ec0 tempest-VolumeTypesAccessTest-1894750554 None] Lock "cinder-e05137fd-2348-4b9e-bab1-21d136a324bd-delete_volume" released by "delete_volume" :: held 1.768s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:14:56 devstack sudo[98827]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:56 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-813c0be4-3381-438a-a3be-3223aa733bf8 tempest-VolumesExtendTest-1257807882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7a393fa7-4879-486c-8216-4d35448485cf_pbapoqmodevstack@QuobyteHD /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-be8f3e05-f24d-41dd-8001-891488fbc966" returned: 0 in 2.900s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:56 devstack cinder-volume[86890]: DEBUG cinder.image.image_utils [None req-813c0be4-3381-438a-a3be-3223aa733bf8 tempest-VolumesExtendTest-1257807882 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7a393fa7-4879-486c-8216-4d35448485cf_pbapoqmodevstack@QuobyteHD, size 112.00 MB, duration 2.90 sec, destination /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-be8f3e05-f24d-41dd-8001-891488fbc966 {{(pid=86890) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 10:14:56 devstack cinder-volume[86890]: INFO cinder.image.image_utils [None req-813c0be4-3381-438a-a3be-3223aa733bf8 tempest-VolumesExtendTest-1257807882 None] Converted 112.00 MB image at 38.61 MB/s Nov 02 10:14:56 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-813c0be4-3381-438a-a3be-3223aa733bf8 tempest-VolumesExtendTest-1257807882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-be8f3e05-f24d-41dd-8001-891488fbc966 1G {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:56 devstack sudo[98848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-be8f3e05-f24d-41dd-8001-891488fbc966 1G Nov 02 10:14:56 devstack sudo[98848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:56 devstack sudo[98848]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:56 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-813c0be4-3381-438a-a3be-3223aa733bf8 tempest-VolumesExtendTest-1257807882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-be8f3e05-f24d-41dd-8001-891488fbc966 1G" returned: 0 in 0.396s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:56 devstack cinder-volume[86890]: DEBUG cinder.volume.volume_utils [None req-813c0be4-3381-438a-a3be-3223aa733bf8 tempest-VolumesExtendTest-1257807882 None] Downloaded image 7a393fa7-4879-486c-8216-4d35448485cf ((None, [{'url': 'file:///opt/stack/data/glance/images/7a393fa7-4879-486c-8216-4d35448485cf', 'metadata': {}}])) to volume be8f3e05-f24d-41dd-8001-891488fbc966 successfully. {{(pid=86890) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 02 10:14:56 devstack cinder-volume[86890]: DEBUG cinder.image.image_utils [None req-813c0be4-3381-438a-a3be-3223aa733bf8 tempest-VolumesExtendTest-1257807882 None] Temporary image 7a393fa7-4879-486c-8216-4d35448485cf for user 2dc6eca44ea9448f84c1278930fc43b9 is deleted. {{(pid=86890) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 02 10:14:56 devstack cinder-volume[86890]: DEBUG cinder.volume.volume_utils [None req-813c0be4-3381-438a-a3be-3223aa733bf8 tempest-VolumesExtendTest-1257807882 None] Marking volume be8f3e05-f24d-41dd-8001-891488fbc966 as bootable. {{(pid=86890) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 02 10:14:56 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-813c0be4-3381-438a-a3be-3223aa733bf8 tempest-VolumesExtendTest-1257807882 None] Copying metadata from image 7a393fa7-4879-486c-8216-4d35448485cf to be8f3e05-f24d-41dd-8001-891488fbc966. {{(pid=86890) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 10:14:56 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-813c0be4-3381-438a-a3be-3223aa733bf8 tempest-VolumesExtendTest-1257807882 None] Creating volume glance metadata for volume be8f3e05-f24d-41dd-8001-891488fbc966 backed by image 7a393fa7-4879-486c-8216-4d35448485cf with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '7a393fa7-4879-486c-8216-4d35448485cf', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86890) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 10:14:56 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-813c0be4-3381-438a-a3be-3223aa733bf8 tempest-VolumesExtendTest-1257807882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df181781-989b-4324-a5bb-a26befc91e06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be8f3e05-f24d-41dd-8001-891488fbc966', 'volume_size': 1, 'image_id': '7a393fa7-4879-486c-8216-4d35448485cf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7a393fa7-4879-486c-8216-4d35448485cf', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '606cf27a36794aa3805ebe6d987aa1a4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7a393fa7-4879-486c-8216-4d35448485cf', 'created_at': datetime.datetime(2026, 11, 2, 8, 55, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 8, 55, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7a393fa7-4879-486c-8216-4d35448485cf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:14:56 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-813c0be4-3381-438a-a3be-3223aa733bf8 tempest-VolumesExtendTest-1257807882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60888e30-27b9-47ba-8679-0939acf550f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:14:56 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-813c0be4-3381-438a-a3be-3223aa733bf8 tempest-VolumesExtendTest-1257807882 None] Volume volume-be8f3e05-f24d-41dd-8001-891488fbc966 (be8f3e05-f24d-41dd-8001-891488fbc966): created successfully Nov 02 10:14:56 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-813c0be4-3381-438a-a3be-3223aa733bf8 tempest-VolumesExtendTest-1257807882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60888e30-27b9-47ba-8679-0939acf550f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:14:56 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-813c0be4-3381-438a-a3be-3223aa733bf8 tempest-VolumesExtendTest-1257807882 None] Flow 'volume_create_manager' (f20c7b74-1754-4eac-a114-04dbbff99047) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:14:56 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-813c0be4-3381-438a-a3be-3223aa733bf8 tempest-VolumesExtendTest-1257807882 None] Created volume successfully. Nov 02 10:14:57 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-6cb67781-d503-461e-bdf2-e896abf50b95 tempest-VolumesExtendTest-1257807882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:14:57 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-6cb67781-d503-461e-bdf2-e896abf50b95 tempest-VolumesExtendTest-1257807882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:14:57 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8e62244-fbd3-4699-8ef3-23efb1798bbd]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:14:57 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6cb67781-d503-461e-bdf2-e896abf50b95 tempest-VolumesExtendTest-1257807882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-be8f3e05-f24d-41dd-8001-891488fbc966 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:57 devstack sudo[98853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-be8f3e05-f24d-41dd-8001-891488fbc966 Nov 02 10:14:57 devstack sudo[98853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:57 devstack sudo[98853]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:57 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6cb67781-d503-461e-bdf2-e896abf50b95 tempest-VolumesExtendTest-1257807882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-be8f3e05-f24d-41dd-8001-891488fbc966" returned: 0 in 0.476s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:57 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6cb67781-d503-461e-bdf2-e896abf50b95 tempest-VolumesExtendTest-1257807882 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-be8f3e05-f24d-41dd-8001-891488fbc966 2G {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:57 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6cb67781-d503-461e-bdf2-e896abf50b95 tempest-VolumesExtendTest-1257807882 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-be8f3e05-f24d-41dd-8001-891488fbc966 2G" returned: 0 in 0.152s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:57 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-6cb67781-d503-461e-bdf2-e896abf50b95 tempest-VolumesExtendTest-1257807882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.666s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:14:58 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-6cb67781-d503-461e-bdf2-e896abf50b95 tempest-VolumesExtendTest-1257807882 None] Extend volume completed successfully. Nov 02 10:14:59 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-3b8efeee-d99c-4732-9745-7d674d8c5688 tempest-VolumesExtendTest-1257807882 None] Acquiring lock "cinder-be8f3e05-f24d-41dd-8001-891488fbc966-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:14:59 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-3b8efeee-d99c-4732-9745-7d674d8c5688 tempest-VolumesExtendTest-1257807882 None] Lock "cinder-be8f3e05-f24d-41dd-8001-891488fbc966-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:14:59 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-3b8efeee-d99c-4732-9745-7d674d8c5688 tempest-VolumesExtendTest-1257807882 None] Acquiring lock "cinder-quobyte-be8f3e05-f24d-41dd-8001-891488fbc966" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:14:59 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-3b8efeee-d99c-4732-9745-7d674d8c5688 tempest-VolumesExtendTest-1257807882 None] Lock "cinder-quobyte-be8f3e05-f24d-41dd-8001-891488fbc966" acquired by "delete_volume" :: waited 0.019s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:14:59 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[82317d3d-1585-4531-b15d-24088a7dd1c2]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:14:59 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-3b8efeee-d99c-4732-9745-7d674d8c5688 tempest-VolumesExtendTest-1257807882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-be8f3e05-f24d-41dd-8001-891488fbc966 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:59 devstack sudo[98863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-be8f3e05-f24d-41dd-8001-891488fbc966 Nov 02 10:14:59 devstack sudo[98863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:59 devstack sudo[98863]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:59 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-3b8efeee-d99c-4732-9745-7d674d8c5688 tempest-VolumesExtendTest-1257807882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-be8f3e05-f24d-41dd-8001-891488fbc966" returned: 0 in 0.459s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:59 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-3b8efeee-d99c-4732-9745-7d674d8c5688 tempest-VolumesExtendTest-1257807882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-be8f3e05-f24d-41dd-8001-891488fbc966 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:59 devstack sudo[98869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-be8f3e05-f24d-41dd-8001-891488fbc966 Nov 02 10:14:59 devstack sudo[98869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:59 devstack sudo[98869]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:59 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-3b8efeee-d99c-4732-9745-7d674d8c5688 tempest-VolumesExtendTest-1257807882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-be8f3e05-f24d-41dd-8001-891488fbc966" returned: 0 in 0.314s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:00 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-3b8efeee-d99c-4732-9745-7d674d8c5688 tempest-VolumesExtendTest-1257807882 None] Lock "cinder-quobyte-be8f3e05-f24d-41dd-8001-891488fbc966" released by "delete_volume" :: held 0.855s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:15:00 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-3b8efeee-d99c-4732-9745-7d674d8c5688 tempest-VolumesExtendTest-1257807882 None] Created reservations ['498f9418-1b2b-4908-a3c0-936a6a4e4afa', '3224f630-3d4c-4e9d-a113-c0593f9a8a89', 'd490ea37-fed9-4ecf-84aa-83c8e8f5d23e', '5ad74c5b-34c8-4c64-aea8-693ab8b534be'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:15:00 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-3b8efeee-d99c-4732-9745-7d674d8c5688 tempest-VolumesExtendTest-1257807882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:15:00 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-3b8efeee-d99c-4732-9745-7d674d8c5688 tempest-VolumesExtendTest-1257807882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:15:00 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-3b8efeee-d99c-4732-9745-7d674d8c5688 tempest-VolumesExtendTest-1257807882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:15:00 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-3b8efeee-d99c-4732-9745-7d674d8c5688 tempest-VolumesExtendTest-1257807882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:15:00 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-3b8efeee-d99c-4732-9745-7d674d8c5688 tempest-VolumesExtendTest-1257807882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:15:00 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-3b8efeee-d99c-4732-9745-7d674d8c5688 tempest-VolumesExtendTest-1257807882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:00 devstack sudo[98872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:15:00 devstack sudo[98872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:00 devstack sudo[98872]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:00 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-3b8efeee-d99c-4732-9745-7d674d8c5688 tempest-VolumesExtendTest-1257807882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.324s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:00 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-3b8efeee-d99c-4732-9745-7d674d8c5688 tempest-VolumesExtendTest-1257807882 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:15:00 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-3b8efeee-d99c-4732-9745-7d674d8c5688 tempest-VolumesExtendTest-1257807882 None] Deleted volume successfully. Nov 02 10:15:00 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-3b8efeee-d99c-4732-9745-7d674d8c5688 tempest-VolumesExtendTest-1257807882 None] Lock "cinder-be8f3e05-f24d-41dd-8001-891488fbc966-delete_volume" released by "delete_volume" :: held 1.496s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:15:01 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac11c6de-1aa4-4ebe-9b56-40d6d7a9390f tempest-VolumesExtendTest-1257807882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:15:01 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-ac11c6de-1aa4-4ebe-9b56-40d6d7a9390f tempest-VolumesExtendTest-1257807882 None] Flow 'volume_create_manager' (92025ddc-5c73-457e-9a4b-d9773edfe336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:15:01 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-ac11c6de-1aa4-4ebe-9b56-40d6d7a9390f tempest-VolumesExtendTest-1257807882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a629ce2-7740-4c1f-b905-82dc1b196e93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:01 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-ac11c6de-1aa4-4ebe-9b56-40d6d7a9390f tempest-VolumesExtendTest-1257807882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a629ce2-7740-4c1f-b905-82dc1b196e93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:15:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-987642735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc06dcb8-df01-4808-b7eb-04597e815526,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c57ea8090d854f5ea2d08d7f8d6d32b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:15:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:15:01Z,use_quota=True,user_id='2dc6eca44ea9448f84c1278930fc43b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:01 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-ac11c6de-1aa4-4ebe-9b56-40d6d7a9390f tempest-VolumesExtendTest-1257807882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ee538e0-7f03-4ceb-afa5-a5588d706a78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:01 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-ac11c6de-1aa4-4ebe-9b56-40d6d7a9390f tempest-VolumesExtendTest-1257807882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ee538e0-7f03-4ceb-afa5-a5588d706a78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:01 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-ac11c6de-1aa4-4ebe-9b56-40d6d7a9390f tempest-VolumesExtendTest-1257807882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a07c0c3-2bc2-418e-9659-98158602fc3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:01 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-ac11c6de-1aa4-4ebe-9b56-40d6d7a9390f tempest-VolumesExtendTest-1257807882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a07c0c3-2bc2-418e-9659-98158602fc3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc06dcb8-df01-4808-b7eb-04597e815526', 'volume_name': 'volume-dc06dcb8-df01-4808-b7eb-04597e815526', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:01 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-ac11c6de-1aa4-4ebe-9b56-40d6d7a9390f tempest-VolumesExtendTest-1257807882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44f62c5d-4f22-4317-a145-aba0a0a872cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:01 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-ac11c6de-1aa4-4ebe-9b56-40d6d7a9390f tempest-VolumesExtendTest-1257807882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44f62c5d-4f22-4317-a145-aba0a0a872cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:01 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-ac11c6de-1aa4-4ebe-9b56-40d6d7a9390f tempest-VolumesExtendTest-1257807882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b51ec8d-fea4-42b4-8cee-d7a73c96bdc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:01 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-ac11c6de-1aa4-4ebe-9b56-40d6d7a9390f tempest-VolumesExtendTest-1257807882 None] Volume dc06dcb8-df01-4808-b7eb-04597e815526: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc06dcb8-df01-4808-b7eb-04597e815526', 'volume_size': 1} Nov 02 10:15:01 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-ac11c6de-1aa4-4ebe-9b56-40d6d7a9390f tempest-VolumesExtendTest-1257807882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:15:01 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-ac11c6de-1aa4-4ebe-9b56-40d6d7a9390f tempest-VolumesExtendTest-1257807882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:15:01 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-ac11c6de-1aa4-4ebe-9b56-40d6d7a9390f tempest-VolumesExtendTest-1257807882 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:15:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-987642735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc06dcb8-df01-4808-b7eb-04597e815526,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c57ea8090d854f5ea2d08d7f8d6d32b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:15:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:15:01Z,use_quota=True,user_id='2dc6eca44ea9448f84c1278930fc43b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:15:01 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-ac11c6de-1aa4-4ebe-9b56-40d6d7a9390f tempest-VolumesExtendTest-1257807882 None] Creating volume dc06dcb8-df01-4808-b7eb-04597e815526 {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:15:01 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-ac11c6de-1aa4-4ebe-9b56-40d6d7a9390f tempest-VolumesExtendTest-1257807882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:15:01 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-ac11c6de-1aa4-4ebe-9b56-40d6d7a9390f tempest-VolumesExtendTest-1257807882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:15:01 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-ac11c6de-1aa4-4ebe-9b56-40d6d7a9390f tempest-VolumesExtendTest-1257807882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:15:01 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-ac11c6de-1aa4-4ebe-9b56-40d6d7a9390f tempest-VolumesExtendTest-1257807882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:15:01 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-ac11c6de-1aa4-4ebe-9b56-40d6d7a9390f tempest-VolumesExtendTest-1257807882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:15:01 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-ac11c6de-1aa4-4ebe-9b56-40d6d7a9390f tempest-VolumesExtendTest-1257807882 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:15:01 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-ac11c6de-1aa4-4ebe-9b56-40d6d7a9390f tempest-VolumesExtendTest-1257807882 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:15:01 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ac11c6de-1aa4-4ebe-9b56-40d6d7a9390f tempest-VolumesExtendTest-1257807882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dc06dcb8-df01-4808-b7eb-04597e815526 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:01 devstack sudo[98875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dc06dcb8-df01-4808-b7eb-04597e815526 1073741824 Nov 02 10:15:01 devstack sudo[98875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:01 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-a48c3874-26e7-4f94-ad6d-1b526f7dc701 tempest-VolumesCloneTest-102722810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:15:01 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-a48c3874-26e7-4f94-ad6d-1b526f7dc701 tempest-VolumesCloneTest-102722810 None] Flow 'volume_create_manager' (e255e9f0-1218-4a63-8f13-4d4c1d5186ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:15:01 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-a48c3874-26e7-4f94-ad6d-1b526f7dc701 tempest-VolumesCloneTest-102722810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85b3ec65-a2dc-4401-be80-c0b6daf97b15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:01 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-a48c3874-26e7-4f94-ad6d-1b526f7dc701 tempest-VolumesCloneTest-102722810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85b3ec65-a2dc-4401-be80-c0b6daf97b15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:15:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1611010947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e37e8636-a7f4-4096-9e00-9d893d066b88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6db89c8c9ec4e2ca63620e9d9f7063e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:15:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:15:02Z,use_quota=True,user_id='cbb179ce06974bce98897b83e01925b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:01 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-a48c3874-26e7-4f94-ad6d-1b526f7dc701 tempest-VolumesCloneTest-102722810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55244572-d327-4f28-b27b-7a77f058b2a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:01 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-a48c3874-26e7-4f94-ad6d-1b526f7dc701 tempest-VolumesCloneTest-102722810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55244572-d327-4f28-b27b-7a77f058b2a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:01 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-a48c3874-26e7-4f94-ad6d-1b526f7dc701 tempest-VolumesCloneTest-102722810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2aba1f69-fa7b-47b5-8e80-a4c72c7ed592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:01 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-a48c3874-26e7-4f94-ad6d-1b526f7dc701 tempest-VolumesCloneTest-102722810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2aba1f69-fa7b-47b5-8e80-a4c72c7ed592) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e37e8636-a7f4-4096-9e00-9d893d066b88', 'volume_name': 'volume-e37e8636-a7f4-4096-9e00-9d893d066b88', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:01 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-a48c3874-26e7-4f94-ad6d-1b526f7dc701 tempest-VolumesCloneTest-102722810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b9b42b7-7298-41c2-953c-9a9f26960172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:01 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-a48c3874-26e7-4f94-ad6d-1b526f7dc701 tempest-VolumesCloneTest-102722810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b9b42b7-7298-41c2-953c-9a9f26960172) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:01 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-a48c3874-26e7-4f94-ad6d-1b526f7dc701 tempest-VolumesCloneTest-102722810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58c1d4ca-7b0d-4691-a0ef-98383e977f72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:01 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-a48c3874-26e7-4f94-ad6d-1b526f7dc701 tempest-VolumesCloneTest-102722810 None] Volume e37e8636-a7f4-4096-9e00-9d893d066b88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e37e8636-a7f4-4096-9e00-9d893d066b88', 'volume_size': 1} Nov 02 10:15:01 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-a48c3874-26e7-4f94-ad6d-1b526f7dc701 tempest-VolumesCloneTest-102722810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:15:01 devstack sudo[98875]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:01 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ac11c6de-1aa4-4ebe-9b56-40d6d7a9390f tempest-VolumesExtendTest-1257807882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dc06dcb8-df01-4808-b7eb-04597e815526 1073741824" returned: 0 in 0.674s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:01 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ac11c6de-1aa4-4ebe-9b56-40d6d7a9390f tempest-VolumesExtendTest-1257807882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dc06dcb8-df01-4808-b7eb-04597e815526 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:01 devstack sudo[98884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dc06dcb8-df01-4808-b7eb-04597e815526 Nov 02 10:15:01 devstack sudo[98884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:02 devstack sudo[98884]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:02 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ac11c6de-1aa4-4ebe-9b56-40d6d7a9390f tempest-VolumesExtendTest-1257807882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dc06dcb8-df01-4808-b7eb-04597e815526" returned: 0 in 0.372s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:02 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-ac11c6de-1aa4-4ebe-9b56-40d6d7a9390f tempest-VolumesExtendTest-1257807882 None] <== create_volume: return (1098ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:15:02 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-ac11c6de-1aa4-4ebe-9b56-40d6d7a9390f tempest-VolumesExtendTest-1257807882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.101s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:15:02 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-a48c3874-26e7-4f94-ad6d-1b526f7dc701 tempest-VolumesCloneTest-102722810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.442s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:15:02 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-a48c3874-26e7-4f94-ad6d-1b526f7dc701 tempest-VolumesCloneTest-102722810 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:15:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1611010947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e37e8636-a7f4-4096-9e00-9d893d066b88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6db89c8c9ec4e2ca63620e9d9f7063e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:15:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:15:02Z,use_quota=True,user_id='cbb179ce06974bce98897b83e01925b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:15:02 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-a48c3874-26e7-4f94-ad6d-1b526f7dc701 tempest-VolumesCloneTest-102722810 None] Creating volume e37e8636-a7f4-4096-9e00-9d893d066b88 {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:15:02 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-a48c3874-26e7-4f94-ad6d-1b526f7dc701 tempest-VolumesCloneTest-102722810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:15:02 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-a48c3874-26e7-4f94-ad6d-1b526f7dc701 tempest-VolumesCloneTest-102722810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:15:02 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-a48c3874-26e7-4f94-ad6d-1b526f7dc701 tempest-VolumesCloneTest-102722810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:15:02 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-a48c3874-26e7-4f94-ad6d-1b526f7dc701 tempest-VolumesCloneTest-102722810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:15:02 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-a48c3874-26e7-4f94-ad6d-1b526f7dc701 tempest-VolumesCloneTest-102722810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:15:02 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-a48c3874-26e7-4f94-ad6d-1b526f7dc701 tempest-VolumesCloneTest-102722810 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:15:02 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-a48c3874-26e7-4f94-ad6d-1b526f7dc701 tempest-VolumesCloneTest-102722810 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:15:02 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a48c3874-26e7-4f94-ad6d-1b526f7dc701 tempest-VolumesCloneTest-102722810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e37e8636-a7f4-4096-9e00-9d893d066b88 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:02 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8b6af78-294d-4f59-b4b9-70051491a1b1 tempest-VolumeImageDependencyTests-1166190201 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:15:02 devstack sudo[98887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e37e8636-a7f4-4096-9e00-9d893d066b88 1073741824 Nov 02 10:15:02 devstack sudo[98887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:02 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-a8b6af78-294d-4f59-b4b9-70051491a1b1 tempest-VolumeImageDependencyTests-1166190201 None] Flow 'volume_create_manager' (24fa5b94-101b-4546-ae4f-4c1be29b6afb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:15:02 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-a8b6af78-294d-4f59-b4b9-70051491a1b1 tempest-VolumeImageDependencyTests-1166190201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a39d9f81-dcfc-4ddd-813d-5bb8f54e58a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:02 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-ac11c6de-1aa4-4ebe-9b56-40d6d7a9390f tempest-VolumesExtendTest-1257807882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b51ec8d-fea4-42b4-8cee-d7a73c96bdc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc06dcb8-df01-4808-b7eb-04597e815526', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:02 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-ac11c6de-1aa4-4ebe-9b56-40d6d7a9390f tempest-VolumesExtendTest-1257807882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c36e137d-107d-41a6-83b1-c4ce20b3cd96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:02 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-a8b6af78-294d-4f59-b4b9-70051491a1b1 tempest-VolumeImageDependencyTests-1166190201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a39d9f81-dcfc-4ddd-813d-5bb8f54e58a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:15:02Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d43a2697-4a4b-4a80-ba1b-a8e5764460d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a96e4e634aac47c0a119e1b5b8d3a58f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:15:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:15:02Z,use_quota=True,user_id='7be312fdaad34643a55463c3edfe54ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:02 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-a8b6af78-294d-4f59-b4b9-70051491a1b1 tempest-VolumeImageDependencyTests-1166190201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef78061c-2b9f-43e8-acd4-ecb069d58324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:02 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-a8b6af78-294d-4f59-b4b9-70051491a1b1 tempest-VolumeImageDependencyTests-1166190201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef78061c-2b9f-43e8-acd4-ecb069d58324) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:02 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-a8b6af78-294d-4f59-b4b9-70051491a1b1 tempest-VolumeImageDependencyTests-1166190201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60189865-3928-43a3-8b30-e491a8acc1d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:02 devstack cinder-volume[86890]: DEBUG cinder.image.glance [None req-a8b6af78-294d-4f59-b4b9-70051491a1b1 tempest-VolumeImageDependencyTests-1166190201 None] Creating Keystone auth plugin from conf {{(pid=86890) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 10:15:02 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-ac11c6de-1aa4-4ebe-9b56-40d6d7a9390f tempest-VolumesExtendTest-1257807882 None] Volume volume-dc06dcb8-df01-4808-b7eb-04597e815526 (dc06dcb8-df01-4808-b7eb-04597e815526): created successfully Nov 02 10:15:02 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-ac11c6de-1aa4-4ebe-9b56-40d6d7a9390f tempest-VolumesExtendTest-1257807882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c36e137d-107d-41a6-83b1-c4ce20b3cd96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:02 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-ac11c6de-1aa4-4ebe-9b56-40d6d7a9390f tempest-VolumesExtendTest-1257807882 None] Flow 'volume_create_manager' (92025ddc-5c73-457e-9a4b-d9773edfe336) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:15:02 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-ac11c6de-1aa4-4ebe-9b56-40d6d7a9390f tempest-VolumesExtendTest-1257807882 None] Created volume successfully. Nov 02 10:15:02 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-a8b6af78-294d-4f59-b4b9-70051491a1b1 tempest-VolumeImageDependencyTests-1166190201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60189865-3928-43a3-8b30-e491a8acc1d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd43a2697-4a4b-4a80-ba1b-a8e5764460d7', 'volume_name': 'volume-d43a2697-4a4b-4a80-ba1b-a8e5764460d7', 'volume_size': 1, 'image_id': '495e63a7-2d88-42d3-848f-4561219e36cd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/495e63a7-2d88-42d3-848f-4561219e36cd', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'edb32be3fbf553f9e451b3751bc53bc5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a96e4e634aac47c0a119e1b5b8d3a58f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7768ae0badd5165f8d5c747004c50ec8db326e2873653bf33eb152b42de2454dd4392875f8b3ae3a68b876bc8dd10a88a687b9506546c403b618d0291704e015', 'id': '495e63a7-2d88-42d3-848f-4561219e36cd', 'created_at': datetime.datetime(2026, 11, 2, 9, 14, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 15, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/495e63a7-2d88-42d3-848f-4561219e36cd/file', 'properties': {}}, 'image_service': }' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:02 devstack sudo[98887]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:02 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-a8b6af78-294d-4f59-b4b9-70051491a1b1 tempest-VolumeImageDependencyTests-1166190201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b179ac5b-cb00-4012-8a89-40f83a108381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:02 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-a8b6af78-294d-4f59-b4b9-70051491a1b1 tempest-VolumeImageDependencyTests-1166190201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b179ac5b-cb00-4012-8a89-40f83a108381) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:02 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-a8b6af78-294d-4f59-b4b9-70051491a1b1 tempest-VolumeImageDependencyTests-1166190201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20bb4460-aee6-44ad-8f74-d378f398de13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:02 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-a8b6af78-294d-4f59-b4b9-70051491a1b1 tempest-VolumeImageDependencyTests-1166190201 None] Volume d43a2697-4a4b-4a80-ba1b-a8e5764460d7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d43a2697-4a4b-4a80-ba1b-a8e5764460d7', 'volume_size': 1, 'image_id': '495e63a7-2d88-42d3-848f-4561219e36cd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/495e63a7-2d88-42d3-848f-4561219e36cd', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'edb32be3fbf553f9e451b3751bc53bc5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a96e4e634aac47c0a119e1b5b8d3a58f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7768ae0badd5165f8d5c747004c50ec8db326e2873653bf33eb152b42de2454dd4392875f8b3ae3a68b876bc8dd10a88a687b9506546c403b618d0291704e015', 'id': '495e63a7-2d88-42d3-848f-4561219e36cd', 'created_at': datetime.datetime(2026, 11, 2, 9, 14, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 15, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/495e63a7-2d88-42d3-848f-4561219e36cd/file', 'properties': {}}, 'image_service': } Nov 02 10:15:02 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8b6af78-294d-4f59-b4b9-70051491a1b1 tempest-VolumeImageDependencyTests-1166190201 None] Trying to clone d43a2697-4a4b-4a80-ba1b-a8e5764460d7 from image 495e63a7-2d88-42d3-848f-4561219e36cd at location (None, [{'url': 'file:///opt/stack/data/glance/images/495e63a7-2d88-42d3-848f-4561219e36cd', 'metadata': {}}]). {{(pid=86890) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 02 10:15:02 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a48c3874-26e7-4f94-ad6d-1b526f7dc701 tempest-VolumesCloneTest-102722810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e37e8636-a7f4-4096-9e00-9d893d066b88 1073741824" returned: 0 in 0.531s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:02 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a48c3874-26e7-4f94-ad6d-1b526f7dc701 tempest-VolumesCloneTest-102722810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e37e8636-a7f4-4096-9e00-9d893d066b88 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:02 devstack sudo[98893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e37e8636-a7f4-4096-9e00-9d893d066b88 Nov 02 10:15:02 devstack sudo[98893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:02 devstack cinder-volume[86890]: DEBUG cinder.image.image_utils [None req-a8b6af78-294d-4f59-b4b9-70051491a1b1 tempest-VolumeImageDependencyTests-1166190201 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_495e63a7-2d88-42d3-848f-4561219e36cd_rndce4s6devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86890) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 02 10:15:02 devstack cinder-volume[86890]: INFO cinder.image.image_utils [None req-a8b6af78-294d-4f59-b4b9-70051491a1b1 tempest-VolumeImageDependencyTests-1166190201 None] Image download 0.00 MB at 0.00 MB/s Nov 02 10:15:03 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[55a72007-6e7c-49be-a99f-b8bd0c15f0be]: (4, 'raw') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:15:03 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a8b6af78-294d-4f59-b4b9-70051491a1b1 tempest-VolumeImageDependencyTests-1166190201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_495e63a7-2d88-42d3-848f-4561219e36cd_rndce4s6devstack@QuobyteHD {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:03 devstack sudo[98895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_495e63a7-2d88-42d3-848f-4561219e36cd_rndce4s6devstack@QuobyteHD Nov 02 10:15:03 devstack sudo[98895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:03 devstack sudo[98893]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:03 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a48c3874-26e7-4f94-ad6d-1b526f7dc701 tempest-VolumesCloneTest-102722810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e37e8636-a7f4-4096-9e00-9d893d066b88" returned: 0 in 0.368s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:03 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-a48c3874-26e7-4f94-ad6d-1b526f7dc701 tempest-VolumesCloneTest-102722810 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:15:03 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-a48c3874-26e7-4f94-ad6d-1b526f7dc701 tempest-VolumesCloneTest-102722810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:15:03 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-a48c3874-26e7-4f94-ad6d-1b526f7dc701 tempest-VolumesCloneTest-102722810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58c1d4ca-7b0d-4691-a0ef-98383e977f72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e37e8636-a7f4-4096-9e00-9d893d066b88', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:03 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-a48c3874-26e7-4f94-ad6d-1b526f7dc701 tempest-VolumesCloneTest-102722810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92071d14-3ed0-440d-adb4-6e27d64f36ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:03 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-a48c3874-26e7-4f94-ad6d-1b526f7dc701 tempest-VolumesCloneTest-102722810 None] Volume volume-e37e8636-a7f4-4096-9e00-9d893d066b88 (e37e8636-a7f4-4096-9e00-9d893d066b88): created successfully Nov 02 10:15:03 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-a48c3874-26e7-4f94-ad6d-1b526f7dc701 tempest-VolumesCloneTest-102722810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92071d14-3ed0-440d-adb4-6e27d64f36ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:03 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-a48c3874-26e7-4f94-ad6d-1b526f7dc701 tempest-VolumesCloneTest-102722810 None] Flow 'volume_create_manager' (e255e9f0-1218-4a63-8f13-4d4c1d5186ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:15:03 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-a48c3874-26e7-4f94-ad6d-1b526f7dc701 tempest-VolumesCloneTest-102722810 None] Created volume successfully. Nov 02 10:15:03 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c3dbbaaf-5c5c-4962-b2db-785cd69f3674 tempest-VolumesExtendTest-1257807882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:15:03 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c3dbbaaf-5c5c-4962-b2db-785cd69f3674 tempest-VolumesExtendTest-1257807882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:15:03 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-c3dbbaaf-5c5c-4962-b2db-785cd69f3674 tempest-VolumesExtendTest-1257807882 None] Creating offline snapshot 5018e15c-7feb-4c88-9e0d-7536c5a143a0 of volume dc06dcb8-df01-4808-b7eb-04597e815526 {{(pid=86890) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:15:03 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[1845b51b-c06f-4537-8ca9-8e8c94628e82]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:15:03 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c3dbbaaf-5c5c-4962-b2db-785cd69f3674 tempest-VolumesExtendTest-1257807882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dc06dcb8-df01-4808-b7eb-04597e815526 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:03 devstack sudo[98895]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:03 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a8b6af78-294d-4f59-b4b9-70051491a1b1 tempest-VolumeImageDependencyTests-1166190201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_495e63a7-2d88-42d3-848f-4561219e36cd_rndce4s6devstack@QuobyteHD" returned: 0 in 0.436s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:03 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a8b6af78-294d-4f59-b4b9-70051491a1b1 tempest-VolumeImageDependencyTests-1166190201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_495e63a7-2d88-42d3-848f-4561219e36cd_rndce4s6devstack@QuobyteHD {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:03 devstack sudo[98900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dc06dcb8-df01-4808-b7eb-04597e815526 Nov 02 10:15:03 devstack sudo[98900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:03 devstack sudo[98901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_495e63a7-2d88-42d3-848f-4561219e36cd_rndce4s6devstack@QuobyteHD Nov 02 10:15:03 devstack sudo[98901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:03 devstack sudo[98901]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:03 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a8b6af78-294d-4f59-b4b9-70051491a1b1 tempest-VolumeImageDependencyTests-1166190201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_495e63a7-2d88-42d3-848f-4561219e36cd_rndce4s6devstack@QuobyteHD" returned: 1 in 0.355s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:03 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a8b6af78-294d-4f59-b4b9-70051491a1b1 tempest-VolumeImageDependencyTests-1166190201 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_495e63a7-2d88-42d3-848f-4561219e36cd_rndce4s6devstack@QuobyteHD' failed. Not Retrying. {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 10:15:03 devstack cinder-volume[86890]: DEBUG cinder.image.image_utils [None req-a8b6af78-294d-4f59-b4b9-70051491a1b1 tempest-VolumeImageDependencyTests-1166190201 None] Temporary image 495e63a7-2d88-42d3-848f-4561219e36cd is fetched for user 7be312fdaad34643a55463c3edfe54ba. {{(pid=86890) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 02 10:15:03 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[0064c38e-35b0-41bd-9cdc-68271a3774c4]: (4, 'raw') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:15:03 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a8b6af78-294d-4f59-b4b9-70051491a1b1 tempest-VolumeImageDependencyTests-1166190201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_495e63a7-2d88-42d3-848f-4561219e36cd_rndce4s6devstack@QuobyteHD {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:03 devstack sudo[98900]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:03 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c3dbbaaf-5c5c-4962-b2db-785cd69f3674 tempest-VolumesExtendTest-1257807882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dc06dcb8-df01-4808-b7eb-04597e815526" returned: 0 in 0.474s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:03 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c3dbbaaf-5c5c-4962-b2db-785cd69f3674 tempest-VolumesExtendTest-1257807882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dc06dcb8-df01-4808-b7eb-04597e815526,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dc06dcb8-df01-4808-b7eb-04597e815526.5018e15c-7feb-4c88-9e0d-7536c5a143a0 1G {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:03 devstack sudo[98912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dc06dcb8-df01-4808-b7eb-04597e815526,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dc06dcb8-df01-4808-b7eb-04597e815526.5018e15c-7feb-4c88-9e0d-7536c5a143a0 1G Nov 02 10:15:03 devstack sudo[98912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:04 devstack sudo[98911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_495e63a7-2d88-42d3-848f-4561219e36cd_rndce4s6devstack@QuobyteHD Nov 02 10:15:04 devstack sudo[98911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:04 devstack sudo[98911]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:04 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a8b6af78-294d-4f59-b4b9-70051491a1b1 tempest-VolumeImageDependencyTests-1166190201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_495e63a7-2d88-42d3-848f-4561219e36cd_rndce4s6devstack@QuobyteHD" returned: 0 in 0.548s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:04 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a8b6af78-294d-4f59-b4b9-70051491a1b1 tempest-VolumeImageDependencyTests-1166190201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_495e63a7-2d88-42d3-848f-4561219e36cd_rndce4s6devstack@QuobyteHD {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:04 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0d627e1-394d-4431-a029-2594eed45b38 tempest-VolumesCloneTest-102722810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:15:04 devstack sudo[98912]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:04 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c3dbbaaf-5c5c-4962-b2db-785cd69f3674 tempest-VolumesExtendTest-1257807882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dc06dcb8-df01-4808-b7eb-04597e815526,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dc06dcb8-df01-4808-b7eb-04597e815526.5018e15c-7feb-4c88-9e0d-7536c5a143a0 1G" returned: 0 in 0.586s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:04 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c3dbbaaf-5c5c-4962-b2db-785cd69f3674 tempest-VolumesExtendTest-1257807882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc06dcb8-df01-4808-b7eb-04597e815526 -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dc06dcb8-df01-4808-b7eb-04597e815526.5018e15c-7feb-4c88-9e0d-7536c5a143a0 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:04 devstack sudo[98922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc06dcb8-df01-4808-b7eb-04597e815526 -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dc06dcb8-df01-4808-b7eb-04597e815526.5018e15c-7feb-4c88-9e0d-7536c5a143a0 Nov 02 10:15:04 devstack sudo[98922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:04 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c0d627e1-394d-4431-a029-2594eed45b38 tempest-VolumesCloneTest-102722810 None] Flow 'volume_create_manager' (09baac98-ef8a-4a63-91c9-b76275935ff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:15:04 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c0d627e1-394d-4431-a029-2594eed45b38 tempest-VolumesCloneTest-102722810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f49d5f10-527d-4d18-b751-a6c2e3bc6287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:04 devstack sudo[98921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_495e63a7-2d88-42d3-848f-4561219e36cd_rndce4s6devstack@QuobyteHD Nov 02 10:15:04 devstack sudo[98921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:04 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c0d627e1-394d-4431-a029-2594eed45b38 tempest-VolumesCloneTest-102722810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f49d5f10-527d-4d18-b751-a6c2e3bc6287) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:15:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-588238832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40d92118-5144-48bd-b532-e165a73f644e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6db89c8c9ec4e2ca63620e9d9f7063e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:15:04Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=e37e8636-a7f4-4096-9e00-9d893d066b88,status='creating',terminated_at=None,updated_at=2026-11-02T09:15:04Z,use_quota=True,user_id='cbb179ce06974bce98897b83e01925b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:04 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c0d627e1-394d-4431-a029-2594eed45b38 tempest-VolumesCloneTest-102722810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0997c74a-4437-4a45-a3ed-1bdaf3af86f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:04 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c0d627e1-394d-4431-a029-2594eed45b38 tempest-VolumesCloneTest-102722810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0997c74a-4437-4a45-a3ed-1bdaf3af86f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:04 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c0d627e1-394d-4431-a029-2594eed45b38 tempest-VolumesCloneTest-102722810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b2403e6-e89a-49fa-ad49-5b007eae670f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:04 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c0d627e1-394d-4431-a029-2594eed45b38 tempest-VolumesCloneTest-102722810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b2403e6-e89a-49fa-ad49-5b007eae670f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '40d92118-5144-48bd-b532-e165a73f644e', 'volume_name': 'volume-40d92118-5144-48bd-b532-e165a73f644e', 'volume_size': 2, 'source_volid': 'e37e8636-a7f4-4096-9e00-9d893d066b88', 'source_volstatus': 'available'}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:04 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c0d627e1-394d-4431-a029-2594eed45b38 tempest-VolumesCloneTest-102722810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51d93eff-4060-4942-8d0d-0a64b2fab883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:04 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c0d627e1-394d-4431-a029-2594eed45b38 tempest-VolumesCloneTest-102722810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51d93eff-4060-4942-8d0d-0a64b2fab883) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:04 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c0d627e1-394d-4431-a029-2594eed45b38 tempest-VolumesCloneTest-102722810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e902e147-332e-4a15-a42c-434a4004cb0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:04 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-c0d627e1-394d-4431-a029-2594eed45b38 tempest-VolumesCloneTest-102722810 None] Volume 40d92118-5144-48bd-b532-e165a73f644e: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-40d92118-5144-48bd-b532-e165a73f644e', 'volume_size': 2, 'source_volid': 'e37e8636-a7f4-4096-9e00-9d893d066b88', 'source_volstatus': 'available'} Nov 02 10:15:04 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c0d627e1-394d-4431-a029-2594eed45b38 tempest-VolumesCloneTest-102722810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:15:04 devstack sudo[98922]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:04 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c3dbbaaf-5c5c-4962-b2db-785cd69f3674 tempest-VolumesExtendTest-1257807882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc06dcb8-df01-4808-b7eb-04597e815526 -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dc06dcb8-df01-4808-b7eb-04597e815526.5018e15c-7feb-4c88-9e0d-7536c5a143a0" returned: 0 in 0.387s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:04 devstack cinder-volume[86890]: WARNING cinder.volume.drivers.remotefs [None req-c3dbbaaf-5c5c-4962-b2db-785cd69f3674 tempest-VolumesExtendTest-1257807882 None] /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dc06dcb8-df01-4808-b7eb-04597e815526.5018e15c-7feb-4c88-9e0d-7536c5a143a0 is being set with open permissions: ugo+rw Nov 02 10:15:04 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c3dbbaaf-5c5c-4962-b2db-785cd69f3674 tempest-VolumesExtendTest-1257807882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dc06dcb8-df01-4808-b7eb-04597e815526.5018e15c-7feb-4c88-9e0d-7536c5a143a0 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:04 devstack sudo[98921]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:04 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a8b6af78-294d-4f59-b4b9-70051491a1b1 tempest-VolumeImageDependencyTests-1166190201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_495e63a7-2d88-42d3-848f-4561219e36cd_rndce4s6devstack@QuobyteHD" returned: 1 in 0.467s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:04 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a8b6af78-294d-4f59-b4b9-70051491a1b1 tempest-VolumeImageDependencyTests-1166190201 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_495e63a7-2d88-42d3-848f-4561219e36cd_rndce4s6devstack@QuobyteHD' failed. Not Retrying. {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 10:15:04 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-a8b6af78-294d-4f59-b4b9-70051491a1b1 tempest-VolumeImageDependencyTests-1166190201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:15:04 devstack sudo[98932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dc06dcb8-df01-4808-b7eb-04597e815526.5018e15c-7feb-4c88-9e0d-7536c5a143a0 Nov 02 10:15:04 devstack sudo[98932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:05 devstack sudo[98932]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:05 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c3dbbaaf-5c5c-4962-b2db-785cd69f3674 tempest-VolumesExtendTest-1257807882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dc06dcb8-df01-4808-b7eb-04597e815526.5018e15c-7feb-4c88-9e0d-7536c5a143a0" returned: 0 in 0.281s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:05 devstack cinder-volume[86890]: DEBUG dbcounter [-] [86890] Writing DB stats cinder:SELECT=103,cinder:UPDATE=125,cinder:INSERT=36,cinder:DELETE=10 {{(pid=86890) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:15:05 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c3dbbaaf-5c5c-4962-b2db-785cd69f3674 tempest-VolumesExtendTest-1257807882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dc06dcb8-df01-4808-b7eb-04597e815526.info {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:05 devstack sudo[98935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dc06dcb8-df01-4808-b7eb-04597e815526.info Nov 02 10:15:05 devstack sudo[98935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:05 devstack sudo[98935]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:05 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c3dbbaaf-5c5c-4962-b2db-785cd69f3674 tempest-VolumesExtendTest-1257807882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dc06dcb8-df01-4808-b7eb-04597e815526.info" returned: 0 in 0.278s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:05 devstack cinder-volume[86890]: WARNING cinder.volume.drivers.remotefs [None req-c3dbbaaf-5c5c-4962-b2db-785cd69f3674 tempest-VolumesExtendTest-1257807882 None] /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dc06dcb8-df01-4808-b7eb-04597e815526.info is being set with open permissions: ugo+rw Nov 02 10:15:05 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c3dbbaaf-5c5c-4962-b2db-785cd69f3674 tempest-VolumesExtendTest-1257807882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dc06dcb8-df01-4808-b7eb-04597e815526.info {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:05 devstack sudo[98938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dc06dcb8-df01-4808-b7eb-04597e815526.info Nov 02 10:15:05 devstack sudo[98938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:05 devstack sudo[98938]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:05 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c3dbbaaf-5c5c-4962-b2db-785cd69f3674 tempest-VolumesExtendTest-1257807882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dc06dcb8-df01-4808-b7eb-04597e815526.info" returned: 0 in 0.275s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:05 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c3dbbaaf-5c5c-4962-b2db-785cd69f3674 tempest-VolumesExtendTest-1257807882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.392s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:15:05 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c0d627e1-394d-4431-a029-2594eed45b38 tempest-VolumesCloneTest-102722810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 1.117s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:15:05 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-c0d627e1-394d-4431-a029-2594eed45b38 tempest-VolumesCloneTest-102722810 None] Cloning volume e37e8636-a7f4-4096-9e00-9d893d066b88 to volume 40d92118-5144-48bd-b532-e165a73f644e Nov 02 10:15:05 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-c0d627e1-394d-4431-a029-2594eed45b38 tempest-VolumesCloneTest-102722810 None] Creating offline snapshot 77c9c886-a8ac-48e8-aa38-5189ef975ac1 of volume e37e8636-a7f4-4096-9e00-9d893d066b88 {{(pid=86890) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:15:05 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-c3dbbaaf-5c5c-4962-b2db-785cd69f3674 tempest-VolumesExtendTest-1257807882 None] Create snapshot completed successfully Nov 02 10:15:05 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[eef1d4d1-59e6-4f59-a29e-64a72ffa5551]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:15:05 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c0d627e1-394d-4431-a029-2594eed45b38 tempest-VolumesCloneTest-102722810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e37e8636-a7f4-4096-9e00-9d893d066b88 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:06 devstack sudo[98941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e37e8636-a7f4-4096-9e00-9d893d066b88 Nov 02 10:15:06 devstack sudo[98941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:06 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-182686d8-d9e7-4f82-8e45-5067ba49f5c1 tempest-VolumesTransfersTest-502438195 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:15:06 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-182686d8-d9e7-4f82-8e45-5067ba49f5c1 tempest-VolumesTransfersTest-502438195 None] Flow 'volume_create_manager' (16260118-8436-4945-b3fc-199ca7d9000e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:15:06 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-182686d8-d9e7-4f82-8e45-5067ba49f5c1 tempest-VolumesTransfersTest-502438195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3aabb02b-492f-4733-b3c2-ec545bb07309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:06 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-182686d8-d9e7-4f82-8e45-5067ba49f5c1 tempest-VolumesTransfersTest-502438195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3aabb02b-492f-4733-b3c2-ec545bb07309) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:15:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-308554081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b76a0f0-d451-4620-905b-75293e69a872,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1852791b5bf472fbb6a8fc2ca5295be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:15:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:15:06Z,use_quota=True,user_id='4dabcf62d0f14328a961a7a20d58970e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:06 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-182686d8-d9e7-4f82-8e45-5067ba49f5c1 tempest-VolumesTransfersTest-502438195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (459da0ce-c75c-4022-b57d-9688ed5c1df2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:06 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-182686d8-d9e7-4f82-8e45-5067ba49f5c1 tempest-VolumesTransfersTest-502438195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (459da0ce-c75c-4022-b57d-9688ed5c1df2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:06 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-182686d8-d9e7-4f82-8e45-5067ba49f5c1 tempest-VolumesTransfersTest-502438195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8992dbb7-c4fd-4b5c-b5dd-21e3b0bca8e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:06 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-182686d8-d9e7-4f82-8e45-5067ba49f5c1 tempest-VolumesTransfersTest-502438195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8992dbb7-c4fd-4b5c-b5dd-21e3b0bca8e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b76a0f0-d451-4620-905b-75293e69a872', 'volume_name': 'volume-3b76a0f0-d451-4620-905b-75293e69a872', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:06 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-182686d8-d9e7-4f82-8e45-5067ba49f5c1 tempest-VolumesTransfersTest-502438195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0db2943-c84f-4fde-93d3-36a278d08cac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:06 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-182686d8-d9e7-4f82-8e45-5067ba49f5c1 tempest-VolumesTransfersTest-502438195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0db2943-c84f-4fde-93d3-36a278d08cac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:06 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-182686d8-d9e7-4f82-8e45-5067ba49f5c1 tempest-VolumesTransfersTest-502438195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (375fe44b-9eae-488c-80c6-421737b2237d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:06 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-182686d8-d9e7-4f82-8e45-5067ba49f5c1 tempest-VolumesTransfersTest-502438195 None] Volume 3b76a0f0-d451-4620-905b-75293e69a872: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b76a0f0-d451-4620-905b-75293e69a872', 'volume_size': 1} Nov 02 10:15:06 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-182686d8-d9e7-4f82-8e45-5067ba49f5c1 tempest-VolumesTransfersTest-502438195 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:15:06 devstack sudo[98941]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:06 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c0d627e1-394d-4431-a029-2594eed45b38 tempest-VolumesCloneTest-102722810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e37e8636-a7f4-4096-9e00-9d893d066b88" returned: 0 in 0.381s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:06 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c0d627e1-394d-4431-a029-2594eed45b38 tempest-VolumesCloneTest-102722810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e37e8636-a7f4-4096-9e00-9d893d066b88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e37e8636-a7f4-4096-9e00-9d893d066b88.77c9c886-a8ac-48e8-aa38-5189ef975ac1 1G {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:06 devstack sudo[98946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e37e8636-a7f4-4096-9e00-9d893d066b88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e37e8636-a7f4-4096-9e00-9d893d066b88.77c9c886-a8ac-48e8-aa38-5189ef975ac1 1G Nov 02 10:15:06 devstack sudo[98946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:06 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-57fc9ccf-6949-448a-8b84-b16a7690d442 tempest-VolumesExtendTest-1257807882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:15:06 devstack sudo[98946]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:06 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c0d627e1-394d-4431-a029-2594eed45b38 tempest-VolumesCloneTest-102722810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e37e8636-a7f4-4096-9e00-9d893d066b88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e37e8636-a7f4-4096-9e00-9d893d066b88.77c9c886-a8ac-48e8-aa38-5189ef975ac1 1G" returned: 0 in 0.534s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:06 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c0d627e1-394d-4431-a029-2594eed45b38 tempest-VolumesCloneTest-102722810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e37e8636-a7f4-4096-9e00-9d893d066b88 -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e37e8636-a7f4-4096-9e00-9d893d066b88.77c9c886-a8ac-48e8-aa38-5189ef975ac1 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:06 devstack sudo[98952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e37e8636-a7f4-4096-9e00-9d893d066b88 -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e37e8636-a7f4-4096-9e00-9d893d066b88.77c9c886-a8ac-48e8-aa38-5189ef975ac1 Nov 02 10:15:06 devstack sudo[98952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:07 devstack sudo[98952]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:07 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c0d627e1-394d-4431-a029-2594eed45b38 tempest-VolumesCloneTest-102722810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e37e8636-a7f4-4096-9e00-9d893d066b88 -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e37e8636-a7f4-4096-9e00-9d893d066b88.77c9c886-a8ac-48e8-aa38-5189ef975ac1" returned: 0 in 0.328s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:07 devstack cinder-volume[86890]: WARNING cinder.volume.drivers.remotefs [None req-c0d627e1-394d-4431-a029-2594eed45b38 tempest-VolumesCloneTest-102722810 None] /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e37e8636-a7f4-4096-9e00-9d893d066b88.77c9c886-a8ac-48e8-aa38-5189ef975ac1 is being set with open permissions: ugo+rw Nov 02 10:15:07 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c0d627e1-394d-4431-a029-2594eed45b38 tempest-VolumesCloneTest-102722810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e37e8636-a7f4-4096-9e00-9d893d066b88.77c9c886-a8ac-48e8-aa38-5189ef975ac1 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:07 devstack sudo[98957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e37e8636-a7f4-4096-9e00-9d893d066b88.77c9c886-a8ac-48e8-aa38-5189ef975ac1 Nov 02 10:15:07 devstack sudo[98957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:07 devstack sudo[98957]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:07 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c0d627e1-394d-4431-a029-2594eed45b38 tempest-VolumesCloneTest-102722810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e37e8636-a7f4-4096-9e00-9d893d066b88.77c9c886-a8ac-48e8-aa38-5189ef975ac1" returned: 0 in 0.248s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:07 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c0d627e1-394d-4431-a029-2594eed45b38 tempest-VolumesCloneTest-102722810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e37e8636-a7f4-4096-9e00-9d893d066b88.info {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:07 devstack sudo[98960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e37e8636-a7f4-4096-9e00-9d893d066b88.info Nov 02 10:15:07 devstack sudo[98960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:07 devstack sudo[98960]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:07 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c0d627e1-394d-4431-a029-2594eed45b38 tempest-VolumesCloneTest-102722810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e37e8636-a7f4-4096-9e00-9d893d066b88.info" returned: 0 in 0.269s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:07 devstack cinder-volume[86890]: WARNING cinder.volume.drivers.remotefs [None req-c0d627e1-394d-4431-a029-2594eed45b38 tempest-VolumesCloneTest-102722810 None] /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e37e8636-a7f4-4096-9e00-9d893d066b88.info is being set with open permissions: ugo+rw Nov 02 10:15:07 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c0d627e1-394d-4431-a029-2594eed45b38 tempest-VolumesCloneTest-102722810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e37e8636-a7f4-4096-9e00-9d893d066b88.info {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:07 devstack sudo[98963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e37e8636-a7f4-4096-9e00-9d893d066b88.info Nov 02 10:15:07 devstack sudo[98963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:07 devstack sudo[98963]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:07 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c0d627e1-394d-4431-a029-2594eed45b38 tempest-VolumesCloneTest-102722810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e37e8636-a7f4-4096-9e00-9d893d066b88.info" returned: 0 in 0.262s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:07 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-c0d627e1-394d-4431-a029-2594eed45b38 tempest-VolumesCloneTest-102722810 None] Acquiring lock "cinder-quobyte-40d92118-5144-48bd-b532-e165a73f644e" by "_copy_volume_from_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:15:07 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-c0d627e1-394d-4431-a029-2594eed45b38 tempest-VolumesCloneTest-102722810 None] Lock "cinder-quobyte-40d92118-5144-48bd-b532-e165a73f644e" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:15:07 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c0d627e1-394d-4431-a029-2594eed45b38 tempest-VolumesCloneTest-102722810 None] snapshot: 77c9c886-a8ac-48e8-aa38-5189ef975ac1, volume: 40d92118-5144-48bd-b532-e165a73f644e, {{(pid=86890) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 10:15:07 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c0d627e1-394d-4431-a029-2594eed45b38 tempest-VolumesCloneTest-102722810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:15:07 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c0d627e1-394d-4431-a029-2594eed45b38 tempest-VolumesCloneTest-102722810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:15:07 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c0d627e1-394d-4431-a029-2594eed45b38 tempest-VolumesCloneTest-102722810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:15:08 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c0d627e1-394d-4431-a029-2594eed45b38 tempest-VolumesCloneTest-102722810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:15:08 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c0d627e1-394d-4431-a029-2594eed45b38 tempest-VolumesCloneTest-102722810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:15:08 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee20d8df-725a-4e81-824a-7f2cd651e9ea]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:15:08 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c0d627e1-394d-4431-a029-2594eed45b38 tempest-VolumesCloneTest-102722810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e37e8636-a7f4-4096-9e00-9d893d066b88.77c9c886-a8ac-48e8-aa38-5189ef975ac1 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:08 devstack sudo[98966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e37e8636-a7f4-4096-9e00-9d893d066b88.77c9c886-a8ac-48e8-aa38-5189ef975ac1 Nov 02 10:15:08 devstack sudo[98966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:08 devstack sudo[98966]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:08 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c0d627e1-394d-4431-a029-2594eed45b38 tempest-VolumesCloneTest-102722810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e37e8636-a7f4-4096-9e00-9d893d066b88.77c9c886-a8ac-48e8-aa38-5189ef975ac1" returned: 0 in 0.352s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:08 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-c0d627e1-394d-4431-a029-2594eed45b38 tempest-VolumesCloneTest-102722810 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e37e8636-a7f4-4096-9e00-9d893d066b88(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86890) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:15:08 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[71f37e56-087e-41e6-a90b-df717da648bc]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:15:08 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c0d627e1-394d-4431-a029-2594eed45b38 tempest-VolumesCloneTest-102722810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e37e8636-a7f4-4096-9e00-9d893d066b88 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:08 devstack sudo[98971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e37e8636-a7f4-4096-9e00-9d893d066b88 Nov 02 10:15:08 devstack sudo[98971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:08 devstack sudo[98971]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:08 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c0d627e1-394d-4431-a029-2594eed45b38 tempest-VolumesCloneTest-102722810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e37e8636-a7f4-4096-9e00-9d893d066b88" returned: 0 in 0.375s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:08 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c0d627e1-394d-4431-a029-2594eed45b38 tempest-VolumesCloneTest-102722810 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e37e8636-a7f4-4096-9e00-9d893d066b88 {{(pid=86890) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 10:15:08 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c0d627e1-394d-4431-a029-2594eed45b38 tempest-VolumesCloneTest-102722810 None] Creating direct copy from snapshot {{(pid=86890) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 10:15:08 devstack cinder-volume[86890]: DEBUG cinder.utils [None req-c0d627e1-394d-4431-a029-2594eed45b38 tempest-VolumesCloneTest-102722810 None] Path /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-40d92118-5144-48bd-b532-e165a73f644e not found in is_blk_device check {{(pid=86890) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 10:15:08 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c0d627e1-394d-4431-a029-2594eed45b38 tempest-VolumesCloneTest-102722810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e37e8636-a7f4-4096-9e00-9d893d066b88 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-40d92118-5144-48bd-b532-e165a73f644e {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:08 devstack sudo[98976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e37e8636-a7f4-4096-9e00-9d893d066b88 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-40d92118-5144-48bd-b532-e165a73f644e Nov 02 10:15:08 devstack sudo[98976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:14 devstack sudo[98976]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:14 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c0d627e1-394d-4431-a029-2594eed45b38 tempest-VolumesCloneTest-102722810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e37e8636-a7f4-4096-9e00-9d893d066b88 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-40d92118-5144-48bd-b532-e165a73f644e" returned: 0 in 5.797s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:14 devstack cinder-volume[86890]: DEBUG cinder.image.image_utils [None req-c0d627e1-394d-4431-a029-2594eed45b38 tempest-VolumesCloneTest-102722810 None] Image conversion details: src /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e37e8636-a7f4-4096-9e00-9d893d066b88, size 1024.00 MB, duration 5.80 sec, destination /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-40d92118-5144-48bd-b532-e165a73f644e {{(pid=86890) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 10:15:14 devstack cinder-volume[86890]: INFO cinder.image.image_utils [None req-c0d627e1-394d-4431-a029-2594eed45b38 tempest-VolumesCloneTest-102722810 None] Converted 1024.00 MB image at 176.61 MB/s Nov 02 10:15:14 devstack cinder-volume[86890]: WARNING cinder.volume.drivers.remotefs [None req-c0d627e1-394d-4431-a029-2594eed45b38 tempest-VolumesCloneTest-102722810 None] /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-40d92118-5144-48bd-b532-e165a73f644e is being set with open permissions: ugo+rw Nov 02 10:15:14 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c0d627e1-394d-4431-a029-2594eed45b38 tempest-VolumesCloneTest-102722810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-40d92118-5144-48bd-b532-e165a73f644e {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:14 devstack sudo[98991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-40d92118-5144-48bd-b532-e165a73f644e Nov 02 10:15:14 devstack sudo[98991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:14 devstack sudo[98991]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:14 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c0d627e1-394d-4431-a029-2594eed45b38 tempest-VolumesCloneTest-102722810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-40d92118-5144-48bd-b532-e165a73f644e" returned: 0 in 0.285s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:14 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-c0d627e1-394d-4431-a029-2594eed45b38 tempest-VolumesCloneTest-102722810 None] Lock "cinder-quobyte-40d92118-5144-48bd-b532-e165a73f644e" released by "_copy_volume_from_snapshot" :: held 6.890s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:15:14 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-c0d627e1-394d-4431-a029-2594eed45b38 tempest-VolumesCloneTest-102722810 None] Acquiring lock "cinder-quobyte-77c9c886-a8ac-48e8-aa38-5189ef975ac1" by "_delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:15:14 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-c0d627e1-394d-4431-a029-2594eed45b38 tempest-VolumesCloneTest-102722810 None] Lock "cinder-quobyte-77c9c886-a8ac-48e8-aa38-5189ef975ac1" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:15:14 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-c0d627e1-394d-4431-a029-2594eed45b38 tempest-VolumesCloneTest-102722810 None] Deleting offline snapshot 77c9c886-a8ac-48e8-aa38-5189ef975ac1 of volume e37e8636-a7f4-4096-9e00-9d893d066b88 {{(pid=86890) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:15:14 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-c0d627e1-394d-4431-a029-2594eed45b38 tempest-VolumesCloneTest-102722810 None] snapshot_file for this snap is: volume-e37e8636-a7f4-4096-9e00-9d893d066b88.77c9c886-a8ac-48e8-aa38-5189ef975ac1 {{(pid=86890) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:15:14 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5bb1adf-a6d4-40a6-9bd9-fdd6308d1eb9]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:15:14 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c0d627e1-394d-4431-a029-2594eed45b38 tempest-VolumesCloneTest-102722810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e37e8636-a7f4-4096-9e00-9d893d066b88.77c9c886-a8ac-48e8-aa38-5189ef975ac1 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:15 devstack sudo[99028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e37e8636-a7f4-4096-9e00-9d893d066b88.77c9c886-a8ac-48e8-aa38-5189ef975ac1 Nov 02 10:15:15 devstack sudo[99028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:15 devstack sudo[99028]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:15 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c0d627e1-394d-4431-a029-2594eed45b38 tempest-VolumesCloneTest-102722810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e37e8636-a7f4-4096-9e00-9d893d066b88.77c9c886-a8ac-48e8-aa38-5189ef975ac1" returned: 0 in 0.369s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:15 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-c0d627e1-394d-4431-a029-2594eed45b38 tempest-VolumesCloneTest-102722810 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e37e8636-a7f4-4096-9e00-9d893d066b88(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86890) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:15:15 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b3dd606-94fe-4656-8d99-0484632f81b8]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:15:15 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c0d627e1-394d-4431-a029-2594eed45b38 tempest-VolumesCloneTest-102722810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e37e8636-a7f4-4096-9e00-9d893d066b88 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:15 devstack sudo[99035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e37e8636-a7f4-4096-9e00-9d893d066b88 Nov 02 10:15:15 devstack sudo[99035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:15 devstack sudo[99035]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:15 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c0d627e1-394d-4431-a029-2594eed45b38 tempest-VolumesCloneTest-102722810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e37e8636-a7f4-4096-9e00-9d893d066b88" returned: 0 in 0.508s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:15 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c0d627e1-394d-4431-a029-2594eed45b38 tempest-VolumesCloneTest-102722810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e37e8636-a7f4-4096-9e00-9d893d066b88.77c9c886-a8ac-48e8-aa38-5189ef975ac1 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:15 devstack sudo[99040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e37e8636-a7f4-4096-9e00-9d893d066b88.77c9c886-a8ac-48e8-aa38-5189ef975ac1 Nov 02 10:15:15 devstack sudo[99040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:16 devstack sudo[99040]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:16 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c0d627e1-394d-4431-a029-2594eed45b38 tempest-VolumesCloneTest-102722810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e37e8636-a7f4-4096-9e00-9d893d066b88.77c9c886-a8ac-48e8-aa38-5189ef975ac1" returned: 0 in 0.338s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:16 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c0d627e1-394d-4431-a029-2594eed45b38 tempest-VolumesCloneTest-102722810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e37e8636-a7f4-4096-9e00-9d893d066b88.77c9c886-a8ac-48e8-aa38-5189ef975ac1 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:16 devstack sudo[99051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e37e8636-a7f4-4096-9e00-9d893d066b88.77c9c886-a8ac-48e8-aa38-5189ef975ac1 Nov 02 10:15:16 devstack sudo[99051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:16 devstack sudo[99051]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:16 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c0d627e1-394d-4431-a029-2594eed45b38 tempest-VolumesCloneTest-102722810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e37e8636-a7f4-4096-9e00-9d893d066b88.77c9c886-a8ac-48e8-aa38-5189ef975ac1" returned: 0 in 0.242s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:16 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-c0d627e1-394d-4431-a029-2594eed45b38 tempest-VolumesCloneTest-102722810 None] Lock "cinder-quobyte-77c9c886-a8ac-48e8-aa38-5189ef975ac1" released by "_delete_snapshot" :: held 1.558s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:15:16 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c0d627e1-394d-4431-a029-2594eed45b38 tempest-VolumesCloneTest-102722810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.699s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:15:16 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-a8b6af78-294d-4f59-b4b9-70051491a1b1 tempest-VolumeImageDependencyTests-1166190201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.593s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:15:16 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-a8b6af78-294d-4f59-b4b9-70051491a1b1 tempest-VolumeImageDependencyTests-1166190201 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:15:02Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d43a2697-4a4b-4a80-ba1b-a8e5764460d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a96e4e634aac47c0a119e1b5b8d3a58f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:15:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:15:02Z,use_quota=True,user_id='7be312fdaad34643a55463c3edfe54ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:15:16 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-a8b6af78-294d-4f59-b4b9-70051491a1b1 tempest-VolumeImageDependencyTests-1166190201 None] Creating volume d43a2697-4a4b-4a80-ba1b-a8e5764460d7 {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:15:16 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-a8b6af78-294d-4f59-b4b9-70051491a1b1 tempest-VolumeImageDependencyTests-1166190201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:15:16 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-a8b6af78-294d-4f59-b4b9-70051491a1b1 tempest-VolumeImageDependencyTests-1166190201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:15:16 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-a8b6af78-294d-4f59-b4b9-70051491a1b1 tempest-VolumeImageDependencyTests-1166190201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:15:16 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-a8b6af78-294d-4f59-b4b9-70051491a1b1 tempest-VolumeImageDependencyTests-1166190201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:15:16 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-a8b6af78-294d-4f59-b4b9-70051491a1b1 tempest-VolumeImageDependencyTests-1166190201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:15:16 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-a8b6af78-294d-4f59-b4b9-70051491a1b1 tempest-VolumeImageDependencyTests-1166190201 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:15:16 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-a8b6af78-294d-4f59-b4b9-70051491a1b1 tempest-VolumeImageDependencyTests-1166190201 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:15:16 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a8b6af78-294d-4f59-b4b9-70051491a1b1 tempest-VolumeImageDependencyTests-1166190201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-d43a2697-4a4b-4a80-ba1b-a8e5764460d7 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:16 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c0d627e1-394d-4431-a029-2594eed45b38 tempest-VolumesCloneTest-102722810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e902e147-332e-4a15-a42c-434a4004cb0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40d92118-5144-48bd-b532-e165a73f644e', 'volume_size': 2, 'source_volid': 'e37e8636-a7f4-4096-9e00-9d893d066b88', 'source_volstatus': 'available'}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:16 devstack sudo[99056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-d43a2697-4a4b-4a80-ba1b-a8e5764460d7 1073741824 Nov 02 10:15:16 devstack sudo[99056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:16 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c0d627e1-394d-4431-a029-2594eed45b38 tempest-VolumesCloneTest-102722810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c194a30e-0005-402f-82be-12073ffc59e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:16 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-c0d627e1-394d-4431-a029-2594eed45b38 tempest-VolumesCloneTest-102722810 None] Volume volume-40d92118-5144-48bd-b532-e165a73f644e (40d92118-5144-48bd-b532-e165a73f644e): created successfully Nov 02 10:15:16 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c0d627e1-394d-4431-a029-2594eed45b38 tempest-VolumesCloneTest-102722810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c194a30e-0005-402f-82be-12073ffc59e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:16 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c0d627e1-394d-4431-a029-2594eed45b38 tempest-VolumesCloneTest-102722810 None] Flow 'volume_create_manager' (09baac98-ef8a-4a63-91c9-b76275935ff3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:15:16 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-c0d627e1-394d-4431-a029-2594eed45b38 tempest-VolumesCloneTest-102722810 None] Created volume successfully. Nov 02 10:15:16 devstack sudo[99056]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:17 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a8b6af78-294d-4f59-b4b9-70051491a1b1 tempest-VolumeImageDependencyTests-1166190201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-d43a2697-4a4b-4a80-ba1b-a8e5764460d7 1073741824" returned: 0 in 0.492s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:17 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a8b6af78-294d-4f59-b4b9-70051491a1b1 tempest-VolumeImageDependencyTests-1166190201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-d43a2697-4a4b-4a80-ba1b-a8e5764460d7 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:17 devstack sudo[99061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-d43a2697-4a4b-4a80-ba1b-a8e5764460d7 Nov 02 10:15:17 devstack sudo[99061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:17 devstack sudo[99061]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:17 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a8b6af78-294d-4f59-b4b9-70051491a1b1 tempest-VolumeImageDependencyTests-1166190201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-d43a2697-4a4b-4a80-ba1b-a8e5764460d7" returned: 0 in 0.299s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:17 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-a8b6af78-294d-4f59-b4b9-70051491a1b1 tempest-VolumeImageDependencyTests-1166190201 None] <== create_volume: return (863ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:15:17 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-a8b6af78-294d-4f59-b4b9-70051491a1b1 tempest-VolumeImageDependencyTests-1166190201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.868s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:15:17 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-182686d8-d9e7-4f82-8e45-5067ba49f5c1 tempest-VolumesTransfersTest-502438195 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.258s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:15:17 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-182686d8-d9e7-4f82-8e45-5067ba49f5c1 tempest-VolumesTransfersTest-502438195 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:15:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-308554081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b76a0f0-d451-4620-905b-75293e69a872,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1852791b5bf472fbb6a8fc2ca5295be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:15:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:15:06Z,use_quota=True,user_id='4dabcf62d0f14328a961a7a20d58970e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:15:17 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-182686d8-d9e7-4f82-8e45-5067ba49f5c1 tempest-VolumesTransfersTest-502438195 None] Creating volume 3b76a0f0-d451-4620-905b-75293e69a872 {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:15:17 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-182686d8-d9e7-4f82-8e45-5067ba49f5c1 tempest-VolumesTransfersTest-502438195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:15:17 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-182686d8-d9e7-4f82-8e45-5067ba49f5c1 tempest-VolumesTransfersTest-502438195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:15:17 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-182686d8-d9e7-4f82-8e45-5067ba49f5c1 tempest-VolumesTransfersTest-502438195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:15:17 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-182686d8-d9e7-4f82-8e45-5067ba49f5c1 tempest-VolumesTransfersTest-502438195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:15:17 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-182686d8-d9e7-4f82-8e45-5067ba49f5c1 tempest-VolumesTransfersTest-502438195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:15:17 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-182686d8-d9e7-4f82-8e45-5067ba49f5c1 tempest-VolumesTransfersTest-502438195 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:15:17 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-182686d8-d9e7-4f82-8e45-5067ba49f5c1 tempest-VolumesTransfersTest-502438195 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:15:17 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-182686d8-d9e7-4f82-8e45-5067ba49f5c1 tempest-VolumesTransfersTest-502438195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3b76a0f0-d451-4620-905b-75293e69a872 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:17 devstack sudo[99064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3b76a0f0-d451-4620-905b-75293e69a872 1073741824 Nov 02 10:15:17 devstack sudo[99064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:17 devstack cinder-volume[86890]: DEBUG cinder.volume.volume_utils [None req-a8b6af78-294d-4f59-b4b9-70051491a1b1 tempest-VolumeImageDependencyTests-1166190201 None] Attempting download of 495e63a7-2d88-42d3-848f-4561219e36cd ((None, [{'url': 'file:///opt/stack/data/glance/images/495e63a7-2d88-42d3-848f-4561219e36cd', 'metadata': {}}])) to volume d43a2697-4a4b-4a80-ba1b-a8e5764460d7. {{(pid=86890) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 02 10:15:17 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[6047d2f4-9d9b-4a27-abe4-14eab09df2ac]: (4, 'raw') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:15:17 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a8b6af78-294d-4f59-b4b9-70051491a1b1 tempest-VolumeImageDependencyTests-1166190201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_495e63a7-2d88-42d3-848f-4561219e36cd__mqcijs1 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:17 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-c654b342-bb6d-4afc-adc1-8aa6609b1214 tempest-VolumesCloneTest-102722810 None] Acquiring lock "cinder-40d92118-5144-48bd-b532-e165a73f644e-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:15:17 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-c654b342-bb6d-4afc-adc1-8aa6609b1214 tempest-VolumesCloneTest-102722810 None] Lock "cinder-40d92118-5144-48bd-b532-e165a73f644e-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:15:17 devstack sudo[99066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_495e63a7-2d88-42d3-848f-4561219e36cd__mqcijs1 Nov 02 10:15:17 devstack sudo[99066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:17 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-c654b342-bb6d-4afc-adc1-8aa6609b1214 tempest-VolumesCloneTest-102722810 None] Acquiring lock "cinder-quobyte-40d92118-5144-48bd-b532-e165a73f644e" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:15:17 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-c654b342-bb6d-4afc-adc1-8aa6609b1214 tempest-VolumesCloneTest-102722810 None] Lock "cinder-quobyte-40d92118-5144-48bd-b532-e165a73f644e" acquired by "delete_volume" :: waited 0.023s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:15:17 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[a73fda27-47ba-4fb0-aba4-bfb930524f4c]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:15:17 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c654b342-bb6d-4afc-adc1-8aa6609b1214 tempest-VolumesCloneTest-102722810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-40d92118-5144-48bd-b532-e165a73f644e {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:17 devstack sudo[99071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-40d92118-5144-48bd-b532-e165a73f644e Nov 02 10:15:17 devstack sudo[99071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:17 devstack sudo[99066]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:17 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a8b6af78-294d-4f59-b4b9-70051491a1b1 tempest-VolumeImageDependencyTests-1166190201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_495e63a7-2d88-42d3-848f-4561219e36cd__mqcijs1" returned: 0 in 0.435s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:17 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a8b6af78-294d-4f59-b4b9-70051491a1b1 tempest-VolumeImageDependencyTests-1166190201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_495e63a7-2d88-42d3-848f-4561219e36cd__mqcijs1 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:18 devstack sudo[99064]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:18 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-182686d8-d9e7-4f82-8e45-5067ba49f5c1 tempest-VolumesTransfersTest-502438195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3b76a0f0-d451-4620-905b-75293e69a872 1073741824" returned: 0 in 0.668s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:18 devstack sudo[99075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_495e63a7-2d88-42d3-848f-4561219e36cd__mqcijs1 Nov 02 10:15:18 devstack sudo[99075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:18 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-182686d8-d9e7-4f82-8e45-5067ba49f5c1 tempest-VolumesTransfersTest-502438195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3b76a0f0-d451-4620-905b-75293e69a872 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:18 devstack sudo[99077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3b76a0f0-d451-4620-905b-75293e69a872 Nov 02 10:15:18 devstack sudo[99077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:18 devstack sudo[99071]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:18 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c654b342-bb6d-4afc-adc1-8aa6609b1214 tempest-VolumesCloneTest-102722810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-40d92118-5144-48bd-b532-e165a73f644e" returned: 0 in 0.480s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:18 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c654b342-bb6d-4afc-adc1-8aa6609b1214 tempest-VolumesCloneTest-102722810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-40d92118-5144-48bd-b532-e165a73f644e {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:18 devstack sudo[99083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-40d92118-5144-48bd-b532-e165a73f644e Nov 02 10:15:18 devstack sudo[99083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:18 devstack sudo[99077]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:18 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-182686d8-d9e7-4f82-8e45-5067ba49f5c1 tempest-VolumesTransfersTest-502438195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3b76a0f0-d451-4620-905b-75293e69a872" returned: 0 in 0.256s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:18 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-182686d8-d9e7-4f82-8e45-5067ba49f5c1 tempest-VolumesTransfersTest-502438195 None] <== create_volume: return (983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:15:18 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-182686d8-d9e7-4f82-8e45-5067ba49f5c1 tempest-VolumesTransfersTest-502438195 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.988s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:15:18 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-57fc9ccf-6949-448a-8b84-b16a7690d442 tempest-VolumesExtendTest-1257807882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 11.627s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:15:18 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-182686d8-d9e7-4f82-8e45-5067ba49f5c1 tempest-VolumesTransfersTest-502438195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (375fe44b-9eae-488c-80c6-421737b2237d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b76a0f0-d451-4620-905b-75293e69a872', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:18 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-182686d8-d9e7-4f82-8e45-5067ba49f5c1 tempest-VolumesTransfersTest-502438195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9eafdf89-be0f-47a4-b7eb-1884c5da113a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:18 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[47cdb97a-f236-4af7-9ee0-9f1258863a32]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:15:18 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-57fc9ccf-6949-448a-8b84-b16a7690d442 tempest-VolumesExtendTest-1257807882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dc06dcb8-df01-4808-b7eb-04597e815526 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:18 devstack sudo[99075]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:18 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-182686d8-d9e7-4f82-8e45-5067ba49f5c1 tempest-VolumesTransfersTest-502438195 None] Volume volume-3b76a0f0-d451-4620-905b-75293e69a872 (3b76a0f0-d451-4620-905b-75293e69a872): created successfully Nov 02 10:15:18 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-182686d8-d9e7-4f82-8e45-5067ba49f5c1 tempest-VolumesTransfersTest-502438195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9eafdf89-be0f-47a4-b7eb-1884c5da113a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:18 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-182686d8-d9e7-4f82-8e45-5067ba49f5c1 tempest-VolumesTransfersTest-502438195 None] Flow 'volume_create_manager' (16260118-8436-4945-b3fc-199ca7d9000e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:15:18 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a8b6af78-294d-4f59-b4b9-70051491a1b1 tempest-VolumeImageDependencyTests-1166190201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_495e63a7-2d88-42d3-848f-4561219e36cd__mqcijs1" returned: 1 in 0.479s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:18 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a8b6af78-294d-4f59-b4b9-70051491a1b1 tempest-VolumeImageDependencyTests-1166190201 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_495e63a7-2d88-42d3-848f-4561219e36cd__mqcijs1' failed. Not Retrying. {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 10:15:18 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2bc5d6d-50e6-4cd6-8248-81b349d374af]: (4, 'raw') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:15:18 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a8b6af78-294d-4f59-b4b9-70051491a1b1 tempest-VolumeImageDependencyTests-1166190201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_495e63a7-2d88-42d3-848f-4561219e36cd_rndce4s6devstack@QuobyteHD {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:18 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-182686d8-d9e7-4f82-8e45-5067ba49f5c1 tempest-VolumesTransfersTest-502438195 None] Created volume successfully. Nov 02 10:15:18 devstack sudo[99083]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:18 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c654b342-bb6d-4afc-adc1-8aa6609b1214 tempest-VolumesCloneTest-102722810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-40d92118-5144-48bd-b532-e165a73f644e" returned: 0 in 0.254s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:18 devstack sudo[99088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dc06dcb8-df01-4808-b7eb-04597e815526 Nov 02 10:15:18 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-c654b342-bb6d-4afc-adc1-8aa6609b1214 tempest-VolumesCloneTest-102722810 None] Lock "cinder-quobyte-40d92118-5144-48bd-b532-e165a73f644e" released by "delete_volume" :: held 0.793s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:15:18 devstack sudo[99088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:18 devstack sudo[99090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_495e63a7-2d88-42d3-848f-4561219e36cd_rndce4s6devstack@QuobyteHD Nov 02 10:15:18 devstack sudo[99090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:18 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-c654b342-bb6d-4afc-adc1-8aa6609b1214 tempest-VolumesCloneTest-102722810 None] Created reservations ['20cfb3f0-8029-4a6e-aa98-066e3dac9ea6', 'ebddca4a-e5e9-426c-9209-953b46e05ee0', '7f1d1c08-d880-441f-9784-01a99b82bcc3', '45a0479d-e0d6-40ff-9239-5ddae7b95b3a'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:15:18 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c654b342-bb6d-4afc-adc1-8aa6609b1214 tempest-VolumesCloneTest-102722810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:15:18 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c654b342-bb6d-4afc-adc1-8aa6609b1214 tempest-VolumesCloneTest-102722810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:15:18 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c654b342-bb6d-4afc-adc1-8aa6609b1214 tempest-VolumesCloneTest-102722810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:15:18 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c654b342-bb6d-4afc-adc1-8aa6609b1214 tempest-VolumesCloneTest-102722810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:15:18 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c654b342-bb6d-4afc-adc1-8aa6609b1214 tempest-VolumesCloneTest-102722810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:15:18 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c654b342-bb6d-4afc-adc1-8aa6609b1214 tempest-VolumesCloneTest-102722810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:18 devstack sudo[99095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:15:18 devstack sudo[99095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:18 devstack sudo[99088]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:18 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-57fc9ccf-6949-448a-8b84-b16a7690d442 tempest-VolumesExtendTest-1257807882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dc06dcb8-df01-4808-b7eb-04597e815526" returned: 0 in 0.462s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:18 devstack sudo[99090]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:18 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-57fc9ccf-6949-448a-8b84-b16a7690d442 tempest-VolumesExtendTest-1257807882 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dc06dcb8-df01-4808-b7eb-04597e815526.5018e15c-7feb-4c88-9e0d-7536c5a143a0 2G {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:18 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-2b9171f1-b3b7-4ab9-942e-8027eb845172 tempest-VolumesCloneTest-102722810 None] Acquiring lock "cinder-e37e8636-a7f4-4096-9e00-9d893d066b88-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:15:18 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a8b6af78-294d-4f59-b4b9-70051491a1b1 tempest-VolumeImageDependencyTests-1166190201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_495e63a7-2d88-42d3-848f-4561219e36cd_rndce4s6devstack@QuobyteHD" returned: 0 in 0.457s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:18 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a8b6af78-294d-4f59-b4b9-70051491a1b1 tempest-VolumeImageDependencyTests-1166190201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_495e63a7-2d88-42d3-848f-4561219e36cd_rndce4s6devstack@QuobyteHD {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:18 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-2b9171f1-b3b7-4ab9-942e-8027eb845172 tempest-VolumesCloneTest-102722810 None] Lock "cinder-e37e8636-a7f4-4096-9e00-9d893d066b88-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:15:19 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-2b9171f1-b3b7-4ab9-942e-8027eb845172 tempest-VolumesCloneTest-102722810 None] Acquiring lock "cinder-quobyte-e37e8636-a7f4-4096-9e00-9d893d066b88" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:15:19 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-2b9171f1-b3b7-4ab9-942e-8027eb845172 tempest-VolumesCloneTest-102722810 None] Lock "cinder-quobyte-e37e8636-a7f4-4096-9e00-9d893d066b88" acquired by "delete_volume" :: waited 0.023s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:15:19 devstack sudo[99102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_495e63a7-2d88-42d3-848f-4561219e36cd_rndce4s6devstack@QuobyteHD Nov 02 10:15:19 devstack sudo[99102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:19 devstack sudo[99095]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:19 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c654b342-bb6d-4afc-adc1-8aa6609b1214 tempest-VolumesCloneTest-102722810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.383s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:19 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-c654b342-bb6d-4afc-adc1-8aa6609b1214 tempest-VolumesCloneTest-102722810 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:15:19 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-57fc9ccf-6949-448a-8b84-b16a7690d442 tempest-VolumesExtendTest-1257807882 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dc06dcb8-df01-4808-b7eb-04597e815526.5018e15c-7feb-4c88-9e0d-7536c5a143a0 2G" returned: 0 in 0.255s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:19 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-57fc9ccf-6949-448a-8b84-b16a7690d442 tempest-VolumesExtendTest-1257807882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.777s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:15:19 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-c654b342-bb6d-4afc-adc1-8aa6609b1214 tempest-VolumesCloneTest-102722810 None] Deleted volume successfully. Nov 02 10:15:19 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[51a7a09d-8f7c-4333-b019-e338f169bf87]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:15:19 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-2b9171f1-b3b7-4ab9-942e-8027eb845172 tempest-VolumesCloneTest-102722810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e37e8636-a7f4-4096-9e00-9d893d066b88 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:19 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-c654b342-bb6d-4afc-adc1-8aa6609b1214 tempest-VolumesCloneTest-102722810 None] Lock "cinder-40d92118-5144-48bd-b532-e165a73f644e-delete_volume" released by "delete_volume" :: held 1.588s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:15:19 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-57fc9ccf-6949-448a-8b84-b16a7690d442 tempest-VolumesExtendTest-1257807882 None] Extend volume completed successfully. Nov 02 10:15:19 devstack sudo[99107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e37e8636-a7f4-4096-9e00-9d893d066b88 Nov 02 10:15:19 devstack sudo[99107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:19 devstack sudo[99102]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:19 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a8b6af78-294d-4f59-b4b9-70051491a1b1 tempest-VolumeImageDependencyTests-1166190201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_495e63a7-2d88-42d3-848f-4561219e36cd_rndce4s6devstack@QuobyteHD" returned: 1 in 0.410s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:19 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a8b6af78-294d-4f59-b4b9-70051491a1b1 tempest-VolumeImageDependencyTests-1166190201 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_495e63a7-2d88-42d3-848f-4561219e36cd_rndce4s6devstack@QuobyteHD' failed. Not Retrying. {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 10:15:19 devstack cinder-volume[86890]: DEBUG cinder.image.image_utils [None req-a8b6af78-294d-4f59-b4b9-70051491a1b1 tempest-VolumeImageDependencyTests-1166190201 None] 495e63a7-2d88-42d3-848f-4561219e36cd was raw, converting to qcow2 {{(pid=86890) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 02 10:15:19 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a8b6af78-294d-4f59-b4b9-70051491a1b1 tempest-VolumeImageDependencyTests-1166190201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_495e63a7-2d88-42d3-848f-4561219e36cd_rndce4s6devstack@QuobyteHD /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-d43a2697-4a4b-4a80-ba1b-a8e5764460d7 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:19 devstack sudo[99112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_495e63a7-2d88-42d3-848f-4561219e36cd_rndce4s6devstack@QuobyteHD /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-d43a2697-4a4b-4a80-ba1b-a8e5764460d7 Nov 02 10:15:19 devstack sudo[99112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:19 devstack sudo[99107]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:19 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-2b9171f1-b3b7-4ab9-942e-8027eb845172 tempest-VolumesCloneTest-102722810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e37e8636-a7f4-4096-9e00-9d893d066b88" returned: 0 in 0.414s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:19 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-2b9171f1-b3b7-4ab9-942e-8027eb845172 tempest-VolumesCloneTest-102722810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e37e8636-a7f4-4096-9e00-9d893d066b88 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:19 devstack sudo[99119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e37e8636-a7f4-4096-9e00-9d893d066b88 Nov 02 10:15:19 devstack sudo[99119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:19 devstack sudo[99119]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:19 devstack sudo[99112]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:19 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a8b6af78-294d-4f59-b4b9-70051491a1b1 tempest-VolumeImageDependencyTests-1166190201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_495e63a7-2d88-42d3-848f-4561219e36cd_rndce4s6devstack@QuobyteHD /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-d43a2697-4a4b-4a80-ba1b-a8e5764460d7" returned: 0 in 0.590s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:19 devstack cinder-volume[86890]: DEBUG cinder.image.image_utils [None req-a8b6af78-294d-4f59-b4b9-70051491a1b1 tempest-VolumeImageDependencyTests-1166190201 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_495e63a7-2d88-42d3-848f-4561219e36cd_rndce4s6devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-d43a2697-4a4b-4a80-ba1b-a8e5764460d7 {{(pid=86890) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 10:15:19 devstack cinder-volume[86890]: INFO cinder.image.image_utils [None req-a8b6af78-294d-4f59-b4b9-70051491a1b1 tempest-VolumeImageDependencyTests-1166190201 None] Converted 0.00 MB image at 0.00 MB/s Nov 02 10:15:19 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a8b6af78-294d-4f59-b4b9-70051491a1b1 tempest-VolumeImageDependencyTests-1166190201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-d43a2697-4a4b-4a80-ba1b-a8e5764460d7 1G {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:19 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-2b9171f1-b3b7-4ab9-942e-8027eb845172 tempest-VolumesCloneTest-102722810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e37e8636-a7f4-4096-9e00-9d893d066b88" returned: 0 in 0.357s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:19 devstack sudo[99124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-d43a2697-4a4b-4a80-ba1b-a8e5764460d7 1G Nov 02 10:15:19 devstack sudo[99124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:19 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-f9812073-23f8-46d5-8722-de4d7603af32 tempest-VolumesExtendTest-1257807882 None] Acquiring lock "cinder-5018e15c-7feb-4c88-9e0d-7536c5a143a0-delete_snapshot" by "delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:15:19 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-0b47d84a-1cb9-4783-bd98-a16daaa57b8a tempest-VolumesTransfersTest-1022818353 None] Transfer volume completed successfully. Nov 02 10:15:19 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-2b9171f1-b3b7-4ab9-942e-8027eb845172 tempest-VolumesCloneTest-102722810 None] Lock "cinder-quobyte-e37e8636-a7f4-4096-9e00-9d893d066b88" released by "delete_volume" :: held 0.957s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:15:20 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-f9812073-23f8-46d5-8722-de4d7603af32 tempest-VolumesExtendTest-1257807882 None] Lock "cinder-5018e15c-7feb-4c88-9e0d-7536c5a143a0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:15:20 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-f9812073-23f8-46d5-8722-de4d7603af32 tempest-VolumesExtendTest-1257807882 None] Acquiring lock "cinder-quobyte-dc06dcb8-df01-4808-b7eb-04597e815526" by "delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:15:20 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-f9812073-23f8-46d5-8722-de4d7603af32 tempest-VolumesExtendTest-1257807882 None] Lock "cinder-quobyte-dc06dcb8-df01-4808-b7eb-04597e815526" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:15:20 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-f9812073-23f8-46d5-8722-de4d7603af32 tempest-VolumesExtendTest-1257807882 None] Acquiring lock "cinder-quobyte-5018e15c-7feb-4c88-9e0d-7536c5a143a0" by "_delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:15:20 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-f9812073-23f8-46d5-8722-de4d7603af32 tempest-VolumesExtendTest-1257807882 None] Lock "cinder-quobyte-5018e15c-7feb-4c88-9e0d-7536c5a143a0" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:15:20 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-f9812073-23f8-46d5-8722-de4d7603af32 tempest-VolumesExtendTest-1257807882 None] Deleting offline snapshot 5018e15c-7feb-4c88-9e0d-7536c5a143a0 of volume dc06dcb8-df01-4808-b7eb-04597e815526 {{(pid=86890) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:15:20 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-f9812073-23f8-46d5-8722-de4d7603af32 tempest-VolumesExtendTest-1257807882 None] snapshot_file for this snap is: volume-dc06dcb8-df01-4808-b7eb-04597e815526.5018e15c-7feb-4c88-9e0d-7536c5a143a0 {{(pid=86890) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:15:20 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cead582-5de0-44d1-b127-c135cb1cacd6]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:15:20 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-f9812073-23f8-46d5-8722-de4d7603af32 tempest-VolumesExtendTest-1257807882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dc06dcb8-df01-4808-b7eb-04597e815526.5018e15c-7feb-4c88-9e0d-7536c5a143a0 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:20 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-2b9171f1-b3b7-4ab9-942e-8027eb845172 tempest-VolumesCloneTest-102722810 None] Created reservations ['4045617a-72d9-4faf-a726-bdd07cd88060', '11295605-5e7e-4046-85f1-a0efeab9aa51', '98a5f582-f33a-48fc-b592-26d1db7b8682', '51e1f3d7-9047-437e-91e1-dfb92432e5c9'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:15:20 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-2b9171f1-b3b7-4ab9-942e-8027eb845172 tempest-VolumesCloneTest-102722810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:15:20 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-2b9171f1-b3b7-4ab9-942e-8027eb845172 tempest-VolumesCloneTest-102722810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:15:20 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-2b9171f1-b3b7-4ab9-942e-8027eb845172 tempest-VolumesCloneTest-102722810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:15:20 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-2b9171f1-b3b7-4ab9-942e-8027eb845172 tempest-VolumesCloneTest-102722810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:15:20 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-2b9171f1-b3b7-4ab9-942e-8027eb845172 tempest-VolumesCloneTest-102722810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:15:20 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-2b9171f1-b3b7-4ab9-942e-8027eb845172 tempest-VolumesCloneTest-102722810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:20 devstack sudo[99130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:15:20 devstack sudo[99130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:20 devstack sudo[99126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dc06dcb8-df01-4808-b7eb-04597e815526.5018e15c-7feb-4c88-9e0d-7536c5a143a0 Nov 02 10:15:20 devstack sudo[99126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:20 devstack sudo[99124]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:20 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a8b6af78-294d-4f59-b4b9-70051491a1b1 tempest-VolumeImageDependencyTests-1166190201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-d43a2697-4a4b-4a80-ba1b-a8e5764460d7 1G" returned: 0 in 0.429s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:20 devstack cinder-volume[86890]: DEBUG cinder.volume.volume_utils [None req-a8b6af78-294d-4f59-b4b9-70051491a1b1 tempest-VolumeImageDependencyTests-1166190201 None] Downloaded image 495e63a7-2d88-42d3-848f-4561219e36cd ((None, [{'url': 'file:///opt/stack/data/glance/images/495e63a7-2d88-42d3-848f-4561219e36cd', 'metadata': {}}])) to volume d43a2697-4a4b-4a80-ba1b-a8e5764460d7 successfully. {{(pid=86890) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 02 10:15:20 devstack cinder-volume[86890]: DEBUG cinder.image.image_utils [None req-a8b6af78-294d-4f59-b4b9-70051491a1b1 tempest-VolumeImageDependencyTests-1166190201 None] Temporary image 495e63a7-2d88-42d3-848f-4561219e36cd for user 7be312fdaad34643a55463c3edfe54ba is deleted. {{(pid=86890) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 02 10:15:20 devstack cinder-volume[86890]: DEBUG cinder.volume.volume_utils [None req-a8b6af78-294d-4f59-b4b9-70051491a1b1 tempest-VolumeImageDependencyTests-1166190201 None] Marking volume d43a2697-4a4b-4a80-ba1b-a8e5764460d7 as bootable. {{(pid=86890) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 02 10:15:20 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8b6af78-294d-4f59-b4b9-70051491a1b1 tempest-VolumeImageDependencyTests-1166190201 None] Copying metadata from image 495e63a7-2d88-42d3-848f-4561219e36cd to d43a2697-4a4b-4a80-ba1b-a8e5764460d7. {{(pid=86890) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 10:15:20 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8b6af78-294d-4f59-b4b9-70051491a1b1 tempest-VolumeImageDependencyTests-1166190201 None] Creating volume glance metadata for volume d43a2697-4a4b-4a80-ba1b-a8e5764460d7 backed by image 495e63a7-2d88-42d3-848f-4561219e36cd with: {'image_id': '495e63a7-2d88-42d3-848f-4561219e36cd', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'edb32be3fbf553f9e451b3751bc53bc5', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86890) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 10:15:20 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-a8b6af78-294d-4f59-b4b9-70051491a1b1 tempest-VolumeImageDependencyTests-1166190201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20bb4460-aee6-44ad-8f74-d378f398de13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d43a2697-4a4b-4a80-ba1b-a8e5764460d7', 'volume_size': 1, 'image_id': '495e63a7-2d88-42d3-848f-4561219e36cd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/495e63a7-2d88-42d3-848f-4561219e36cd', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'edb32be3fbf553f9e451b3751bc53bc5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a96e4e634aac47c0a119e1b5b8d3a58f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7768ae0badd5165f8d5c747004c50ec8db326e2873653bf33eb152b42de2454dd4392875f8b3ae3a68b876bc8dd10a88a687b9506546c403b618d0291704e015', 'id': '495e63a7-2d88-42d3-848f-4561219e36cd', 'created_at': datetime.datetime(2026, 11, 2, 9, 14, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 15, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/495e63a7-2d88-42d3-848f-4561219e36cd/file', 'properties': {}}, 'image_service': }' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:20 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-a8b6af78-294d-4f59-b4b9-70051491a1b1 tempest-VolumeImageDependencyTests-1166190201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27cc3cc4-0093-42a5-bf24-7d549621d371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:20 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-a8b6af78-294d-4f59-b4b9-70051491a1b1 tempest-VolumeImageDependencyTests-1166190201 None] Volume volume-d43a2697-4a4b-4a80-ba1b-a8e5764460d7 (d43a2697-4a4b-4a80-ba1b-a8e5764460d7): created successfully Nov 02 10:15:20 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-a8b6af78-294d-4f59-b4b9-70051491a1b1 tempest-VolumeImageDependencyTests-1166190201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27cc3cc4-0093-42a5-bf24-7d549621d371) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:20 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-a8b6af78-294d-4f59-b4b9-70051491a1b1 tempest-VolumeImageDependencyTests-1166190201 None] Flow 'volume_create_manager' (24fa5b94-101b-4546-ae4f-4c1be29b6afb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:15:20 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-a8b6af78-294d-4f59-b4b9-70051491a1b1 tempest-VolumeImageDependencyTests-1166190201 None] Created volume successfully. Nov 02 10:15:20 devstack sudo[99130]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:20 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-2b9171f1-b3b7-4ab9-942e-8027eb845172 tempest-VolumesCloneTest-102722810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.303s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:20 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-2b9171f1-b3b7-4ab9-942e-8027eb845172 tempest-VolumesCloneTest-102722810 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:15:20 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-2b9171f1-b3b7-4ab9-942e-8027eb845172 tempest-VolumesCloneTest-102722810 None] Deleted volume successfully. Nov 02 10:15:20 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-2b9171f1-b3b7-4ab9-942e-8027eb845172 tempest-VolumesCloneTest-102722810 None] Lock "cinder-e37e8636-a7f4-4096-9e00-9d893d066b88-delete_volume" released by "delete_volume" :: held 1.626s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:15:20 devstack sudo[99126]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:20 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-f9812073-23f8-46d5-8722-de4d7603af32 tempest-VolumesExtendTest-1257807882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dc06dcb8-df01-4808-b7eb-04597e815526.5018e15c-7feb-4c88-9e0d-7536c5a143a0" returned: 0 in 0.534s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:20 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-f9812073-23f8-46d5-8722-de4d7603af32 tempest-VolumesExtendTest-1257807882 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dc06dcb8-df01-4808-b7eb-04597e815526(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86890) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:15:20 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d806b56-83d4-4c5b-af96-708bd9b02177]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:15:20 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-f9812073-23f8-46d5-8722-de4d7603af32 tempest-VolumesExtendTest-1257807882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dc06dcb8-df01-4808-b7eb-04597e815526 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:20 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-79f56c1d-73d0-4a25-862a-b67ca72e247f tempest-VolumesTransfersTest-536703662 None] Acquiring lock "cinder-3b76a0f0-d451-4620-905b-75293e69a872-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:15:20 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-79f56c1d-73d0-4a25-862a-b67ca72e247f tempest-VolumesTransfersTest-536703662 None] Lock "cinder-3b76a0f0-d451-4620-905b-75293e69a872-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:15:20 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-79f56c1d-73d0-4a25-862a-b67ca72e247f tempest-VolumesTransfersTest-536703662 None] Acquiring lock "cinder-quobyte-3b76a0f0-d451-4620-905b-75293e69a872" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:15:20 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-79f56c1d-73d0-4a25-862a-b67ca72e247f tempest-VolumesTransfersTest-536703662 None] Lock "cinder-quobyte-3b76a0f0-d451-4620-905b-75293e69a872" acquired by "delete_volume" :: waited 0.020s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:15:20 devstack sudo[99137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dc06dcb8-df01-4808-b7eb-04597e815526 Nov 02 10:15:20 devstack sudo[99137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:20 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f0c68b5-0386-4e98-8ae4-05af4723a0cf]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:15:20 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-79f56c1d-73d0-4a25-862a-b67ca72e247f tempest-VolumesTransfersTest-536703662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3b76a0f0-d451-4620-905b-75293e69a872 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:20 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-e94f4813-161d-4876-aa88-e82ab838d5ef tempest-VolumeImageDependencyTests-1166190201 None] Acquiring lock "cinder-d43a2697-4a4b-4a80-ba1b-a8e5764460d7-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:15:20 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-e94f4813-161d-4876-aa88-e82ab838d5ef tempest-VolumeImageDependencyTests-1166190201 None] Lock "cinder-d43a2697-4a4b-4a80-ba1b-a8e5764460d7-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:15:20 devstack sudo[99139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3b76a0f0-d451-4620-905b-75293e69a872 Nov 02 10:15:20 devstack sudo[99139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:20 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-e94f4813-161d-4876-aa88-e82ab838d5ef tempest-VolumeImageDependencyTests-1166190201 None] Acquiring lock "cinder-quobyte-d43a2697-4a4b-4a80-ba1b-a8e5764460d7" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:15:21 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-e94f4813-161d-4876-aa88-e82ab838d5ef tempest-VolumeImageDependencyTests-1166190201 None] Lock "cinder-quobyte-d43a2697-4a4b-4a80-ba1b-a8e5764460d7" acquired by "delete_volume" :: waited 0.025s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:15:21 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ebeba5a-a2d4-4a10-af14-333e6da81417]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:15:21 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-e94f4813-161d-4876-aa88-e82ab838d5ef tempest-VolumeImageDependencyTests-1166190201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-d43a2697-4a4b-4a80-ba1b-a8e5764460d7 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:21 devstack sudo[99137]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:21 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-f9812073-23f8-46d5-8722-de4d7603af32 tempest-VolumesExtendTest-1257807882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dc06dcb8-df01-4808-b7eb-04597e815526" returned: 0 in 0.482s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:21 devstack sudo[99141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-d43a2697-4a4b-4a80-ba1b-a8e5764460d7 Nov 02 10:15:21 devstack sudo[99141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:21 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-f9812073-23f8-46d5-8722-de4d7603af32 tempest-VolumesExtendTest-1257807882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dc06dcb8-df01-4808-b7eb-04597e815526.5018e15c-7feb-4c88-9e0d-7536c5a143a0 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:21 devstack sudo[99146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dc06dcb8-df01-4808-b7eb-04597e815526.5018e15c-7feb-4c88-9e0d-7536c5a143a0 Nov 02 10:15:21 devstack sudo[99146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:21 devstack sudo[99139]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:21 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-79f56c1d-73d0-4a25-862a-b67ca72e247f tempest-VolumesTransfersTest-536703662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3b76a0f0-d451-4620-905b-75293e69a872" returned: 0 in 0.448s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:21 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-79f56c1d-73d0-4a25-862a-b67ca72e247f tempest-VolumesTransfersTest-536703662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3b76a0f0-d451-4620-905b-75293e69a872 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:21 devstack sudo[99151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3b76a0f0-d451-4620-905b-75293e69a872 Nov 02 10:15:21 devstack sudo[99151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:21 devstack sudo[99141]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:21 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-e94f4813-161d-4876-aa88-e82ab838d5ef tempest-VolumeImageDependencyTests-1166190201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-d43a2697-4a4b-4a80-ba1b-a8e5764460d7" returned: 0 in 0.464s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:21 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-e94f4813-161d-4876-aa88-e82ab838d5ef tempest-VolumeImageDependencyTests-1166190201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-d43a2697-4a4b-4a80-ba1b-a8e5764460d7 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:21 devstack sudo[99159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-d43a2697-4a4b-4a80-ba1b-a8e5764460d7 Nov 02 10:15:21 devstack sudo[99159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:21 devstack sudo[99151]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:21 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-79f56c1d-73d0-4a25-862a-b67ca72e247f tempest-VolumesTransfersTest-536703662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3b76a0f0-d451-4620-905b-75293e69a872" returned: 0 in 0.327s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:21 devstack sudo[99146]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:21 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-79f56c1d-73d0-4a25-862a-b67ca72e247f tempest-VolumesTransfersTest-536703662 None] Lock "cinder-quobyte-3b76a0f0-d451-4620-905b-75293e69a872" released by "delete_volume" :: held 0.835s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:15:21 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-f9812073-23f8-46d5-8722-de4d7603af32 tempest-VolumesExtendTest-1257807882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dc06dcb8-df01-4808-b7eb-04597e815526.5018e15c-7feb-4c88-9e0d-7536c5a143a0" returned: 0 in 0.471s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:21 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-f9812073-23f8-46d5-8722-de4d7603af32 tempest-VolumesExtendTest-1257807882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dc06dcb8-df01-4808-b7eb-04597e815526.5018e15c-7feb-4c88-9e0d-7536c5a143a0 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:21 devstack sudo[99163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dc06dcb8-df01-4808-b7eb-04597e815526.5018e15c-7feb-4c88-9e0d-7536c5a143a0 Nov 02 10:15:21 devstack sudo[99163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:21 devstack sudo[99159]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:21 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-e94f4813-161d-4876-aa88-e82ab838d5ef tempest-VolumeImageDependencyTests-1166190201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-d43a2697-4a4b-4a80-ba1b-a8e5764460d7" returned: 0 in 0.296s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:21 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-e94f4813-161d-4876-aa88-e82ab838d5ef tempest-VolumeImageDependencyTests-1166190201 None] Lock "cinder-quobyte-d43a2697-4a4b-4a80-ba1b-a8e5764460d7" released by "delete_volume" :: held 0.833s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:15:21 devstack sudo[99163]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:21 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-f9812073-23f8-46d5-8722-de4d7603af32 tempest-VolumesExtendTest-1257807882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dc06dcb8-df01-4808-b7eb-04597e815526.5018e15c-7feb-4c88-9e0d-7536c5a143a0" returned: 0 in 0.264s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:21 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-f9812073-23f8-46d5-8722-de4d7603af32 tempest-VolumesExtendTest-1257807882 None] Lock "cinder-quobyte-5018e15c-7feb-4c88-9e0d-7536c5a143a0" released by "_delete_snapshot" :: held 1.888s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:15:21 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-f9812073-23f8-46d5-8722-de4d7603af32 tempest-VolumesExtendTest-1257807882 None] Lock "cinder-quobyte-dc06dcb8-df01-4808-b7eb-04597e815526" released by "delete_snapshot" :: held 1.937s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:15:21 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-79f56c1d-73d0-4a25-862a-b67ca72e247f tempest-VolumesTransfersTest-536703662 None] Created reservations ['4e89343b-f319-4a6a-b033-06973f2ed90a', '7cf9fd3a-b341-43d3-9d30-52626ab4977c', '572ab647-354f-4735-ac9a-498b060f35d3', '3b2c35f9-fb0e-4359-85e6-13a44e8c785e'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:15:21 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-e94f4813-161d-4876-aa88-e82ab838d5ef tempest-VolumeImageDependencyTests-1166190201 None] Created reservations ['40c60f7a-013d-41a3-8934-6587352ba796', 'e8e9147f-d287-4a34-9fb4-b095da5d8a8c', '91ade40d-797a-4d87-a7a9-473d87784ab9', '2ef52f39-8275-4a00-b49c-04b3c35dfdf5'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:15:22 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-e94f4813-161d-4876-aa88-e82ab838d5ef tempest-VolumeImageDependencyTests-1166190201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:15:22 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-e94f4813-161d-4876-aa88-e82ab838d5ef tempest-VolumeImageDependencyTests-1166190201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:15:22 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-e94f4813-161d-4876-aa88-e82ab838d5ef tempest-VolumeImageDependencyTests-1166190201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:15:22 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-e94f4813-161d-4876-aa88-e82ab838d5ef tempest-VolumeImageDependencyTests-1166190201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:15:22 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-e94f4813-161d-4876-aa88-e82ab838d5ef tempest-VolumeImageDependencyTests-1166190201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:15:22 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-e94f4813-161d-4876-aa88-e82ab838d5ef tempest-VolumeImageDependencyTests-1166190201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:22 devstack sudo[99167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:15:22 devstack sudo[99167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:22 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-f9812073-23f8-46d5-8722-de4d7603af32 tempest-VolumesExtendTest-1257807882 None] Created reservations ['7eee6e84-d2fd-4f93-9513-3f253afff857', '9e99ac15-4bd2-477d-adf3-78512ea6ce77', '99809010-7b8f-4d55-a60f-84ee2e57edbd', 'bc29f391-cd55-40df-aa8c-e29034b97c0a'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:15:22 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-79f56c1d-73d0-4a25-862a-b67ca72e247f tempest-VolumesTransfersTest-536703662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:15:22 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-79f56c1d-73d0-4a25-862a-b67ca72e247f tempest-VolumesTransfersTest-536703662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:15:22 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-79f56c1d-73d0-4a25-862a-b67ca72e247f tempest-VolumesTransfersTest-536703662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:15:22 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-79f56c1d-73d0-4a25-862a-b67ca72e247f tempest-VolumesTransfersTest-536703662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:15:22 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-79f56c1d-73d0-4a25-862a-b67ca72e247f tempest-VolumesTransfersTest-536703662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:15:22 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-79f56c1d-73d0-4a25-862a-b67ca72e247f tempest-VolumesTransfersTest-536703662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:22 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-f9812073-23f8-46d5-8722-de4d7603af32 tempest-VolumesExtendTest-1257807882 None] Delete snapshot completed successfully. Nov 02 10:15:22 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-f9812073-23f8-46d5-8722-de4d7603af32 tempest-VolumesExtendTest-1257807882 None] Lock "cinder-5018e15c-7feb-4c88-9e0d-7536c5a143a0-delete_snapshot" released by "delete_snapshot" :: held 2.240s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:15:22 devstack sudo[99169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:15:22 devstack sudo[99169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:22 devstack sudo[99167]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:22 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-e94f4813-161d-4876-aa88-e82ab838d5ef tempest-VolumeImageDependencyTests-1166190201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.329s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:22 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-e94f4813-161d-4876-aa88-e82ab838d5ef tempest-VolumeImageDependencyTests-1166190201 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:15:22 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-e94f4813-161d-4876-aa88-e82ab838d5ef tempest-VolumeImageDependencyTests-1166190201 None] Deleted volume successfully. Nov 02 10:15:22 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-e94f4813-161d-4876-aa88-e82ab838d5ef tempest-VolumeImageDependencyTests-1166190201 None] Lock "cinder-d43a2697-4a4b-4a80-ba1b-a8e5764460d7-delete_volume" released by "delete_volume" :: held 1.511s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:15:22 devstack sudo[99169]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:22 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-79f56c1d-73d0-4a25-862a-b67ca72e247f tempest-VolumesTransfersTest-536703662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.328s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:22 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-79f56c1d-73d0-4a25-862a-b67ca72e247f tempest-VolumesTransfersTest-536703662 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:15:22 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-79f56c1d-73d0-4a25-862a-b67ca72e247f tempest-VolumesTransfersTest-536703662 None] Deleted volume successfully. Nov 02 10:15:22 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-79f56c1d-73d0-4a25-862a-b67ca72e247f tempest-VolumesTransfersTest-536703662 None] Lock "cinder-3b76a0f0-d451-4620-905b-75293e69a872-delete_volume" released by "delete_volume" :: held 1.815s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:15:22 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-79824a36-e92c-4fbf-b5f6-bb27d4a6181d tempest-VolumesExtendTest-1257807882 None] Acquiring lock "cinder-dc06dcb8-df01-4808-b7eb-04597e815526-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:15:22 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-79824a36-e92c-4fbf-b5f6-bb27d4a6181d tempest-VolumesExtendTest-1257807882 None] Lock "cinder-dc06dcb8-df01-4808-b7eb-04597e815526-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:15:22 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-79824a36-e92c-4fbf-b5f6-bb27d4a6181d tempest-VolumesExtendTest-1257807882 None] Acquiring lock "cinder-quobyte-dc06dcb8-df01-4808-b7eb-04597e815526" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:15:22 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-79824a36-e92c-4fbf-b5f6-bb27d4a6181d tempest-VolumesExtendTest-1257807882 None] Lock "cinder-quobyte-dc06dcb8-df01-4808-b7eb-04597e815526" acquired by "delete_volume" :: waited 0.020s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:15:22 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[19c6659a-058b-4168-bf7f-0f2cb037bd72]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:15:22 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-79824a36-e92c-4fbf-b5f6-bb27d4a6181d tempest-VolumesExtendTest-1257807882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dc06dcb8-df01-4808-b7eb-04597e815526 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:22 devstack sudo[99173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dc06dcb8-df01-4808-b7eb-04597e815526 Nov 02 10:15:22 devstack sudo[99173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:23 devstack sudo[99173]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:23 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-79824a36-e92c-4fbf-b5f6-bb27d4a6181d tempest-VolumesExtendTest-1257807882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dc06dcb8-df01-4808-b7eb-04597e815526" returned: 0 in 0.500s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:23 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-79824a36-e92c-4fbf-b5f6-bb27d4a6181d tempest-VolumesExtendTest-1257807882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dc06dcb8-df01-4808-b7eb-04597e815526 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:23 devstack sudo[99178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dc06dcb8-df01-4808-b7eb-04597e815526 Nov 02 10:15:23 devstack sudo[99178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:23 devstack sudo[99178]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:23 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-79824a36-e92c-4fbf-b5f6-bb27d4a6181d tempest-VolumesExtendTest-1257807882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dc06dcb8-df01-4808-b7eb-04597e815526" returned: 0 in 0.329s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:23 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-79824a36-e92c-4fbf-b5f6-bb27d4a6181d tempest-VolumesExtendTest-1257807882 None] Lock "cinder-quobyte-dc06dcb8-df01-4808-b7eb-04597e815526" released by "delete_volume" :: held 0.918s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:15:23 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-79824a36-e92c-4fbf-b5f6-bb27d4a6181d tempest-VolumesExtendTest-1257807882 None] Created reservations ['33220b94-26b1-492c-81a2-672fc2111755', 'dfeb9c33-46bf-4ea6-b362-79341243c64d', 'db729b7d-34de-4f9a-8401-de3cb3e8efb0', '18c7814f-adcc-46bf-af27-e6e6b39ba25e'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:15:23 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-79824a36-e92c-4fbf-b5f6-bb27d4a6181d tempest-VolumesExtendTest-1257807882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:15:23 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-79824a36-e92c-4fbf-b5f6-bb27d4a6181d tempest-VolumesExtendTest-1257807882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:15:23 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-79824a36-e92c-4fbf-b5f6-bb27d4a6181d tempest-VolumesExtendTest-1257807882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:15:23 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-79824a36-e92c-4fbf-b5f6-bb27d4a6181d tempest-VolumesExtendTest-1257807882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:15:23 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-79824a36-e92c-4fbf-b5f6-bb27d4a6181d tempest-VolumesExtendTest-1257807882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:15:23 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-79824a36-e92c-4fbf-b5f6-bb27d4a6181d tempest-VolumesExtendTest-1257807882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:23 devstack sudo[99182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:15:23 devstack sudo[99182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:24 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-780b806d-c0fc-4283-b037-e86fd841dbe1 tempest-VolumesTransfersTest-502438195 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:15:24 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-780b806d-c0fc-4283-b037-e86fd841dbe1 tempest-VolumesTransfersTest-502438195 None] Flow 'volume_create_manager' (30068fd6-7c6c-4779-92db-b91c45d09637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:15:24 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-780b806d-c0fc-4283-b037-e86fd841dbe1 tempest-VolumesTransfersTest-502438195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (666a3b7e-02ff-457c-b050-01f09dbf267f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:24 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-780b806d-c0fc-4283-b037-e86fd841dbe1 tempest-VolumesTransfersTest-502438195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (666a3b7e-02ff-457c-b050-01f09dbf267f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:15:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1423420375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52fce216-ce17-4b42-a8b9-173bd2fb5741,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1852791b5bf472fbb6a8fc2ca5295be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:15:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:15:24Z,use_quota=True,user_id='4dabcf62d0f14328a961a7a20d58970e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:24 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-780b806d-c0fc-4283-b037-e86fd841dbe1 tempest-VolumesTransfersTest-502438195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c50f0b12-d669-47eb-9a73-2ed989e09e57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:24 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-780b806d-c0fc-4283-b037-e86fd841dbe1 tempest-VolumesTransfersTest-502438195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c50f0b12-d669-47eb-9a73-2ed989e09e57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:24 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-780b806d-c0fc-4283-b037-e86fd841dbe1 tempest-VolumesTransfersTest-502438195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f303cf28-1197-423c-9e41-a7d73d9878d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:24 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-780b806d-c0fc-4283-b037-e86fd841dbe1 tempest-VolumesTransfersTest-502438195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f303cf28-1197-423c-9e41-a7d73d9878d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52fce216-ce17-4b42-a8b9-173bd2fb5741', 'volume_name': 'volume-52fce216-ce17-4b42-a8b9-173bd2fb5741', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:24 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-780b806d-c0fc-4283-b037-e86fd841dbe1 tempest-VolumesTransfersTest-502438195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4e34e0f-5530-47da-ae5a-0c6c0065e69a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:24 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-780b806d-c0fc-4283-b037-e86fd841dbe1 tempest-VolumesTransfersTest-502438195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4e34e0f-5530-47da-ae5a-0c6c0065e69a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:24 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-780b806d-c0fc-4283-b037-e86fd841dbe1 tempest-VolumesTransfersTest-502438195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa0487b8-6fe5-49f3-a6e1-598fb283030b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:24 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-780b806d-c0fc-4283-b037-e86fd841dbe1 tempest-VolumesTransfersTest-502438195 None] Volume 52fce216-ce17-4b42-a8b9-173bd2fb5741: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52fce216-ce17-4b42-a8b9-173bd2fb5741', 'volume_size': 1} Nov 02 10:15:24 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-780b806d-c0fc-4283-b037-e86fd841dbe1 tempest-VolumesTransfersTest-502438195 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:15:24 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-780b806d-c0fc-4283-b037-e86fd841dbe1 tempest-VolumesTransfersTest-502438195 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:15:24 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-780b806d-c0fc-4283-b037-e86fd841dbe1 tempest-VolumesTransfersTest-502438195 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:15:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1423420375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52fce216-ce17-4b42-a8b9-173bd2fb5741,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1852791b5bf472fbb6a8fc2ca5295be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:15:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:15:24Z,use_quota=True,user_id='4dabcf62d0f14328a961a7a20d58970e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:15:24 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-780b806d-c0fc-4283-b037-e86fd841dbe1 tempest-VolumesTransfersTest-502438195 None] Creating volume 52fce216-ce17-4b42-a8b9-173bd2fb5741 {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:15:24 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-780b806d-c0fc-4283-b037-e86fd841dbe1 tempest-VolumesTransfersTest-502438195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:15:24 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-780b806d-c0fc-4283-b037-e86fd841dbe1 tempest-VolumesTransfersTest-502438195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:15:24 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-780b806d-c0fc-4283-b037-e86fd841dbe1 tempest-VolumesTransfersTest-502438195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:15:24 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-780b806d-c0fc-4283-b037-e86fd841dbe1 tempest-VolumesTransfersTest-502438195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:15:24 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-780b806d-c0fc-4283-b037-e86fd841dbe1 tempest-VolumesTransfersTest-502438195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:15:24 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-780b806d-c0fc-4283-b037-e86fd841dbe1 tempest-VolumesTransfersTest-502438195 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:15:24 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-780b806d-c0fc-4283-b037-e86fd841dbe1 tempest-VolumesTransfersTest-502438195 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:15:24 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-780b806d-c0fc-4283-b037-e86fd841dbe1 tempest-VolumesTransfersTest-502438195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-52fce216-ce17-4b42-a8b9-173bd2fb5741 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:24 devstack sudo[99184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-52fce216-ce17-4b42-a8b9-173bd2fb5741 1073741824 Nov 02 10:15:24 devstack sudo[99184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:24 devstack sudo[99182]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:24 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-79824a36-e92c-4fbf-b5f6-bb27d4a6181d tempest-VolumesExtendTest-1257807882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.453s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:24 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-79824a36-e92c-4fbf-b5f6-bb27d4a6181d tempest-VolumesExtendTest-1257807882 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:15:24 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-79824a36-e92c-4fbf-b5f6-bb27d4a6181d tempest-VolumesExtendTest-1257807882 None] Deleted volume successfully. Nov 02 10:15:24 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-79824a36-e92c-4fbf-b5f6-bb27d4a6181d tempest-VolumesExtendTest-1257807882 None] Lock "cinder-dc06dcb8-df01-4808-b7eb-04597e815526-delete_volume" released by "delete_volume" :: held 1.779s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:15:24 devstack sudo[99184]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:24 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-780b806d-c0fc-4283-b037-e86fd841dbe1 tempest-VolumesTransfersTest-502438195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-52fce216-ce17-4b42-a8b9-173bd2fb5741 1073741824" returned: 0 in 0.751s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:25 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-780b806d-c0fc-4283-b037-e86fd841dbe1 tempest-VolumesTransfersTest-502438195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-52fce216-ce17-4b42-a8b9-173bd2fb5741 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:25 devstack sudo[99191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-52fce216-ce17-4b42-a8b9-173bd2fb5741 Nov 02 10:15:25 devstack sudo[99191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:25 devstack sudo[99191]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:25 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-780b806d-c0fc-4283-b037-e86fd841dbe1 tempest-VolumesTransfersTest-502438195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-52fce216-ce17-4b42-a8b9-173bd2fb5741" returned: 0 in 0.306s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:25 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-780b806d-c0fc-4283-b037-e86fd841dbe1 tempest-VolumesTransfersTest-502438195 None] <== create_volume: return (1268ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:15:25 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-780b806d-c0fc-4283-b037-e86fd841dbe1 tempest-VolumesTransfersTest-502438195 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.274s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:15:25 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-780b806d-c0fc-4283-b037-e86fd841dbe1 tempest-VolumesTransfersTest-502438195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa0487b8-6fe5-49f3-a6e1-598fb283030b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52fce216-ce17-4b42-a8b9-173bd2fb5741', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:25 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-780b806d-c0fc-4283-b037-e86fd841dbe1 tempest-VolumesTransfersTest-502438195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46838ede-455e-4117-bb3c-579cedf37eba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:25 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-780b806d-c0fc-4283-b037-e86fd841dbe1 tempest-VolumesTransfersTest-502438195 None] Volume volume-52fce216-ce17-4b42-a8b9-173bd2fb5741 (52fce216-ce17-4b42-a8b9-173bd2fb5741): created successfully Nov 02 10:15:25 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-780b806d-c0fc-4283-b037-e86fd841dbe1 tempest-VolumesTransfersTest-502438195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46838ede-455e-4117-bb3c-579cedf37eba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:25 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-780b806d-c0fc-4283-b037-e86fd841dbe1 tempest-VolumesTransfersTest-502438195 None] Flow 'volume_create_manager' (30068fd6-7c6c-4779-92db-b91c45d09637) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:15:25 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-780b806d-c0fc-4283-b037-e86fd841dbe1 tempest-VolumesTransfersTest-502438195 None] Created volume successfully. Nov 02 10:15:26 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-69a2573d-3c75-4fec-8b05-5472b2fcf98a tempest-VolumesTransfersTest-536703662 None] Acquiring lock "cinder-52fce216-ce17-4b42-a8b9-173bd2fb5741-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:15:26 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-69a2573d-3c75-4fec-8b05-5472b2fcf98a tempest-VolumesTransfersTest-536703662 None] Lock "cinder-52fce216-ce17-4b42-a8b9-173bd2fb5741-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:15:26 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-69a2573d-3c75-4fec-8b05-5472b2fcf98a tempest-VolumesTransfersTest-536703662 None] Acquiring lock "cinder-quobyte-52fce216-ce17-4b42-a8b9-173bd2fb5741" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:15:26 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-69a2573d-3c75-4fec-8b05-5472b2fcf98a tempest-VolumesTransfersTest-536703662 None] Lock "cinder-quobyte-52fce216-ce17-4b42-a8b9-173bd2fb5741" acquired by "delete_volume" :: waited 0.025s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:15:26 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccd0b5e5-b077-4cf4-a9c9-462259ab4983]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:15:26 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-69a2573d-3c75-4fec-8b05-5472b2fcf98a tempest-VolumesTransfersTest-536703662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-52fce216-ce17-4b42-a8b9-173bd2fb5741 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:26 devstack sudo[99194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-52fce216-ce17-4b42-a8b9-173bd2fb5741 Nov 02 10:15:26 devstack sudo[99194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:27 devstack sudo[99194]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:27 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-69a2573d-3c75-4fec-8b05-5472b2fcf98a tempest-VolumesTransfersTest-536703662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-52fce216-ce17-4b42-a8b9-173bd2fb5741" returned: 0 in 0.505s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:27 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-69a2573d-3c75-4fec-8b05-5472b2fcf98a tempest-VolumesTransfersTest-536703662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-52fce216-ce17-4b42-a8b9-173bd2fb5741 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:27 devstack sudo[99199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-52fce216-ce17-4b42-a8b9-173bd2fb5741 Nov 02 10:15:27 devstack sudo[99199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:27 devstack sudo[99199]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:27 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-69a2573d-3c75-4fec-8b05-5472b2fcf98a tempest-VolumesTransfersTest-536703662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-52fce216-ce17-4b42-a8b9-173bd2fb5741" returned: 0 in 0.325s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:27 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-69a2573d-3c75-4fec-8b05-5472b2fcf98a tempest-VolumesTransfersTest-536703662 None] Lock "cinder-quobyte-52fce216-ce17-4b42-a8b9-173bd2fb5741" released by "delete_volume" :: held 0.904s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:15:27 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-58529e0b-036e-494d-8dfc-49ed250e229a tempest-VolumesListTestJSON-2141001974 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:15:27 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-58529e0b-036e-494d-8dfc-49ed250e229a tempest-VolumesListTestJSON-2141001974 None] Flow 'volume_create_manager' (793ec61a-85f5-4f5f-8a67-39f5600b4746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:15:27 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-58529e0b-036e-494d-8dfc-49ed250e229a tempest-VolumesListTestJSON-2141001974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (620631a7-7d8e-4903-84bc-d81429fbc48c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:27 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-58529e0b-036e-494d-8dfc-49ed250e229a tempest-VolumesListTestJSON-2141001974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (620631a7-7d8e-4903-84bc-d81429fbc48c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:15:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1815895188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fcc4714-3a55-4f7c-b25c-1274603ff0a8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7ddb39b7f7994651b34f7a9b8aca4e2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:15:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:15:27Z,use_quota=True,user_id='bd7ba284cdc14c93b9059a2af08d9059',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:27 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-58529e0b-036e-494d-8dfc-49ed250e229a tempest-VolumesListTestJSON-2141001974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d61b0e49-ec3e-41fd-95c9-fb5a34129497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:27 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-58529e0b-036e-494d-8dfc-49ed250e229a tempest-VolumesListTestJSON-2141001974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d61b0e49-ec3e-41fd-95c9-fb5a34129497) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:27 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-58529e0b-036e-494d-8dfc-49ed250e229a tempest-VolumesListTestJSON-2141001974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (505e2fa3-346e-433c-83a2-25abec542584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:27 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-58529e0b-036e-494d-8dfc-49ed250e229a tempest-VolumesListTestJSON-2141001974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (505e2fa3-346e-433c-83a2-25abec542584) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7fcc4714-3a55-4f7c-b25c-1274603ff0a8', 'volume_name': 'volume-7fcc4714-3a55-4f7c-b25c-1274603ff0a8', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:27 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-58529e0b-036e-494d-8dfc-49ed250e229a tempest-VolumesListTestJSON-2141001974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9519ba6b-59b0-4f2d-847a-f1ffd525a679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:27 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-58529e0b-036e-494d-8dfc-49ed250e229a tempest-VolumesListTestJSON-2141001974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9519ba6b-59b0-4f2d-847a-f1ffd525a679) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:27 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-58529e0b-036e-494d-8dfc-49ed250e229a tempest-VolumesListTestJSON-2141001974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d3f42d7-906e-4efe-95c0-5fd5ea056ebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:27 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-58529e0b-036e-494d-8dfc-49ed250e229a tempest-VolumesListTestJSON-2141001974 None] Volume 7fcc4714-3a55-4f7c-b25c-1274603ff0a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7fcc4714-3a55-4f7c-b25c-1274603ff0a8', 'volume_size': 1} Nov 02 10:15:27 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-58529e0b-036e-494d-8dfc-49ed250e229a tempest-VolumesListTestJSON-2141001974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:15:27 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-58529e0b-036e-494d-8dfc-49ed250e229a tempest-VolumesListTestJSON-2141001974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:15:27 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-58529e0b-036e-494d-8dfc-49ed250e229a tempest-VolumesListTestJSON-2141001974 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:15:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1815895188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fcc4714-3a55-4f7c-b25c-1274603ff0a8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7ddb39b7f7994651b34f7a9b8aca4e2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:15:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:15:27Z,use_quota=True,user_id='bd7ba284cdc14c93b9059a2af08d9059',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:15:27 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-58529e0b-036e-494d-8dfc-49ed250e229a tempest-VolumesListTestJSON-2141001974 None] Creating volume 7fcc4714-3a55-4f7c-b25c-1274603ff0a8 {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:15:27 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-58529e0b-036e-494d-8dfc-49ed250e229a tempest-VolumesListTestJSON-2141001974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:15:27 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-58529e0b-036e-494d-8dfc-49ed250e229a tempest-VolumesListTestJSON-2141001974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:15:27 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-58529e0b-036e-494d-8dfc-49ed250e229a tempest-VolumesListTestJSON-2141001974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:15:27 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-58529e0b-036e-494d-8dfc-49ed250e229a tempest-VolumesListTestJSON-2141001974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:15:27 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-58529e0b-036e-494d-8dfc-49ed250e229a tempest-VolumesListTestJSON-2141001974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:15:27 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-58529e0b-036e-494d-8dfc-49ed250e229a tempest-VolumesListTestJSON-2141001974 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:15:27 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-58529e0b-036e-494d-8dfc-49ed250e229a tempest-VolumesListTestJSON-2141001974 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:15:27 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-58529e0b-036e-494d-8dfc-49ed250e229a tempest-VolumesListTestJSON-2141001974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-7fcc4714-3a55-4f7c-b25c-1274603ff0a8 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:27 devstack sudo[99202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-7fcc4714-3a55-4f7c-b25c-1274603ff0a8 1073741824 Nov 02 10:15:27 devstack sudo[99202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:27 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-69a2573d-3c75-4fec-8b05-5472b2fcf98a tempest-VolumesTransfersTest-536703662 None] Created reservations ['76047be9-40f8-4905-a21d-2bd953aa4228', '40a74862-1bae-45c9-bb4a-bcc47ee2f521', '6848217d-49c9-4c4f-a8da-419ab1032f19', '4a073759-de86-44de-ac6f-e75fb027f576'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:15:27 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-69a2573d-3c75-4fec-8b05-5472b2fcf98a tempest-VolumesTransfersTest-536703662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:15:27 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-69a2573d-3c75-4fec-8b05-5472b2fcf98a tempest-VolumesTransfersTest-536703662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:15:27 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-69a2573d-3c75-4fec-8b05-5472b2fcf98a tempest-VolumesTransfersTest-536703662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:15:27 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-69a2573d-3c75-4fec-8b05-5472b2fcf98a tempest-VolumesTransfersTest-536703662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:15:27 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-69a2573d-3c75-4fec-8b05-5472b2fcf98a tempest-VolumesTransfersTest-536703662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:15:27 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-69a2573d-3c75-4fec-8b05-5472b2fcf98a tempest-VolumesTransfersTest-536703662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:27 devstack sudo[99204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:15:27 devstack sudo[99204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:28 devstack sudo[99204]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:28 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-69a2573d-3c75-4fec-8b05-5472b2fcf98a tempest-VolumesTransfersTest-536703662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.347s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:28 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-69a2573d-3c75-4fec-8b05-5472b2fcf98a tempest-VolumesTransfersTest-536703662 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:15:28 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-69a2573d-3c75-4fec-8b05-5472b2fcf98a tempest-VolumesTransfersTest-536703662 None] Deleted volume successfully. Nov 02 10:15:28 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-69a2573d-3c75-4fec-8b05-5472b2fcf98a tempest-VolumesTransfersTest-536703662 None] Lock "cinder-52fce216-ce17-4b42-a8b9-173bd2fb5741-delete_volume" released by "delete_volume" :: held 1.683s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:15:28 devstack sudo[99202]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:28 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-58529e0b-036e-494d-8dfc-49ed250e229a tempest-VolumesListTestJSON-2141001974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-7fcc4714-3a55-4f7c-b25c-1274603ff0a8 1073741824" returned: 0 in 0.588s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:28 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-58529e0b-036e-494d-8dfc-49ed250e229a tempest-VolumesListTestJSON-2141001974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-7fcc4714-3a55-4f7c-b25c-1274603ff0a8 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:28 devstack sudo[99211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-7fcc4714-3a55-4f7c-b25c-1274603ff0a8 Nov 02 10:15:28 devstack sudo[99211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:28 devstack sudo[99211]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:28 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-58529e0b-036e-494d-8dfc-49ed250e229a tempest-VolumesListTestJSON-2141001974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-7fcc4714-3a55-4f7c-b25c-1274603ff0a8" returned: 0 in 0.296s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:28 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-58529e0b-036e-494d-8dfc-49ed250e229a tempest-VolumesListTestJSON-2141001974 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:15:28 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-58529e0b-036e-494d-8dfc-49ed250e229a tempest-VolumesListTestJSON-2141001974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:15:28 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-58529e0b-036e-494d-8dfc-49ed250e229a tempest-VolumesListTestJSON-2141001974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d3f42d7-906e-4efe-95c0-5fd5ea056ebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fcc4714-3a55-4f7c-b25c-1274603ff0a8', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:28 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-58529e0b-036e-494d-8dfc-49ed250e229a tempest-VolumesListTestJSON-2141001974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdd6e3fe-2754-4e86-aadf-f5e0641640a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:28 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-58529e0b-036e-494d-8dfc-49ed250e229a tempest-VolumesListTestJSON-2141001974 None] Volume volume-7fcc4714-3a55-4f7c-b25c-1274603ff0a8 (7fcc4714-3a55-4f7c-b25c-1274603ff0a8): created successfully Nov 02 10:15:28 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-58529e0b-036e-494d-8dfc-49ed250e229a tempest-VolumesListTestJSON-2141001974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdd6e3fe-2754-4e86-aadf-f5e0641640a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:28 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-58529e0b-036e-494d-8dfc-49ed250e229a tempest-VolumesListTestJSON-2141001974 None] Flow 'volume_create_manager' (793ec61a-85f5-4f5f-8a67-39f5600b4746) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:15:28 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-58529e0b-036e-494d-8dfc-49ed250e229a tempest-VolumesListTestJSON-2141001974 None] Created volume successfully. Nov 02 10:15:29 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-96f04dd3-c959-4b41-95e1-abf202316200 tempest-ProjectReaderTests-1500075906 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:15:29 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-96f04dd3-c959-4b41-95e1-abf202316200 tempest-ProjectReaderTests-1500075906 None] Flow 'volume_create_manager' (1d848716-0eaa-40ca-a6f1-e7615c2d33ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:15:29 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-96f04dd3-c959-4b41-95e1-abf202316200 tempest-ProjectReaderTests-1500075906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79ae2a00-22c6-49bf-a8dc-e87d1021601f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:29 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-96f04dd3-c959-4b41-95e1-abf202316200 tempest-ProjectReaderTests-1500075906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79ae2a00-22c6-49bf-a8dc-e87d1021601f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:15:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1640462787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5946ad53-4e78-42dc-9ffc-2dacb34e8b5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='189c9acae3d4446eb95af40b45730d95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:15:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:15:29Z,use_quota=True,user_id='c321898e250e4c9b820a2cf9fb40e041',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:29 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-96f04dd3-c959-4b41-95e1-abf202316200 tempest-ProjectReaderTests-1500075906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24409e1c-154d-4ff9-ba77-06692802e051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:29 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-96f04dd3-c959-4b41-95e1-abf202316200 tempest-ProjectReaderTests-1500075906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24409e1c-154d-4ff9-ba77-06692802e051) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:29 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-96f04dd3-c959-4b41-95e1-abf202316200 tempest-ProjectReaderTests-1500075906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40469b96-af6b-4c77-b6c5-f9391e37c77f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:29 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-96f04dd3-c959-4b41-95e1-abf202316200 tempest-ProjectReaderTests-1500075906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40469b96-af6b-4c77-b6c5-f9391e37c77f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5946ad53-4e78-42dc-9ffc-2dacb34e8b5c', 'volume_name': 'volume-5946ad53-4e78-42dc-9ffc-2dacb34e8b5c', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:29 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-96f04dd3-c959-4b41-95e1-abf202316200 tempest-ProjectReaderTests-1500075906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44c83553-8d63-4612-a548-ae15838dda3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:29 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-96f04dd3-c959-4b41-95e1-abf202316200 tempest-ProjectReaderTests-1500075906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44c83553-8d63-4612-a548-ae15838dda3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:29 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-96f04dd3-c959-4b41-95e1-abf202316200 tempest-ProjectReaderTests-1500075906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c1a7492-0135-4138-b470-a87a30fb9074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:29 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-96f04dd3-c959-4b41-95e1-abf202316200 tempest-ProjectReaderTests-1500075906 None] Volume 5946ad53-4e78-42dc-9ffc-2dacb34e8b5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5946ad53-4e78-42dc-9ffc-2dacb34e8b5c', 'volume_size': 1} Nov 02 10:15:29 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-96f04dd3-c959-4b41-95e1-abf202316200 tempest-ProjectReaderTests-1500075906 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:15:29 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-96f04dd3-c959-4b41-95e1-abf202316200 tempest-ProjectReaderTests-1500075906 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:15:29 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-96f04dd3-c959-4b41-95e1-abf202316200 tempest-ProjectReaderTests-1500075906 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:15:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1640462787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5946ad53-4e78-42dc-9ffc-2dacb34e8b5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='189c9acae3d4446eb95af40b45730d95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:15:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:15:29Z,use_quota=True,user_id='c321898e250e4c9b820a2cf9fb40e041',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:15:29 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-96f04dd3-c959-4b41-95e1-abf202316200 tempest-ProjectReaderTests-1500075906 None] Creating volume 5946ad53-4e78-42dc-9ffc-2dacb34e8b5c {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:15:29 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-96f04dd3-c959-4b41-95e1-abf202316200 tempest-ProjectReaderTests-1500075906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:15:29 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-96f04dd3-c959-4b41-95e1-abf202316200 tempest-ProjectReaderTests-1500075906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:15:29 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-96f04dd3-c959-4b41-95e1-abf202316200 tempest-ProjectReaderTests-1500075906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:15:29 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-96f04dd3-c959-4b41-95e1-abf202316200 tempest-ProjectReaderTests-1500075906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:15:29 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-96f04dd3-c959-4b41-95e1-abf202316200 tempest-ProjectReaderTests-1500075906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:15:29 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-96f04dd3-c959-4b41-95e1-abf202316200 tempest-ProjectReaderTests-1500075906 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:15:29 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-96f04dd3-c959-4b41-95e1-abf202316200 tempest-ProjectReaderTests-1500075906 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:15:29 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-96f04dd3-c959-4b41-95e1-abf202316200 tempest-ProjectReaderTests-1500075906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-5946ad53-4e78-42dc-9ffc-2dacb34e8b5c 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:29 devstack sudo[99214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-5946ad53-4e78-42dc-9ffc-2dacb34e8b5c 1073741824 Nov 02 10:15:29 devstack sudo[99214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:29 devstack sudo[99214]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:29 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-96f04dd3-c959-4b41-95e1-abf202316200 tempest-ProjectReaderTests-1500075906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-5946ad53-4e78-42dc-9ffc-2dacb34e8b5c 1073741824" returned: 0 in 0.625s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:29 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-96f04dd3-c959-4b41-95e1-abf202316200 tempest-ProjectReaderTests-1500075906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-5946ad53-4e78-42dc-9ffc-2dacb34e8b5c {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:29 devstack sudo[99219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-5946ad53-4e78-42dc-9ffc-2dacb34e8b5c Nov 02 10:15:29 devstack sudo[99219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:30 devstack sudo[99219]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:30 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-96f04dd3-c959-4b41-95e1-abf202316200 tempest-ProjectReaderTests-1500075906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-5946ad53-4e78-42dc-9ffc-2dacb34e8b5c" returned: 0 in 0.439s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:30 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-96f04dd3-c959-4b41-95e1-abf202316200 tempest-ProjectReaderTests-1500075906 None] <== create_volume: return (1116ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:15:30 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-96f04dd3-c959-4b41-95e1-abf202316200 tempest-ProjectReaderTests-1500075906 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.119s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:15:30 devstack cinder-volume[86890]: DEBUG dbcounter [-] [86890] Writing DB stats cinder:SELECT=154,cinder:UPDATE=184,cinder:INSERT=48,cinder:DELETE=14 {{(pid=86890) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:15:30 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-96f04dd3-c959-4b41-95e1-abf202316200 tempest-ProjectReaderTests-1500075906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c1a7492-0135-4138-b470-a87a30fb9074) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5946ad53-4e78-42dc-9ffc-2dacb34e8b5c', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:30 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-96f04dd3-c959-4b41-95e1-abf202316200 tempest-ProjectReaderTests-1500075906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cfadc66-f085-4a8c-b7e8-4ebdf98fb4be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:30 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-96f04dd3-c959-4b41-95e1-abf202316200 tempest-ProjectReaderTests-1500075906 None] Volume volume-5946ad53-4e78-42dc-9ffc-2dacb34e8b5c (5946ad53-4e78-42dc-9ffc-2dacb34e8b5c): created successfully Nov 02 10:15:30 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-96f04dd3-c959-4b41-95e1-abf202316200 tempest-ProjectReaderTests-1500075906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cfadc66-f085-4a8c-b7e8-4ebdf98fb4be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:30 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-96f04dd3-c959-4b41-95e1-abf202316200 tempest-ProjectReaderTests-1500075906 None] Flow 'volume_create_manager' (1d848716-0eaa-40ca-a6f1-e7615c2d33ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:15:30 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-011b8c72-f183-41db-90f4-320bd5400bb4 tempest-VolumesListTestJSON-2141001974 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:15:30 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-011b8c72-f183-41db-90f4-320bd5400bb4 tempest-VolumesListTestJSON-2141001974 None] Flow 'volume_create_manager' (153d7997-2d07-4854-aac0-e0a7018e715d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:15:30 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-011b8c72-f183-41db-90f4-320bd5400bb4 tempest-VolumesListTestJSON-2141001974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (006a3291-2aa0-45da-aecc-8722396d3be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:30 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-96f04dd3-c959-4b41-95e1-abf202316200 tempest-ProjectReaderTests-1500075906 None] Created volume successfully. Nov 02 10:15:30 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-011b8c72-f183-41db-90f4-320bd5400bb4 tempest-VolumesListTestJSON-2141001974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (006a3291-2aa0-45da-aecc-8722396d3be8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:15:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1277429829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d9ebdbf-b9e6-4b80-b1ab-da9188039a5a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7ddb39b7f7994651b34f7a9b8aca4e2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:15:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:15:30Z,use_quota=True,user_id='bd7ba284cdc14c93b9059a2af08d9059',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:30 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-011b8c72-f183-41db-90f4-320bd5400bb4 tempest-VolumesListTestJSON-2141001974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13dbbff2-d079-4aec-b377-e9ce2442744f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:30 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-011b8c72-f183-41db-90f4-320bd5400bb4 tempest-VolumesListTestJSON-2141001974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13dbbff2-d079-4aec-b377-e9ce2442744f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:30 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-011b8c72-f183-41db-90f4-320bd5400bb4 tempest-VolumesListTestJSON-2141001974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7705ea71-45ff-4666-8477-a13884ce26f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:30 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-011b8c72-f183-41db-90f4-320bd5400bb4 tempest-VolumesListTestJSON-2141001974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7705ea71-45ff-4666-8477-a13884ce26f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d9ebdbf-b9e6-4b80-b1ab-da9188039a5a', 'volume_name': 'volume-2d9ebdbf-b9e6-4b80-b1ab-da9188039a5a', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:30 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-011b8c72-f183-41db-90f4-320bd5400bb4 tempest-VolumesListTestJSON-2141001974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (677f6377-4b6c-4567-8ae6-638c426522a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:30 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-011b8c72-f183-41db-90f4-320bd5400bb4 tempest-VolumesListTestJSON-2141001974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (677f6377-4b6c-4567-8ae6-638c426522a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:30 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-011b8c72-f183-41db-90f4-320bd5400bb4 tempest-VolumesListTestJSON-2141001974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75bd70ff-2e1d-4a67-ad48-9b49b0f1acbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:30 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-011b8c72-f183-41db-90f4-320bd5400bb4 tempest-VolumesListTestJSON-2141001974 None] Volume 2d9ebdbf-b9e6-4b80-b1ab-da9188039a5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d9ebdbf-b9e6-4b80-b1ab-da9188039a5a', 'volume_size': 1} Nov 02 10:15:30 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-011b8c72-f183-41db-90f4-320bd5400bb4 tempest-VolumesListTestJSON-2141001974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:15:30 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-011b8c72-f183-41db-90f4-320bd5400bb4 tempest-VolumesListTestJSON-2141001974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:15:30 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-011b8c72-f183-41db-90f4-320bd5400bb4 tempest-VolumesListTestJSON-2141001974 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:15:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1277429829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d9ebdbf-b9e6-4b80-b1ab-da9188039a5a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7ddb39b7f7994651b34f7a9b8aca4e2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:15:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:15:30Z,use_quota=True,user_id='bd7ba284cdc14c93b9059a2af08d9059',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:15:30 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-011b8c72-f183-41db-90f4-320bd5400bb4 tempest-VolumesListTestJSON-2141001974 None] Creating volume 2d9ebdbf-b9e6-4b80-b1ab-da9188039a5a {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:15:30 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-011b8c72-f183-41db-90f4-320bd5400bb4 tempest-VolumesListTestJSON-2141001974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:15:30 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-011b8c72-f183-41db-90f4-320bd5400bb4 tempest-VolumesListTestJSON-2141001974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:15:30 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-011b8c72-f183-41db-90f4-320bd5400bb4 tempest-VolumesListTestJSON-2141001974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:15:30 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-011b8c72-f183-41db-90f4-320bd5400bb4 tempest-VolumesListTestJSON-2141001974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:15:30 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-011b8c72-f183-41db-90f4-320bd5400bb4 tempest-VolumesListTestJSON-2141001974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:15:30 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-011b8c72-f183-41db-90f4-320bd5400bb4 tempest-VolumesListTestJSON-2141001974 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:15:30 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-011b8c72-f183-41db-90f4-320bd5400bb4 tempest-VolumesListTestJSON-2141001974 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:15:30 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-011b8c72-f183-41db-90f4-320bd5400bb4 tempest-VolumesListTestJSON-2141001974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-2d9ebdbf-b9e6-4b80-b1ab-da9188039a5a 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:30 devstack sudo[99222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-2d9ebdbf-b9e6-4b80-b1ab-da9188039a5a 1073741824 Nov 02 10:15:30 devstack sudo[99222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:31 devstack sudo[99222]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:31 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-011b8c72-f183-41db-90f4-320bd5400bb4 tempest-VolumesListTestJSON-2141001974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-2d9ebdbf-b9e6-4b80-b1ab-da9188039a5a 1073741824" returned: 0 in 0.523s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:31 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-011b8c72-f183-41db-90f4-320bd5400bb4 tempest-VolumesListTestJSON-2141001974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-2d9ebdbf-b9e6-4b80-b1ab-da9188039a5a {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:31 devstack sudo[99228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-2d9ebdbf-b9e6-4b80-b1ab-da9188039a5a Nov 02 10:15:31 devstack sudo[99228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:31 devstack sudo[99228]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:31 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-011b8c72-f183-41db-90f4-320bd5400bb4 tempest-VolumesListTestJSON-2141001974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-2d9ebdbf-b9e6-4b80-b1ab-da9188039a5a" returned: 0 in 0.323s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:31 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-011b8c72-f183-41db-90f4-320bd5400bb4 tempest-VolumesListTestJSON-2141001974 None] <== create_volume: return (904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:15:31 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-011b8c72-f183-41db-90f4-320bd5400bb4 tempest-VolumesListTestJSON-2141001974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.908s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:15:31 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-011b8c72-f183-41db-90f4-320bd5400bb4 tempest-VolumesListTestJSON-2141001974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75bd70ff-2e1d-4a67-ad48-9b49b0f1acbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d9ebdbf-b9e6-4b80-b1ab-da9188039a5a', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:31 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-011b8c72-f183-41db-90f4-320bd5400bb4 tempest-VolumesListTestJSON-2141001974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a83be4e-5541-46d3-a155-97a600a57fca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:31 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-011b8c72-f183-41db-90f4-320bd5400bb4 tempest-VolumesListTestJSON-2141001974 None] Volume volume-2d9ebdbf-b9e6-4b80-b1ab-da9188039a5a (2d9ebdbf-b9e6-4b80-b1ab-da9188039a5a): created successfully Nov 02 10:15:31 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-011b8c72-f183-41db-90f4-320bd5400bb4 tempest-VolumesListTestJSON-2141001974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a83be4e-5541-46d3-a155-97a600a57fca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:31 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-011b8c72-f183-41db-90f4-320bd5400bb4 tempest-VolumesListTestJSON-2141001974 None] Flow 'volume_create_manager' (153d7997-2d07-4854-aac0-e0a7018e715d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:15:31 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-011b8c72-f183-41db-90f4-320bd5400bb4 tempest-VolumesListTestJSON-2141001974 None] Created volume successfully. Nov 02 10:15:31 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-e54d3eba-e6a3-43eb-a834-18db146d8687 tempest-ProjectReaderTests-1500075906 None] Acquiring lock "cinder-5946ad53-4e78-42dc-9ffc-2dacb34e8b5c-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:15:31 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-e54d3eba-e6a3-43eb-a834-18db146d8687 tempest-ProjectReaderTests-1500075906 None] Lock "cinder-5946ad53-4e78-42dc-9ffc-2dacb34e8b5c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:15:31 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-e54d3eba-e6a3-43eb-a834-18db146d8687 tempest-ProjectReaderTests-1500075906 None] Acquiring lock "cinder-quobyte-5946ad53-4e78-42dc-9ffc-2dacb34e8b5c" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:15:31 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-e54d3eba-e6a3-43eb-a834-18db146d8687 tempest-ProjectReaderTests-1500075906 None] Lock "cinder-quobyte-5946ad53-4e78-42dc-9ffc-2dacb34e8b5c" acquired by "delete_volume" :: waited 0.028s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:15:31 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[80d6d551-9eed-432c-adca-aaf4d3fc9fe1]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:15:31 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-e54d3eba-e6a3-43eb-a834-18db146d8687 tempest-ProjectReaderTests-1500075906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-5946ad53-4e78-42dc-9ffc-2dacb34e8b5c {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:31 devstack sudo[99231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-5946ad53-4e78-42dc-9ffc-2dacb34e8b5c Nov 02 10:15:31 devstack sudo[99231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:32 devstack sudo[99231]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:32 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-e54d3eba-e6a3-43eb-a834-18db146d8687 tempest-ProjectReaderTests-1500075906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-5946ad53-4e78-42dc-9ffc-2dacb34e8b5c" returned: 0 in 0.436s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:32 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-e54d3eba-e6a3-43eb-a834-18db146d8687 tempest-ProjectReaderTests-1500075906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-5946ad53-4e78-42dc-9ffc-2dacb34e8b5c {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:32 devstack sudo[99236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-5946ad53-4e78-42dc-9ffc-2dacb34e8b5c Nov 02 10:15:32 devstack sudo[99236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:32 devstack sudo[99236]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:32 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-e54d3eba-e6a3-43eb-a834-18db146d8687 tempest-ProjectReaderTests-1500075906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-5946ad53-4e78-42dc-9ffc-2dacb34e8b5c" returned: 0 in 0.304s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:32 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-e54d3eba-e6a3-43eb-a834-18db146d8687 tempest-ProjectReaderTests-1500075906 None] Lock "cinder-quobyte-5946ad53-4e78-42dc-9ffc-2dacb34e8b5c" released by "delete_volume" :: held 0.788s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:15:32 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-e54d3eba-e6a3-43eb-a834-18db146d8687 tempest-ProjectReaderTests-1500075906 None] Created reservations ['404d2c22-4a62-4b5a-8b96-662d92448d37', '8b49a90c-cd3d-4736-8049-6519746b49a1', 'a5c80aac-de79-49d9-b815-c34362b82ab9', '1a85ca1c-1261-4265-a684-dea934f12428'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:15:32 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-e54d3eba-e6a3-43eb-a834-18db146d8687 tempest-ProjectReaderTests-1500075906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:15:32 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-e54d3eba-e6a3-43eb-a834-18db146d8687 tempest-ProjectReaderTests-1500075906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:15:32 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-e54d3eba-e6a3-43eb-a834-18db146d8687 tempest-ProjectReaderTests-1500075906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:15:32 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-e54d3eba-e6a3-43eb-a834-18db146d8687 tempest-ProjectReaderTests-1500075906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:15:32 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-e54d3eba-e6a3-43eb-a834-18db146d8687 tempest-ProjectReaderTests-1500075906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:15:32 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-e54d3eba-e6a3-43eb-a834-18db146d8687 tempest-ProjectReaderTests-1500075906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:32 devstack sudo[99239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:15:32 devstack sudo[99239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:33 devstack sudo[99239]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:33 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-e54d3eba-e6a3-43eb-a834-18db146d8687 tempest-ProjectReaderTests-1500075906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.361s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:33 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-e54d3eba-e6a3-43eb-a834-18db146d8687 tempest-ProjectReaderTests-1500075906 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:15:33 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-e54d3eba-e6a3-43eb-a834-18db146d8687 tempest-ProjectReaderTests-1500075906 None] Deleted volume successfully. Nov 02 10:15:33 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-e54d3eba-e6a3-43eb-a834-18db146d8687 tempest-ProjectReaderTests-1500075906 None] Lock "cinder-5946ad53-4e78-42dc-9ffc-2dacb34e8b5c-delete_volume" released by "delete_volume" :: held 1.477s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:15:33 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-b37cb066-1f28-4bb2-b43a-90d6372dcba2 tempest-VolumesListTestJSON-2141001974 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:15:33 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-b37cb066-1f28-4bb2-b43a-90d6372dcba2 tempest-VolumesListTestJSON-2141001974 None] Flow 'volume_create_manager' (46980d27-efc5-4463-9b4b-02ab063d6e85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:15:33 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-b37cb066-1f28-4bb2-b43a-90d6372dcba2 tempest-VolumesListTestJSON-2141001974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c5e3a57-dc7b-4e47-bad0-df723a0fa7a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:33 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-b37cb066-1f28-4bb2-b43a-90d6372dcba2 tempest-VolumesListTestJSON-2141001974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c5e3a57-dc7b-4e47-bad0-df723a0fa7a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:15:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2079622646',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d2eaa5b-b23f-4017-bf4c-ddeee8dcda23,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7ddb39b7f7994651b34f7a9b8aca4e2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:15:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:15:34Z,use_quota=True,user_id='bd7ba284cdc14c93b9059a2af08d9059',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:33 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-b37cb066-1f28-4bb2-b43a-90d6372dcba2 tempest-VolumesListTestJSON-2141001974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d803e831-58ff-419d-a8c9-df9c5043adcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:33 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-b37cb066-1f28-4bb2-b43a-90d6372dcba2 tempest-VolumesListTestJSON-2141001974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d803e831-58ff-419d-a8c9-df9c5043adcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:33 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-b37cb066-1f28-4bb2-b43a-90d6372dcba2 tempest-VolumesListTestJSON-2141001974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c22f455-2222-4c84-9aa2-bf2e6df7bfe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:33 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-b37cb066-1f28-4bb2-b43a-90d6372dcba2 tempest-VolumesListTestJSON-2141001974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c22f455-2222-4c84-9aa2-bf2e6df7bfe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d2eaa5b-b23f-4017-bf4c-ddeee8dcda23', 'volume_name': 'volume-3d2eaa5b-b23f-4017-bf4c-ddeee8dcda23', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:34 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-b37cb066-1f28-4bb2-b43a-90d6372dcba2 tempest-VolumesListTestJSON-2141001974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f32a7bd6-fafd-4459-b6b6-d49aac288e72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:34 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-b37cb066-1f28-4bb2-b43a-90d6372dcba2 tempest-VolumesListTestJSON-2141001974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f32a7bd6-fafd-4459-b6b6-d49aac288e72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:34 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-b37cb066-1f28-4bb2-b43a-90d6372dcba2 tempest-VolumesListTestJSON-2141001974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (662eda31-6409-4a6a-a8f0-068665508626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:34 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-b37cb066-1f28-4bb2-b43a-90d6372dcba2 tempest-VolumesListTestJSON-2141001974 None] Volume 3d2eaa5b-b23f-4017-bf4c-ddeee8dcda23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d2eaa5b-b23f-4017-bf4c-ddeee8dcda23', 'volume_size': 1} Nov 02 10:15:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-b37cb066-1f28-4bb2-b43a-90d6372dcba2 tempest-VolumesListTestJSON-2141001974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:15:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-b37cb066-1f28-4bb2-b43a-90d6372dcba2 tempest-VolumesListTestJSON-2141001974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:15:34 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-b37cb066-1f28-4bb2-b43a-90d6372dcba2 tempest-VolumesListTestJSON-2141001974 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:15:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2079622646',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d2eaa5b-b23f-4017-bf4c-ddeee8dcda23,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7ddb39b7f7994651b34f7a9b8aca4e2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:15:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:15:34Z,use_quota=True,user_id='bd7ba284cdc14c93b9059a2af08d9059',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:15:34 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-b37cb066-1f28-4bb2-b43a-90d6372dcba2 tempest-VolumesListTestJSON-2141001974 None] Creating volume 3d2eaa5b-b23f-4017-bf4c-ddeee8dcda23 {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:15:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-b37cb066-1f28-4bb2-b43a-90d6372dcba2 tempest-VolumesListTestJSON-2141001974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:15:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-b37cb066-1f28-4bb2-b43a-90d6372dcba2 tempest-VolumesListTestJSON-2141001974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:15:34 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-b37cb066-1f28-4bb2-b43a-90d6372dcba2 tempest-VolumesListTestJSON-2141001974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:15:34 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-b37cb066-1f28-4bb2-b43a-90d6372dcba2 tempest-VolumesListTestJSON-2141001974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:15:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-b37cb066-1f28-4bb2-b43a-90d6372dcba2 tempest-VolumesListTestJSON-2141001974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:15:34 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-b37cb066-1f28-4bb2-b43a-90d6372dcba2 tempest-VolumesListTestJSON-2141001974 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:15:34 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-b37cb066-1f28-4bb2-b43a-90d6372dcba2 tempest-VolumesListTestJSON-2141001974 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:15:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-b37cb066-1f28-4bb2-b43a-90d6372dcba2 tempest-VolumesListTestJSON-2141001974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3d2eaa5b-b23f-4017-bf4c-ddeee8dcda23 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:34 devstack sudo[99243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3d2eaa5b-b23f-4017-bf4c-ddeee8dcda23 1073741824 Nov 02 10:15:34 devstack sudo[99243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:34 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-387b219d-ecbb-46f8-9fa6-5c1a3ec7a7a0 tempest-ProjectReaderTests-1500075906 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:15:34 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-387b219d-ecbb-46f8-9fa6-5c1a3ec7a7a0 tempest-ProjectReaderTests-1500075906 None] Flow 'volume_create_manager' (0b09f9ec-1fef-4d3a-96a7-5ba5edd0a110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:15:34 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-387b219d-ecbb-46f8-9fa6-5c1a3ec7a7a0 tempest-ProjectReaderTests-1500075906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddcae6c6-f32b-4993-96f0-080934a17ff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:34 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-387b219d-ecbb-46f8-9fa6-5c1a3ec7a7a0 tempest-ProjectReaderTests-1500075906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddcae6c6-f32b-4993-96f0-080934a17ff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:15:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-279716328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abacd55e-dee8-4ba7-8115-88322ac341ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='189c9acae3d4446eb95af40b45730d95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:15:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:15:34Z,use_quota=True,user_id='c321898e250e4c9b820a2cf9fb40e041',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:34 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-387b219d-ecbb-46f8-9fa6-5c1a3ec7a7a0 tempest-ProjectReaderTests-1500075906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a726c10-0c85-416e-bd92-c2e7da64f2b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:34 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-387b219d-ecbb-46f8-9fa6-5c1a3ec7a7a0 tempest-ProjectReaderTests-1500075906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a726c10-0c85-416e-bd92-c2e7da64f2b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:34 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-387b219d-ecbb-46f8-9fa6-5c1a3ec7a7a0 tempest-ProjectReaderTests-1500075906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9549391-d572-4309-b9fc-52c18eaee6be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:34 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-387b219d-ecbb-46f8-9fa6-5c1a3ec7a7a0 tempest-ProjectReaderTests-1500075906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9549391-d572-4309-b9fc-52c18eaee6be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'abacd55e-dee8-4ba7-8115-88322ac341ef', 'volume_name': 'volume-abacd55e-dee8-4ba7-8115-88322ac341ef', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:34 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-387b219d-ecbb-46f8-9fa6-5c1a3ec7a7a0 tempest-ProjectReaderTests-1500075906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30e601a0-6202-4d8a-9043-99e7a1fe38f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:34 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-387b219d-ecbb-46f8-9fa6-5c1a3ec7a7a0 tempest-ProjectReaderTests-1500075906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30e601a0-6202-4d8a-9043-99e7a1fe38f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:34 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-387b219d-ecbb-46f8-9fa6-5c1a3ec7a7a0 tempest-ProjectReaderTests-1500075906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb9fc2d8-358d-407d-8b51-56fb9a37414d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:34 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-387b219d-ecbb-46f8-9fa6-5c1a3ec7a7a0 tempest-ProjectReaderTests-1500075906 None] Volume abacd55e-dee8-4ba7-8115-88322ac341ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-abacd55e-dee8-4ba7-8115-88322ac341ef', 'volume_size': 1} Nov 02 10:15:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-387b219d-ecbb-46f8-9fa6-5c1a3ec7a7a0 tempest-ProjectReaderTests-1500075906 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:15:34 devstack sudo[99243]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-b37cb066-1f28-4bb2-b43a-90d6372dcba2 tempest-VolumesListTestJSON-2141001974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3d2eaa5b-b23f-4017-bf4c-ddeee8dcda23 1073741824" returned: 0 in 0.675s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-b37cb066-1f28-4bb2-b43a-90d6372dcba2 tempest-VolumesListTestJSON-2141001974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3d2eaa5b-b23f-4017-bf4c-ddeee8dcda23 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:34 devstack cinder-volume[86890]: DEBUG oslo_service.periodic_task [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86890) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:15:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:15:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:15:34 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:15:34 devstack sudo[99249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3d2eaa5b-b23f-4017-bf4c-ddeee8dcda23 Nov 02 10:15:34 devstack sudo[99249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:34 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:15:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:15:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:34 devstack sudo[99251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:15:34 devstack sudo[99251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:35 devstack sudo[99251]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:35 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.344s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:35 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:15:35 devstack sudo[99249]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:35 devstack cinder-volume[86890]: DEBUG oslo_service.periodic_task [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Running periodic task VolumeManager._thread_info {{(pid=86890) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:15:35 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] thread count: 29 {{(pid=86890) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:15:35 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] thread info: [<_MainThread(MainThread, started 133913319395456)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86890) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:15:35 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-b37cb066-1f28-4bb2-b43a-90d6372dcba2 tempest-VolumesListTestJSON-2141001974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3d2eaa5b-b23f-4017-bf4c-ddeee8dcda23" returned: 0 in 0.404s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:35 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-b37cb066-1f28-4bb2-b43a-90d6372dcba2 tempest-VolumesListTestJSON-2141001974 None] <== create_volume: return (1208ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:15:35 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-b37cb066-1f28-4bb2-b43a-90d6372dcba2 tempest-VolumesListTestJSON-2141001974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.213s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:15:35 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-387b219d-ecbb-46f8-9fa6-5c1a3ec7a7a0 tempest-ProjectReaderTests-1500075906 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.020s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:15:35 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-387b219d-ecbb-46f8-9fa6-5c1a3ec7a7a0 tempest-ProjectReaderTests-1500075906 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:15:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-279716328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abacd55e-dee8-4ba7-8115-88322ac341ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='189c9acae3d4446eb95af40b45730d95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:15:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:15:34Z,use_quota=True,user_id='c321898e250e4c9b820a2cf9fb40e041',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:15:35 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-387b219d-ecbb-46f8-9fa6-5c1a3ec7a7a0 tempest-ProjectReaderTests-1500075906 None] Creating volume abacd55e-dee8-4ba7-8115-88322ac341ef {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:15:35 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-387b219d-ecbb-46f8-9fa6-5c1a3ec7a7a0 tempest-ProjectReaderTests-1500075906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:15:35 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-387b219d-ecbb-46f8-9fa6-5c1a3ec7a7a0 tempest-ProjectReaderTests-1500075906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:15:35 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-387b219d-ecbb-46f8-9fa6-5c1a3ec7a7a0 tempest-ProjectReaderTests-1500075906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:15:35 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-387b219d-ecbb-46f8-9fa6-5c1a3ec7a7a0 tempest-ProjectReaderTests-1500075906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:15:35 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-387b219d-ecbb-46f8-9fa6-5c1a3ec7a7a0 tempest-ProjectReaderTests-1500075906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:15:35 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-387b219d-ecbb-46f8-9fa6-5c1a3ec7a7a0 tempest-ProjectReaderTests-1500075906 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:15:35 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-387b219d-ecbb-46f8-9fa6-5c1a3ec7a7a0 tempest-ProjectReaderTests-1500075906 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:15:35 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-387b219d-ecbb-46f8-9fa6-5c1a3ec7a7a0 tempest-ProjectReaderTests-1500075906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-abacd55e-dee8-4ba7-8115-88322ac341ef 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:35 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-b37cb066-1f28-4bb2-b43a-90d6372dcba2 tempest-VolumesListTestJSON-2141001974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (662eda31-6409-4a6a-a8f0-068665508626) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d2eaa5b-b23f-4017-bf4c-ddeee8dcda23', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:35 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-b37cb066-1f28-4bb2-b43a-90d6372dcba2 tempest-VolumesListTestJSON-2141001974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (131c0913-acd9-4b06-9da3-919273249704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:35 devstack sudo[99255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-abacd55e-dee8-4ba7-8115-88322ac341ef 1073741824 Nov 02 10:15:35 devstack sudo[99255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:35 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-b37cb066-1f28-4bb2-b43a-90d6372dcba2 tempest-VolumesListTestJSON-2141001974 None] Volume volume-3d2eaa5b-b23f-4017-bf4c-ddeee8dcda23 (3d2eaa5b-b23f-4017-bf4c-ddeee8dcda23): created successfully Nov 02 10:15:35 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-b37cb066-1f28-4bb2-b43a-90d6372dcba2 tempest-VolumesListTestJSON-2141001974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (131c0913-acd9-4b06-9da3-919273249704) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:35 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-b37cb066-1f28-4bb2-b43a-90d6372dcba2 tempest-VolumesListTestJSON-2141001974 None] Flow 'volume_create_manager' (46980d27-efc5-4463-9b4b-02ab063d6e85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:15:35 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-b37cb066-1f28-4bb2-b43a-90d6372dcba2 tempest-VolumesListTestJSON-2141001974 None] Created volume successfully. Nov 02 10:15:35 devstack sudo[99255]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:35 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-387b219d-ecbb-46f8-9fa6-5c1a3ec7a7a0 tempest-ProjectReaderTests-1500075906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-abacd55e-dee8-4ba7-8115-88322ac341ef 1073741824" returned: 0 in 0.615s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:35 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-387b219d-ecbb-46f8-9fa6-5c1a3ec7a7a0 tempest-ProjectReaderTests-1500075906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-abacd55e-dee8-4ba7-8115-88322ac341ef {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:35 devstack sudo[99262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-abacd55e-dee8-4ba7-8115-88322ac341ef Nov 02 10:15:35 devstack sudo[99262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:36 devstack sudo[99262]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:36 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-387b219d-ecbb-46f8-9fa6-5c1a3ec7a7a0 tempest-ProjectReaderTests-1500075906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-abacd55e-dee8-4ba7-8115-88322ac341ef" returned: 0 in 0.508s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:36 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-387b219d-ecbb-46f8-9fa6-5c1a3ec7a7a0 tempest-ProjectReaderTests-1500075906 None] <== create_volume: return (1207ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:15:36 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-387b219d-ecbb-46f8-9fa6-5c1a3ec7a7a0 tempest-ProjectReaderTests-1500075906 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.210s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:15:36 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-387b219d-ecbb-46f8-9fa6-5c1a3ec7a7a0 tempest-ProjectReaderTests-1500075906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb9fc2d8-358d-407d-8b51-56fb9a37414d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abacd55e-dee8-4ba7-8115-88322ac341ef', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:36 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-387b219d-ecbb-46f8-9fa6-5c1a3ec7a7a0 tempest-ProjectReaderTests-1500075906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80bf5084-a7f3-4813-ae88-26ba133cbb54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:36 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-387b219d-ecbb-46f8-9fa6-5c1a3ec7a7a0 tempest-ProjectReaderTests-1500075906 None] Volume volume-abacd55e-dee8-4ba7-8115-88322ac341ef (abacd55e-dee8-4ba7-8115-88322ac341ef): created successfully Nov 02 10:15:36 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-387b219d-ecbb-46f8-9fa6-5c1a3ec7a7a0 tempest-ProjectReaderTests-1500075906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80bf5084-a7f3-4813-ae88-26ba133cbb54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:36 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-387b219d-ecbb-46f8-9fa6-5c1a3ec7a7a0 tempest-ProjectReaderTests-1500075906 None] Flow 'volume_create_manager' (0b09f9ec-1fef-4d3a-96a7-5ba5edd0a110) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:15:36 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-387b219d-ecbb-46f8-9fa6-5c1a3ec7a7a0 tempest-ProjectReaderTests-1500075906 None] Created volume successfully. Nov 02 10:15:37 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-b8880bc7-80b0-40db-b584-92ec2ba2adf1 tempest-ProjectReaderTests-1500075906 None] Acquiring lock "cinder-abacd55e-dee8-4ba7-8115-88322ac341ef-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:15:37 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-b8880bc7-80b0-40db-b584-92ec2ba2adf1 tempest-ProjectReaderTests-1500075906 None] Lock "cinder-abacd55e-dee8-4ba7-8115-88322ac341ef-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:15:37 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-b8880bc7-80b0-40db-b584-92ec2ba2adf1 tempest-ProjectReaderTests-1500075906 None] Acquiring lock "cinder-quobyte-abacd55e-dee8-4ba7-8115-88322ac341ef" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:15:37 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-b8880bc7-80b0-40db-b584-92ec2ba2adf1 tempest-ProjectReaderTests-1500075906 None] Lock "cinder-quobyte-abacd55e-dee8-4ba7-8115-88322ac341ef" acquired by "delete_volume" :: waited 0.023s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:15:37 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[8deacfa1-9d23-42cc-b291-fbde31758da1]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:15:37 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-b8880bc7-80b0-40db-b584-92ec2ba2adf1 tempest-ProjectReaderTests-1500075906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-abacd55e-dee8-4ba7-8115-88322ac341ef {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:37 devstack sudo[99265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-abacd55e-dee8-4ba7-8115-88322ac341ef Nov 02 10:15:37 devstack sudo[99265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:37 devstack sudo[99265]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:37 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-b8880bc7-80b0-40db-b584-92ec2ba2adf1 tempest-ProjectReaderTests-1500075906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-abacd55e-dee8-4ba7-8115-88322ac341ef" returned: 0 in 0.445s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:37 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-b8880bc7-80b0-40db-b584-92ec2ba2adf1 tempest-ProjectReaderTests-1500075906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-abacd55e-dee8-4ba7-8115-88322ac341ef {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:37 devstack sudo[99270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-abacd55e-dee8-4ba7-8115-88322ac341ef Nov 02 10:15:37 devstack sudo[99270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:38 devstack sudo[99270]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:38 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-b8880bc7-80b0-40db-b584-92ec2ba2adf1 tempest-ProjectReaderTests-1500075906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-abacd55e-dee8-4ba7-8115-88322ac341ef" returned: 0 in 0.314s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:38 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-b8880bc7-80b0-40db-b584-92ec2ba2adf1 tempest-ProjectReaderTests-1500075906 None] Lock "cinder-quobyte-abacd55e-dee8-4ba7-8115-88322ac341ef" released by "delete_volume" :: held 0.823s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:15:38 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-b8880bc7-80b0-40db-b584-92ec2ba2adf1 tempest-ProjectReaderTests-1500075906 None] Created reservations ['05fa8b57-05d3-49c4-893f-b9f331546973', 'ec039383-aecd-4eaf-8c45-2864a8d9a7ef', 'acedb858-6d61-4b83-9cfa-c8adde6a115e', 'b24fbea9-1848-42c6-b6e3-26983f456ded'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:15:38 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-b8880bc7-80b0-40db-b584-92ec2ba2adf1 tempest-ProjectReaderTests-1500075906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:15:38 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-b8880bc7-80b0-40db-b584-92ec2ba2adf1 tempest-ProjectReaderTests-1500075906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:15:38 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-b8880bc7-80b0-40db-b584-92ec2ba2adf1 tempest-ProjectReaderTests-1500075906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:15:38 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-b8880bc7-80b0-40db-b584-92ec2ba2adf1 tempest-ProjectReaderTests-1500075906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:15:38 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-b8880bc7-80b0-40db-b584-92ec2ba2adf1 tempest-ProjectReaderTests-1500075906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:15:38 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-b8880bc7-80b0-40db-b584-92ec2ba2adf1 tempest-ProjectReaderTests-1500075906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:38 devstack sudo[99273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:15:38 devstack sudo[99273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:38 devstack sudo[99273]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:38 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-b8880bc7-80b0-40db-b584-92ec2ba2adf1 tempest-ProjectReaderTests-1500075906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.433s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:38 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-b8880bc7-80b0-40db-b584-92ec2ba2adf1 tempest-ProjectReaderTests-1500075906 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:15:38 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-b8880bc7-80b0-40db-b584-92ec2ba2adf1 tempest-ProjectReaderTests-1500075906 None] Deleted volume successfully. Nov 02 10:15:38 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-b8880bc7-80b0-40db-b584-92ec2ba2adf1 tempest-ProjectReaderTests-1500075906 None] Lock "cinder-abacd55e-dee8-4ba7-8115-88322ac341ef-delete_volume" released by "delete_volume" :: held 1.577s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:15:39 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-af902c7b-df5b-40c2-a353-d5fed3ff58d1 tempest-VolumesListTestJSON-2141001974 None] Acquiring lock "cinder-3d2eaa5b-b23f-4017-bf4c-ddeee8dcda23-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:15:39 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-af902c7b-df5b-40c2-a353-d5fed3ff58d1 tempest-VolumesListTestJSON-2141001974 None] Lock "cinder-3d2eaa5b-b23f-4017-bf4c-ddeee8dcda23-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:15:39 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-af902c7b-df5b-40c2-a353-d5fed3ff58d1 tempest-VolumesListTestJSON-2141001974 None] Acquiring lock "cinder-quobyte-3d2eaa5b-b23f-4017-bf4c-ddeee8dcda23" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:15:39 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-af902c7b-df5b-40c2-a353-d5fed3ff58d1 tempest-VolumesListTestJSON-2141001974 None] Lock "cinder-quobyte-3d2eaa5b-b23f-4017-bf4c-ddeee8dcda23" acquired by "delete_volume" :: waited 0.027s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:15:39 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[69e1d44d-be57-4bcc-8c68-7ae3c6835f95]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:15:39 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-af902c7b-df5b-40c2-a353-d5fed3ff58d1 tempest-VolumesListTestJSON-2141001974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3d2eaa5b-b23f-4017-bf4c-ddeee8dcda23 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:39 devstack sudo[99276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3d2eaa5b-b23f-4017-bf4c-ddeee8dcda23 Nov 02 10:15:39 devstack sudo[99276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:39 devstack sudo[99276]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:39 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-af902c7b-df5b-40c2-a353-d5fed3ff58d1 tempest-VolumesListTestJSON-2141001974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3d2eaa5b-b23f-4017-bf4c-ddeee8dcda23" returned: 0 in 0.516s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:39 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-af902c7b-df5b-40c2-a353-d5fed3ff58d1 tempest-VolumesListTestJSON-2141001974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3d2eaa5b-b23f-4017-bf4c-ddeee8dcda23 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:39 devstack sudo[99281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3d2eaa5b-b23f-4017-bf4c-ddeee8dcda23 Nov 02 10:15:39 devstack sudo[99281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:40 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7fa0e2f-3801-4389-a2f0-ff44eec0e0e1 tempest-VolumesTransfersV357Test-1217735249 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:15:40 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-e7fa0e2f-3801-4389-a2f0-ff44eec0e0e1 tempest-VolumesTransfersV357Test-1217735249 None] Flow 'volume_create_manager' (7184d953-5d7e-4781-a0c6-d35ffd22cf5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:15:40 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-e7fa0e2f-3801-4389-a2f0-ff44eec0e0e1 tempest-VolumesTransfersV357Test-1217735249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (496db5a2-dc8c-4a64-bffa-0dbe32f79514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:40 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-e7fa0e2f-3801-4389-a2f0-ff44eec0e0e1 tempest-VolumesTransfersV357Test-1217735249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (496db5a2-dc8c-4a64-bffa-0dbe32f79514) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:15:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1901857899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=904b9bc7-5c6c-4aac-bf23-ab45a33ecca3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd044db3c0d24f7ea9f4081c2af51fe7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:15:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:15:40Z,use_quota=True,user_id='8a5d733dec4741bf9180219bdf84b0fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:40 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-e7fa0e2f-3801-4389-a2f0-ff44eec0e0e1 tempest-VolumesTransfersV357Test-1217735249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbb849d9-fcee-4aac-9ff5-1ab4a59be6c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:40 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-e7fa0e2f-3801-4389-a2f0-ff44eec0e0e1 tempest-VolumesTransfersV357Test-1217735249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbb849d9-fcee-4aac-9ff5-1ab4a59be6c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:40 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-e7fa0e2f-3801-4389-a2f0-ff44eec0e0e1 tempest-VolumesTransfersV357Test-1217735249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e56ee04-8ad9-46ac-a272-d9cd5ee21ad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:40 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-e7fa0e2f-3801-4389-a2f0-ff44eec0e0e1 tempest-VolumesTransfersV357Test-1217735249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e56ee04-8ad9-46ac-a272-d9cd5ee21ad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '904b9bc7-5c6c-4aac-bf23-ab45a33ecca3', 'volume_name': 'volume-904b9bc7-5c6c-4aac-bf23-ab45a33ecca3', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:40 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-e7fa0e2f-3801-4389-a2f0-ff44eec0e0e1 tempest-VolumesTransfersV357Test-1217735249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b555346-4ebd-4a5e-9e3e-3654b7c4e658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:40 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-e7fa0e2f-3801-4389-a2f0-ff44eec0e0e1 tempest-VolumesTransfersV357Test-1217735249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b555346-4ebd-4a5e-9e3e-3654b7c4e658) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:40 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-e7fa0e2f-3801-4389-a2f0-ff44eec0e0e1 tempest-VolumesTransfersV357Test-1217735249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e4a8f89-1ecd-4c23-a86b-917b39817a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:40 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-e7fa0e2f-3801-4389-a2f0-ff44eec0e0e1 tempest-VolumesTransfersV357Test-1217735249 None] Volume 904b9bc7-5c6c-4aac-bf23-ab45a33ecca3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-904b9bc7-5c6c-4aac-bf23-ab45a33ecca3', 'volume_size': 1} Nov 02 10:15:40 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-e7fa0e2f-3801-4389-a2f0-ff44eec0e0e1 tempest-VolumesTransfersV357Test-1217735249 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:15:40 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-e7fa0e2f-3801-4389-a2f0-ff44eec0e0e1 tempest-VolumesTransfersV357Test-1217735249 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:15:40 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-e7fa0e2f-3801-4389-a2f0-ff44eec0e0e1 tempest-VolumesTransfersV357Test-1217735249 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:15:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1901857899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=904b9bc7-5c6c-4aac-bf23-ab45a33ecca3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd044db3c0d24f7ea9f4081c2af51fe7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:15:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:15:40Z,use_quota=True,user_id='8a5d733dec4741bf9180219bdf84b0fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:15:40 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-e7fa0e2f-3801-4389-a2f0-ff44eec0e0e1 tempest-VolumesTransfersV357Test-1217735249 None] Creating volume 904b9bc7-5c6c-4aac-bf23-ab45a33ecca3 {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:15:40 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-e7fa0e2f-3801-4389-a2f0-ff44eec0e0e1 tempest-VolumesTransfersV357Test-1217735249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:15:40 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-e7fa0e2f-3801-4389-a2f0-ff44eec0e0e1 tempest-VolumesTransfersV357Test-1217735249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:15:40 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-e7fa0e2f-3801-4389-a2f0-ff44eec0e0e1 tempest-VolumesTransfersV357Test-1217735249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:15:40 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-e7fa0e2f-3801-4389-a2f0-ff44eec0e0e1 tempest-VolumesTransfersV357Test-1217735249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:15:40 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-e7fa0e2f-3801-4389-a2f0-ff44eec0e0e1 tempest-VolumesTransfersV357Test-1217735249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:15:40 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-e7fa0e2f-3801-4389-a2f0-ff44eec0e0e1 tempest-VolumesTransfersV357Test-1217735249 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:15:40 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-e7fa0e2f-3801-4389-a2f0-ff44eec0e0e1 tempest-VolumesTransfersV357Test-1217735249 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:15:40 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-e7fa0e2f-3801-4389-a2f0-ff44eec0e0e1 tempest-VolumesTransfersV357Test-1217735249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-904b9bc7-5c6c-4aac-bf23-ab45a33ecca3 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:40 devstack sudo[99284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-904b9bc7-5c6c-4aac-bf23-ab45a33ecca3 1073741824 Nov 02 10:15:40 devstack sudo[99284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:40 devstack sudo[99281]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:40 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-af902c7b-df5b-40c2-a353-d5fed3ff58d1 tempest-VolumesListTestJSON-2141001974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3d2eaa5b-b23f-4017-bf4c-ddeee8dcda23" returned: 0 in 0.364s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:40 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-af902c7b-df5b-40c2-a353-d5fed3ff58d1 tempest-VolumesListTestJSON-2141001974 None] Lock "cinder-quobyte-3d2eaa5b-b23f-4017-bf4c-ddeee8dcda23" released by "delete_volume" :: held 0.957s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:15:40 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-af902c7b-df5b-40c2-a353-d5fed3ff58d1 tempest-VolumesListTestJSON-2141001974 None] Created reservations ['99756c2b-8af2-49c2-b1a3-5e192d2c7b01', '999eb3bf-9d41-4f3f-b4b1-de6fb269709b', 'd963fde6-b1b1-43f9-aa7a-cf58ab478295', 'b8ea08f2-5c07-44e2-8cb0-79a6fdf75c47'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:15:40 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-af902c7b-df5b-40c2-a353-d5fed3ff58d1 tempest-VolumesListTestJSON-2141001974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:15:40 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-af902c7b-df5b-40c2-a353-d5fed3ff58d1 tempest-VolumesListTestJSON-2141001974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:15:40 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-af902c7b-df5b-40c2-a353-d5fed3ff58d1 tempest-VolumesListTestJSON-2141001974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:15:40 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-af902c7b-df5b-40c2-a353-d5fed3ff58d1 tempest-VolumesListTestJSON-2141001974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:15:40 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-af902c7b-df5b-40c2-a353-d5fed3ff58d1 tempest-VolumesListTestJSON-2141001974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:15:40 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-af902c7b-df5b-40c2-a353-d5fed3ff58d1 tempest-VolumesListTestJSON-2141001974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:40 devstack sudo[99288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:15:40 devstack sudo[99288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:40 devstack sudo[99284]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:40 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-e7fa0e2f-3801-4389-a2f0-ff44eec0e0e1 tempest-VolumesTransfersV357Test-1217735249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-904b9bc7-5c6c-4aac-bf23-ab45a33ecca3 1073741824" returned: 0 in 0.772s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:40 devstack sudo[99288]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:41 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-af902c7b-df5b-40c2-a353-d5fed3ff58d1 tempest-VolumesListTestJSON-2141001974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.426s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:41 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-af902c7b-df5b-40c2-a353-d5fed3ff58d1 tempest-VolumesListTestJSON-2141001974 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:15:41 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-af902c7b-df5b-40c2-a353-d5fed3ff58d1 tempest-VolumesListTestJSON-2141001974 None] Deleted volume successfully. Nov 02 10:15:41 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-e7fa0e2f-3801-4389-a2f0-ff44eec0e0e1 tempest-VolumesTransfersV357Test-1217735249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-904b9bc7-5c6c-4aac-bf23-ab45a33ecca3 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:41 devstack sudo[99294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-904b9bc7-5c6c-4aac-bf23-ab45a33ecca3 Nov 02 10:15:41 devstack sudo[99294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:41 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-af902c7b-df5b-40c2-a353-d5fed3ff58d1 tempest-VolumesListTestJSON-2141001974 None] Lock "cinder-3d2eaa5b-b23f-4017-bf4c-ddeee8dcda23-delete_volume" released by "delete_volume" :: held 1.780s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:15:41 devstack sudo[99294]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:41 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-e7fa0e2f-3801-4389-a2f0-ff44eec0e0e1 tempest-VolumesTransfersV357Test-1217735249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-904b9bc7-5c6c-4aac-bf23-ab45a33ecca3" returned: 0 in 0.315s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:41 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-e7fa0e2f-3801-4389-a2f0-ff44eec0e0e1 tempest-VolumesTransfersV357Test-1217735249 None] <== create_volume: return (1159ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:15:41 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-e7fa0e2f-3801-4389-a2f0-ff44eec0e0e1 tempest-VolumesTransfersV357Test-1217735249 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.165s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:15:41 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-e7fa0e2f-3801-4389-a2f0-ff44eec0e0e1 tempest-VolumesTransfersV357Test-1217735249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e4a8f89-1ecd-4c23-a86b-917b39817a58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-904b9bc7-5c6c-4aac-bf23-ab45a33ecca3', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:41 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-e7fa0e2f-3801-4389-a2f0-ff44eec0e0e1 tempest-VolumesTransfersV357Test-1217735249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0beeb946-8142-481b-a1bb-276396b54cac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:41 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-e7fa0e2f-3801-4389-a2f0-ff44eec0e0e1 tempest-VolumesTransfersV357Test-1217735249 None] Volume volume-904b9bc7-5c6c-4aac-bf23-ab45a33ecca3 (904b9bc7-5c6c-4aac-bf23-ab45a33ecca3): created successfully Nov 02 10:15:41 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-e7fa0e2f-3801-4389-a2f0-ff44eec0e0e1 tempest-VolumesTransfersV357Test-1217735249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0beeb946-8142-481b-a1bb-276396b54cac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:41 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-e7fa0e2f-3801-4389-a2f0-ff44eec0e0e1 tempest-VolumesTransfersV357Test-1217735249 None] Flow 'volume_create_manager' (7184d953-5d7e-4781-a0c6-d35ffd22cf5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:15:41 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-e7fa0e2f-3801-4389-a2f0-ff44eec0e0e1 tempest-VolumesTransfersV357Test-1217735249 None] Created volume successfully. Nov 02 10:15:41 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-94062105-8d9d-45d0-8820-6f2da67e799c tempest-VolumesListTestJSON-2141001974 None] Acquiring lock "cinder-2d9ebdbf-b9e6-4b80-b1ab-da9188039a5a-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:15:41 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-94062105-8d9d-45d0-8820-6f2da67e799c tempest-VolumesListTestJSON-2141001974 None] Lock "cinder-2d9ebdbf-b9e6-4b80-b1ab-da9188039a5a-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:15:41 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-94062105-8d9d-45d0-8820-6f2da67e799c tempest-VolumesListTestJSON-2141001974 None] Acquiring lock "cinder-quobyte-2d9ebdbf-b9e6-4b80-b1ab-da9188039a5a" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:15:41 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-94062105-8d9d-45d0-8820-6f2da67e799c tempest-VolumesListTestJSON-2141001974 None] Lock "cinder-quobyte-2d9ebdbf-b9e6-4b80-b1ab-da9188039a5a" acquired by "delete_volume" :: waited 0.020s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:15:41 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[e11db0da-f98c-4029-bfcd-b44a9fb70432]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:15:41 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-94062105-8d9d-45d0-8820-6f2da67e799c tempest-VolumesListTestJSON-2141001974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-2d9ebdbf-b9e6-4b80-b1ab-da9188039a5a {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:41 devstack sudo[99297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-2d9ebdbf-b9e6-4b80-b1ab-da9188039a5a Nov 02 10:15:41 devstack sudo[99297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:42 devstack sudo[99297]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:42 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-94062105-8d9d-45d0-8820-6f2da67e799c tempest-VolumesListTestJSON-2141001974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-2d9ebdbf-b9e6-4b80-b1ab-da9188039a5a" returned: 0 in 0.460s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:42 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-94062105-8d9d-45d0-8820-6f2da67e799c tempest-VolumesListTestJSON-2141001974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-2d9ebdbf-b9e6-4b80-b1ab-da9188039a5a {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:42 devstack sudo[99302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-2d9ebdbf-b9e6-4b80-b1ab-da9188039a5a Nov 02 10:15:42 devstack sudo[99302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:42 devstack sudo[99302]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:42 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-94062105-8d9d-45d0-8820-6f2da67e799c tempest-VolumesListTestJSON-2141001974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-2d9ebdbf-b9e6-4b80-b1ab-da9188039a5a" returned: 0 in 0.288s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:42 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-94062105-8d9d-45d0-8820-6f2da67e799c tempest-VolumesListTestJSON-2141001974 None] Lock "cinder-quobyte-2d9ebdbf-b9e6-4b80-b1ab-da9188039a5a" released by "delete_volume" :: held 0.797s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:15:42 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-94062105-8d9d-45d0-8820-6f2da67e799c tempest-VolumesListTestJSON-2141001974 None] Created reservations ['3631e2d1-da51-4ccf-ba25-d938eb036eb0', 'b05ad787-2f51-42b0-918b-a17d1d991306', '56a582f0-061d-41c5-8b75-b6bcf35298ec', '5a9d6402-0372-4e3b-b7a9-3827de577434'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:15:42 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-94062105-8d9d-45d0-8820-6f2da67e799c tempest-VolumesListTestJSON-2141001974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:15:42 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-94062105-8d9d-45d0-8820-6f2da67e799c tempest-VolumesListTestJSON-2141001974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:15:42 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-94062105-8d9d-45d0-8820-6f2da67e799c tempest-VolumesListTestJSON-2141001974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:15:42 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-94062105-8d9d-45d0-8820-6f2da67e799c tempest-VolumesListTestJSON-2141001974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:15:42 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-94062105-8d9d-45d0-8820-6f2da67e799c tempest-VolumesListTestJSON-2141001974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:15:42 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-94062105-8d9d-45d0-8820-6f2da67e799c tempest-VolumesListTestJSON-2141001974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:42 devstack sudo[99305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:15:42 devstack sudo[99305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:42 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-1addeb73-8cbf-4666-afbf-f62d42aea451 tempest-VolumesListTestJSON-2141001974 None] Acquiring lock "cinder-7fcc4714-3a55-4f7c-b25c-1274603ff0a8-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:15:43 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-1addeb73-8cbf-4666-afbf-f62d42aea451 tempest-VolumesListTestJSON-2141001974 None] Lock "cinder-7fcc4714-3a55-4f7c-b25c-1274603ff0a8-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:15:43 devstack sudo[99305]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:43 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-94062105-8d9d-45d0-8820-6f2da67e799c tempest-VolumesListTestJSON-2141001974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.329s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:43 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-94062105-8d9d-45d0-8820-6f2da67e799c tempest-VolumesListTestJSON-2141001974 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:15:43 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-94062105-8d9d-45d0-8820-6f2da67e799c tempest-VolumesListTestJSON-2141001974 None] Deleted volume successfully. Nov 02 10:15:43 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-94062105-8d9d-45d0-8820-6f2da67e799c tempest-VolumesListTestJSON-2141001974 None] Lock "cinder-2d9ebdbf-b9e6-4b80-b1ab-da9188039a5a-delete_volume" released by "delete_volume" :: held 1.420s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:15:43 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-1addeb73-8cbf-4666-afbf-f62d42aea451 tempest-VolumesListTestJSON-2141001974 None] Acquiring lock "cinder-quobyte-7fcc4714-3a55-4f7c-b25c-1274603ff0a8" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:15:43 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-1addeb73-8cbf-4666-afbf-f62d42aea451 tempest-VolumesListTestJSON-2141001974 None] Lock "cinder-quobyte-7fcc4714-3a55-4f7c-b25c-1274603ff0a8" acquired by "delete_volume" :: waited 0.016s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:15:43 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[22c75309-31a1-46ae-af75-a77dcf1fdcbc]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:15:43 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-1addeb73-8cbf-4666-afbf-f62d42aea451 tempest-VolumesListTestJSON-2141001974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-7fcc4714-3a55-4f7c-b25c-1274603ff0a8 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:43 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-2f3d0b22-d2fa-42e7-8e6c-ca5a21a5304d tempest-VolumesTransfersV357Test-276285860 None] Transfer volume completed successfully. Nov 02 10:15:43 devstack sudo[99308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-7fcc4714-3a55-4f7c-b25c-1274603ff0a8 Nov 02 10:15:43 devstack sudo[99308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:43 devstack sudo[99308]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:43 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-1addeb73-8cbf-4666-afbf-f62d42aea451 tempest-VolumesListTestJSON-2141001974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-7fcc4714-3a55-4f7c-b25c-1274603ff0a8" returned: 0 in 0.499s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:43 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-1addeb73-8cbf-4666-afbf-f62d42aea451 tempest-VolumesListTestJSON-2141001974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-7fcc4714-3a55-4f7c-b25c-1274603ff0a8 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:43 devstack sudo[99314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-7fcc4714-3a55-4f7c-b25c-1274603ff0a8 Nov 02 10:15:43 devstack sudo[99314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:43 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-d459dec8-cc80-4520-8d41-b459addad2b0 tempest-VolumesTransfersV357Test-1462458474 None] Acquiring lock "cinder-904b9bc7-5c6c-4aac-bf23-ab45a33ecca3-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:15:43 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-d459dec8-cc80-4520-8d41-b459addad2b0 tempest-VolumesTransfersV357Test-1462458474 None] Lock "cinder-904b9bc7-5c6c-4aac-bf23-ab45a33ecca3-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:15:43 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-d459dec8-cc80-4520-8d41-b459addad2b0 tempest-VolumesTransfersV357Test-1462458474 None] Acquiring lock "cinder-quobyte-904b9bc7-5c6c-4aac-bf23-ab45a33ecca3" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:15:43 devstack sudo[99314]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:43 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-1addeb73-8cbf-4666-afbf-f62d42aea451 tempest-VolumesListTestJSON-2141001974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-7fcc4714-3a55-4f7c-b25c-1274603ff0a8" returned: 0 in 0.302s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:43 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-d459dec8-cc80-4520-8d41-b459addad2b0 tempest-VolumesTransfersV357Test-1462458474 None] Lock "cinder-quobyte-904b9bc7-5c6c-4aac-bf23-ab45a33ecca3" acquired by "delete_volume" :: waited 0.026s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:15:43 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-1addeb73-8cbf-4666-afbf-f62d42aea451 tempest-VolumesListTestJSON-2141001974 None] Lock "cinder-quobyte-7fcc4714-3a55-4f7c-b25c-1274603ff0a8" released by "delete_volume" :: held 0.864s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:15:43 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6be6c97-b35e-4a21-aa4c-54cb20ff9285]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:15:43 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-d459dec8-cc80-4520-8d41-b459addad2b0 tempest-VolumesTransfersV357Test-1462458474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-904b9bc7-5c6c-4aac-bf23-ab45a33ecca3 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:44 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-1addeb73-8cbf-4666-afbf-f62d42aea451 tempest-VolumesListTestJSON-2141001974 None] Created reservations ['bb7d4562-5c54-4a21-a459-72675a5d4b11', '7f737d16-2496-4734-9192-346b0f8ac544', 'fb2cb5b6-397e-4102-aa1e-a81f9838ba2d', 'f00ecff5-3264-41c2-bcb4-385f96df6b7d'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:15:44 devstack sudo[99317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-904b9bc7-5c6c-4aac-bf23-ab45a33ecca3 Nov 02 10:15:44 devstack sudo[99317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:44 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-1addeb73-8cbf-4666-afbf-f62d42aea451 tempest-VolumesListTestJSON-2141001974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:15:44 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-1addeb73-8cbf-4666-afbf-f62d42aea451 tempest-VolumesListTestJSON-2141001974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:15:44 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-1addeb73-8cbf-4666-afbf-f62d42aea451 tempest-VolumesListTestJSON-2141001974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:15:44 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-1addeb73-8cbf-4666-afbf-f62d42aea451 tempest-VolumesListTestJSON-2141001974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:15:44 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-1addeb73-8cbf-4666-afbf-f62d42aea451 tempest-VolumesListTestJSON-2141001974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:15:44 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-1addeb73-8cbf-4666-afbf-f62d42aea451 tempest-VolumesListTestJSON-2141001974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:44 devstack sudo[99319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:15:44 devstack sudo[99319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:44 devstack sudo[99317]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:44 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-d459dec8-cc80-4520-8d41-b459addad2b0 tempest-VolumesTransfersV357Test-1462458474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-904b9bc7-5c6c-4aac-bf23-ab45a33ecca3" returned: 0 in 0.413s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:44 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-d459dec8-cc80-4520-8d41-b459addad2b0 tempest-VolumesTransfersV357Test-1462458474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-904b9bc7-5c6c-4aac-bf23-ab45a33ecca3 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:44 devstack sudo[99325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-904b9bc7-5c6c-4aac-bf23-ab45a33ecca3 Nov 02 10:15:44 devstack sudo[99325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:44 devstack sudo[99319]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:44 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-1addeb73-8cbf-4666-afbf-f62d42aea451 tempest-VolumesListTestJSON-2141001974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.267s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:44 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-1addeb73-8cbf-4666-afbf-f62d42aea451 tempest-VolumesListTestJSON-2141001974 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:15:44 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-1addeb73-8cbf-4666-afbf-f62d42aea451 tempest-VolumesListTestJSON-2141001974 None] Deleted volume successfully. Nov 02 10:15:44 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-1addeb73-8cbf-4666-afbf-f62d42aea451 tempest-VolumesListTestJSON-2141001974 None] Lock "cinder-7fcc4714-3a55-4f7c-b25c-1274603ff0a8-delete_volume" released by "delete_volume" :: held 1.482s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:15:44 devstack sudo[99325]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:44 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-d459dec8-cc80-4520-8d41-b459addad2b0 tempest-VolumesTransfersV357Test-1462458474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-904b9bc7-5c6c-4aac-bf23-ab45a33ecca3" returned: 0 in 0.282s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:44 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-d459dec8-cc80-4520-8d41-b459addad2b0 tempest-VolumesTransfersV357Test-1462458474 None] Lock "cinder-quobyte-904b9bc7-5c6c-4aac-bf23-ab45a33ecca3" released by "delete_volume" :: held 0.741s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:15:44 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-d459dec8-cc80-4520-8d41-b459addad2b0 tempest-VolumesTransfersV357Test-1462458474 None] Created reservations ['de0d68af-9e70-4aa8-9bee-4daeecaa252e', '96f76034-f5ce-4379-92b1-b0f505787efc', '6bdcafe4-94b9-4cf6-857f-a1abbb8d2eca', '9c65476c-6c24-403c-b035-8bde273c75af'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:15:44 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-d459dec8-cc80-4520-8d41-b459addad2b0 tempest-VolumesTransfersV357Test-1462458474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:15:44 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-d459dec8-cc80-4520-8d41-b459addad2b0 tempest-VolumesTransfersV357Test-1462458474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:15:44 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-d459dec8-cc80-4520-8d41-b459addad2b0 tempest-VolumesTransfersV357Test-1462458474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:15:44 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-d459dec8-cc80-4520-8d41-b459addad2b0 tempest-VolumesTransfersV357Test-1462458474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:15:44 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-d459dec8-cc80-4520-8d41-b459addad2b0 tempest-VolumesTransfersV357Test-1462458474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:15:44 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-d459dec8-cc80-4520-8d41-b459addad2b0 tempest-VolumesTransfersV357Test-1462458474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:44 devstack sudo[99328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:15:44 devstack sudo[99328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:45 devstack sudo[99328]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:45 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-d459dec8-cc80-4520-8d41-b459addad2b0 tempest-VolumesTransfersV357Test-1462458474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.269s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:45 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-d459dec8-cc80-4520-8d41-b459addad2b0 tempest-VolumesTransfersV357Test-1462458474 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:15:45 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-d459dec8-cc80-4520-8d41-b459addad2b0 tempest-VolumesTransfersV357Test-1462458474 None] Deleted volume successfully. Nov 02 10:15:45 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-d459dec8-cc80-4520-8d41-b459addad2b0 tempest-VolumesTransfersV357Test-1462458474 None] Lock "cinder-904b9bc7-5c6c-4aac-bf23-ab45a33ecca3-delete_volume" released by "delete_volume" :: held 1.298s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:15:45 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-3898f66b-66b6-477c-86a6-ec9df3623b4b tempest-VolumesTransfersV357Test-1217735249 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:15:45 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-3898f66b-66b6-477c-86a6-ec9df3623b4b tempest-VolumesTransfersV357Test-1217735249 None] Flow 'volume_create_manager' (fb1eba38-7970-48c1-a6a2-1d4f31d42d00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:15:45 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-3898f66b-66b6-477c-86a6-ec9df3623b4b tempest-VolumesTransfersV357Test-1217735249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92b0e90c-8eff-4150-9364-7fd9cac18a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:45 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-3898f66b-66b6-477c-86a6-ec9df3623b4b tempest-VolumesTransfersV357Test-1217735249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92b0e90c-8eff-4150-9364-7fd9cac18a18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:15:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1277852109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cf3fb70-9767-4421-b53d-44709f46d841,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd044db3c0d24f7ea9f4081c2af51fe7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:15:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:15:46Z,use_quota=True,user_id='8a5d733dec4741bf9180219bdf84b0fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:45 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-3898f66b-66b6-477c-86a6-ec9df3623b4b tempest-VolumesTransfersV357Test-1217735249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2bba13c-af30-4a3d-842f-873866b0873e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:45 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-3898f66b-66b6-477c-86a6-ec9df3623b4b tempest-VolumesTransfersV357Test-1217735249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2bba13c-af30-4a3d-842f-873866b0873e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:45 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-3898f66b-66b6-477c-86a6-ec9df3623b4b tempest-VolumesTransfersV357Test-1217735249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f1a08be-2fe8-45f8-9755-fbdeeb97d189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:45 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-3898f66b-66b6-477c-86a6-ec9df3623b4b tempest-VolumesTransfersV357Test-1217735249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f1a08be-2fe8-45f8-9755-fbdeeb97d189) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2cf3fb70-9767-4421-b53d-44709f46d841', 'volume_name': 'volume-2cf3fb70-9767-4421-b53d-44709f46d841', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:45 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-3898f66b-66b6-477c-86a6-ec9df3623b4b tempest-VolumesTransfersV357Test-1217735249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43e2f99d-65c5-4123-8475-ea5d873c78a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:45 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-3898f66b-66b6-477c-86a6-ec9df3623b4b tempest-VolumesTransfersV357Test-1217735249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43e2f99d-65c5-4123-8475-ea5d873c78a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:45 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-3898f66b-66b6-477c-86a6-ec9df3623b4b tempest-VolumesTransfersV357Test-1217735249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd9593d1-fc8e-4129-8f47-5c75ee5add94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:45 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-3898f66b-66b6-477c-86a6-ec9df3623b4b tempest-VolumesTransfersV357Test-1217735249 None] Volume 2cf3fb70-9767-4421-b53d-44709f46d841: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2cf3fb70-9767-4421-b53d-44709f46d841', 'volume_size': 1} Nov 02 10:15:45 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-3898f66b-66b6-477c-86a6-ec9df3623b4b tempest-VolumesTransfersV357Test-1217735249 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:15:45 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-3898f66b-66b6-477c-86a6-ec9df3623b4b tempest-VolumesTransfersV357Test-1217735249 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:15:45 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-3898f66b-66b6-477c-86a6-ec9df3623b4b tempest-VolumesTransfersV357Test-1217735249 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:15:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1277852109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cf3fb70-9767-4421-b53d-44709f46d841,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd044db3c0d24f7ea9f4081c2af51fe7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:15:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:15:46Z,use_quota=True,user_id='8a5d733dec4741bf9180219bdf84b0fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:15:45 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-3898f66b-66b6-477c-86a6-ec9df3623b4b tempest-VolumesTransfersV357Test-1217735249 None] Creating volume 2cf3fb70-9767-4421-b53d-44709f46d841 {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:15:45 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-3898f66b-66b6-477c-86a6-ec9df3623b4b tempest-VolumesTransfersV357Test-1217735249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:15:45 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-3898f66b-66b6-477c-86a6-ec9df3623b4b tempest-VolumesTransfersV357Test-1217735249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:15:45 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-3898f66b-66b6-477c-86a6-ec9df3623b4b tempest-VolumesTransfersV357Test-1217735249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:15:45 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-3898f66b-66b6-477c-86a6-ec9df3623b4b tempest-VolumesTransfersV357Test-1217735249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:15:45 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-3898f66b-66b6-477c-86a6-ec9df3623b4b tempest-VolumesTransfersV357Test-1217735249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:15:45 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-3898f66b-66b6-477c-86a6-ec9df3623b4b tempest-VolumesTransfersV357Test-1217735249 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:15:45 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-3898f66b-66b6-477c-86a6-ec9df3623b4b tempest-VolumesTransfersV357Test-1217735249 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:15:45 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-3898f66b-66b6-477c-86a6-ec9df3623b4b tempest-VolumesTransfersV357Test-1217735249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-2cf3fb70-9767-4421-b53d-44709f46d841 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:45 devstack sudo[99331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-2cf3fb70-9767-4421-b53d-44709f46d841 1073741824 Nov 02 10:15:45 devstack sudo[99331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:46 devstack sudo[99331]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:46 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-3898f66b-66b6-477c-86a6-ec9df3623b4b tempest-VolumesTransfersV357Test-1217735249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-2cf3fb70-9767-4421-b53d-44709f46d841 1073741824" returned: 0 in 0.545s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:46 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-3898f66b-66b6-477c-86a6-ec9df3623b4b tempest-VolumesTransfersV357Test-1217735249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-2cf3fb70-9767-4421-b53d-44709f46d841 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:46 devstack sudo[99337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-2cf3fb70-9767-4421-b53d-44709f46d841 Nov 02 10:15:46 devstack sudo[99337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:46 devstack sudo[99337]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:46 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-3898f66b-66b6-477c-86a6-ec9df3623b4b tempest-VolumesTransfersV357Test-1217735249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-2cf3fb70-9767-4421-b53d-44709f46d841" returned: 0 in 0.283s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:46 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-3898f66b-66b6-477c-86a6-ec9df3623b4b tempest-VolumesTransfersV357Test-1217735249 None] <== create_volume: return (879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:15:46 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-3898f66b-66b6-477c-86a6-ec9df3623b4b tempest-VolumesTransfersV357Test-1217735249 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:15:46 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-3898f66b-66b6-477c-86a6-ec9df3623b4b tempest-VolumesTransfersV357Test-1217735249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd9593d1-fc8e-4129-8f47-5c75ee5add94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2cf3fb70-9767-4421-b53d-44709f46d841', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:46 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-3898f66b-66b6-477c-86a6-ec9df3623b4b tempest-VolumesTransfersV357Test-1217735249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf57968a-8da6-4550-a086-e5ee1513d2b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:46 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-3898f66b-66b6-477c-86a6-ec9df3623b4b tempest-VolumesTransfersV357Test-1217735249 None] Volume volume-2cf3fb70-9767-4421-b53d-44709f46d841 (2cf3fb70-9767-4421-b53d-44709f46d841): created successfully Nov 02 10:15:46 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-3898f66b-66b6-477c-86a6-ec9df3623b4b tempest-VolumesTransfersV357Test-1217735249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf57968a-8da6-4550-a086-e5ee1513d2b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:46 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-3898f66b-66b6-477c-86a6-ec9df3623b4b tempest-VolumesTransfersV357Test-1217735249 None] Flow 'volume_create_manager' (fb1eba38-7970-48c1-a6a2-1d4f31d42d00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:15:46 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-3898f66b-66b6-477c-86a6-ec9df3623b4b tempest-VolumesTransfersV357Test-1217735249 None] Created volume successfully. Nov 02 10:15:48 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-286733f7-7d67-444a-9bc6-38aca4303e58 tempest-VolumesTransfersV357Test-1462458474 None] Acquiring lock "cinder-2cf3fb70-9767-4421-b53d-44709f46d841-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:15:48 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-286733f7-7d67-444a-9bc6-38aca4303e58 tempest-VolumesTransfersV357Test-1462458474 None] Lock "cinder-2cf3fb70-9767-4421-b53d-44709f46d841-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:15:48 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-286733f7-7d67-444a-9bc6-38aca4303e58 tempest-VolumesTransfersV357Test-1462458474 None] Acquiring lock "cinder-quobyte-2cf3fb70-9767-4421-b53d-44709f46d841" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:15:48 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-286733f7-7d67-444a-9bc6-38aca4303e58 tempest-VolumesTransfersV357Test-1462458474 None] Lock "cinder-quobyte-2cf3fb70-9767-4421-b53d-44709f46d841" acquired by "delete_volume" :: waited 0.016s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:15:48 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5f6e9c0-d403-45a7-bb9e-0659c44ae394]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:15:48 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-286733f7-7d67-444a-9bc6-38aca4303e58 tempest-VolumesTransfersV357Test-1462458474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-2cf3fb70-9767-4421-b53d-44709f46d841 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:48 devstack sudo[99340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-2cf3fb70-9767-4421-b53d-44709f46d841 Nov 02 10:15:48 devstack sudo[99340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:48 devstack sudo[99340]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:48 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-286733f7-7d67-444a-9bc6-38aca4303e58 tempest-VolumesTransfersV357Test-1462458474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-2cf3fb70-9767-4421-b53d-44709f46d841" returned: 0 in 0.413s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:48 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-286733f7-7d67-444a-9bc6-38aca4303e58 tempest-VolumesTransfersV357Test-1462458474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-2cf3fb70-9767-4421-b53d-44709f46d841 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:48 devstack sudo[99345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-2cf3fb70-9767-4421-b53d-44709f46d841 Nov 02 10:15:48 devstack sudo[99345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:48 devstack sudo[99345]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:48 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-286733f7-7d67-444a-9bc6-38aca4303e58 tempest-VolumesTransfersV357Test-1462458474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-2cf3fb70-9767-4421-b53d-44709f46d841" returned: 0 in 0.286s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:48 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-286733f7-7d67-444a-9bc6-38aca4303e58 tempest-VolumesTransfersV357Test-1462458474 None] Lock "cinder-quobyte-2cf3fb70-9767-4421-b53d-44709f46d841" released by "delete_volume" :: held 0.756s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:15:49 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-286733f7-7d67-444a-9bc6-38aca4303e58 tempest-VolumesTransfersV357Test-1462458474 None] Created reservations ['21afe957-a4ea-4a1c-9592-f98bc7686ec5', '20c0e9f9-132d-45f3-85ce-85a58fda1080', '05b8f0f1-99be-4ee4-9d2b-943c6f5ad86a', '3fdf32a1-ac93-4f4c-8314-37e3ee39febd'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:15:49 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-286733f7-7d67-444a-9bc6-38aca4303e58 tempest-VolumesTransfersV357Test-1462458474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:15:49 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-286733f7-7d67-444a-9bc6-38aca4303e58 tempest-VolumesTransfersV357Test-1462458474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:15:49 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-286733f7-7d67-444a-9bc6-38aca4303e58 tempest-VolumesTransfersV357Test-1462458474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:15:49 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-286733f7-7d67-444a-9bc6-38aca4303e58 tempest-VolumesTransfersV357Test-1462458474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:15:49 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-286733f7-7d67-444a-9bc6-38aca4303e58 tempest-VolumesTransfersV357Test-1462458474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:15:49 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-286733f7-7d67-444a-9bc6-38aca4303e58 tempest-VolumesTransfersV357Test-1462458474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:49 devstack sudo[99348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:15:49 devstack sudo[99348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:49 devstack sudo[99348]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:49 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-286733f7-7d67-444a-9bc6-38aca4303e58 tempest-VolumesTransfersV357Test-1462458474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.291s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:49 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-286733f7-7d67-444a-9bc6-38aca4303e58 tempest-VolumesTransfersV357Test-1462458474 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:15:49 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-286733f7-7d67-444a-9bc6-38aca4303e58 tempest-VolumesTransfersV357Test-1462458474 None] Deleted volume successfully. Nov 02 10:15:49 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-286733f7-7d67-444a-9bc6-38aca4303e58 tempest-VolumesTransfersV357Test-1462458474 None] Lock "cinder-2cf3fb70-9767-4421-b53d-44709f46d841-delete_volume" released by "delete_volume" :: held 1.451s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:15:49 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cf98c8c-4ae2-4b5d-9b46-7cd865760d44 tempest-VolumesSnapshotListTestJSON-343657281 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:15:49 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-4cf98c8c-4ae2-4b5d-9b46-7cd865760d44 tempest-VolumesSnapshotListTestJSON-343657281 None] Flow 'volume_create_manager' (064d5996-002f-478e-89ce-edf3d34be78c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:15:49 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-4cf98c8c-4ae2-4b5d-9b46-7cd865760d44 tempest-VolumesSnapshotListTestJSON-343657281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dae4b8d5-ef10-49b8-8489-54673f03aeeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:49 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-4cf98c8c-4ae2-4b5d-9b46-7cd865760d44 tempest-VolumesSnapshotListTestJSON-343657281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dae4b8d5-ef10-49b8-8489-54673f03aeeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:15:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1630354326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05aa2d4b-4977-485f-a06e-3601696c34ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a78deda580340d1bdab7d394f3f96ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:15:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:15:50Z,use_quota=True,user_id='2feff2198e5b4518946389979dc67a75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:49 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-4cf98c8c-4ae2-4b5d-9b46-7cd865760d44 tempest-VolumesSnapshotListTestJSON-343657281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cc2440e-61b8-443a-afae-a0606e1b546d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:49 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-4cf98c8c-4ae2-4b5d-9b46-7cd865760d44 tempest-VolumesSnapshotListTestJSON-343657281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cc2440e-61b8-443a-afae-a0606e1b546d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:49 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-4cf98c8c-4ae2-4b5d-9b46-7cd865760d44 tempest-VolumesSnapshotListTestJSON-343657281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46a056de-e326-4938-b7ee-91b3a514e8ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:49 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-4cf98c8c-4ae2-4b5d-9b46-7cd865760d44 tempest-VolumesSnapshotListTestJSON-343657281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46a056de-e326-4938-b7ee-91b3a514e8ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05aa2d4b-4977-485f-a06e-3601696c34ec', 'volume_name': 'volume-05aa2d4b-4977-485f-a06e-3601696c34ec', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:49 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-4cf98c8c-4ae2-4b5d-9b46-7cd865760d44 tempest-VolumesSnapshotListTestJSON-343657281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4aef5a44-14ff-4bcb-a67a-f763335091f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:49 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-4cf98c8c-4ae2-4b5d-9b46-7cd865760d44 tempest-VolumesSnapshotListTestJSON-343657281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4aef5a44-14ff-4bcb-a67a-f763335091f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:49 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-4cf98c8c-4ae2-4b5d-9b46-7cd865760d44 tempest-VolumesSnapshotListTestJSON-343657281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc2218a7-62ab-474b-b46d-95efcf6e11bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:49 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-4cf98c8c-4ae2-4b5d-9b46-7cd865760d44 tempest-VolumesSnapshotListTestJSON-343657281 None] Volume 05aa2d4b-4977-485f-a06e-3601696c34ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05aa2d4b-4977-485f-a06e-3601696c34ec', 'volume_size': 1} Nov 02 10:15:49 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-4cf98c8c-4ae2-4b5d-9b46-7cd865760d44 tempest-VolumesSnapshotListTestJSON-343657281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:15:49 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-4cf98c8c-4ae2-4b5d-9b46-7cd865760d44 tempest-VolumesSnapshotListTestJSON-343657281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:15:49 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-4cf98c8c-4ae2-4b5d-9b46-7cd865760d44 tempest-VolumesSnapshotListTestJSON-343657281 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:15:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1630354326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05aa2d4b-4977-485f-a06e-3601696c34ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a78deda580340d1bdab7d394f3f96ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:15:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:15:50Z,use_quota=True,user_id='2feff2198e5b4518946389979dc67a75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:15:49 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-4cf98c8c-4ae2-4b5d-9b46-7cd865760d44 tempest-VolumesSnapshotListTestJSON-343657281 None] Creating volume 05aa2d4b-4977-485f-a06e-3601696c34ec {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:15:49 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-4cf98c8c-4ae2-4b5d-9b46-7cd865760d44 tempest-VolumesSnapshotListTestJSON-343657281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:15:49 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-4cf98c8c-4ae2-4b5d-9b46-7cd865760d44 tempest-VolumesSnapshotListTestJSON-343657281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:15:49 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-4cf98c8c-4ae2-4b5d-9b46-7cd865760d44 tempest-VolumesSnapshotListTestJSON-343657281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:15:50 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-4cf98c8c-4ae2-4b5d-9b46-7cd865760d44 tempest-VolumesSnapshotListTestJSON-343657281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:15:50 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-4cf98c8c-4ae2-4b5d-9b46-7cd865760d44 tempest-VolumesSnapshotListTestJSON-343657281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:15:50 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-4cf98c8c-4ae2-4b5d-9b46-7cd865760d44 tempest-VolumesSnapshotListTestJSON-343657281 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:15:50 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-4cf98c8c-4ae2-4b5d-9b46-7cd865760d44 tempest-VolumesSnapshotListTestJSON-343657281 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:15:50 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-4cf98c8c-4ae2-4b5d-9b46-7cd865760d44 tempest-VolumesSnapshotListTestJSON-343657281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-05aa2d4b-4977-485f-a06e-3601696c34ec 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:50 devstack sudo[99351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-05aa2d4b-4977-485f-a06e-3601696c34ec 1073741824 Nov 02 10:15:50 devstack sudo[99351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:50 devstack sudo[99351]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:50 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-4cf98c8c-4ae2-4b5d-9b46-7cd865760d44 tempest-VolumesSnapshotListTestJSON-343657281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-05aa2d4b-4977-485f-a06e-3601696c34ec 1073741824" returned: 0 in 0.563s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:50 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-4cf98c8c-4ae2-4b5d-9b46-7cd865760d44 tempest-VolumesSnapshotListTestJSON-343657281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-05aa2d4b-4977-485f-a06e-3601696c34ec {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:50 devstack sudo[99357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-05aa2d4b-4977-485f-a06e-3601696c34ec Nov 02 10:15:50 devstack sudo[99357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:50 devstack sudo[99357]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:50 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-4cf98c8c-4ae2-4b5d-9b46-7cd865760d44 tempest-VolumesSnapshotListTestJSON-343657281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-05aa2d4b-4977-485f-a06e-3601696c34ec" returned: 0 in 0.269s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:50 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-4cf98c8c-4ae2-4b5d-9b46-7cd865760d44 tempest-VolumesSnapshotListTestJSON-343657281 None] <== create_volume: return (891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:15:50 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-4cf98c8c-4ae2-4b5d-9b46-7cd865760d44 tempest-VolumesSnapshotListTestJSON-343657281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.895s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:15:50 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-4cf98c8c-4ae2-4b5d-9b46-7cd865760d44 tempest-VolumesSnapshotListTestJSON-343657281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc2218a7-62ab-474b-b46d-95efcf6e11bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05aa2d4b-4977-485f-a06e-3601696c34ec', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:50 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-4cf98c8c-4ae2-4b5d-9b46-7cd865760d44 tempest-VolumesSnapshotListTestJSON-343657281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07859707-00ca-4cfc-8584-9e77544bde22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:50 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-4cf98c8c-4ae2-4b5d-9b46-7cd865760d44 tempest-VolumesSnapshotListTestJSON-343657281 None] Volume volume-05aa2d4b-4977-485f-a06e-3601696c34ec (05aa2d4b-4977-485f-a06e-3601696c34ec): created successfully Nov 02 10:15:50 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-4cf98c8c-4ae2-4b5d-9b46-7cd865760d44 tempest-VolumesSnapshotListTestJSON-343657281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07859707-00ca-4cfc-8584-9e77544bde22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:50 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-4cf98c8c-4ae2-4b5d-9b46-7cd865760d44 tempest-VolumesSnapshotListTestJSON-343657281 None] Flow 'volume_create_manager' (064d5996-002f-478e-89ce-edf3d34be78c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:15:50 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-4cf98c8c-4ae2-4b5d-9b46-7cd865760d44 tempest-VolumesSnapshotListTestJSON-343657281 None] Created volume successfully. Nov 02 10:15:52 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-9e5bfcee-445f-4ab8-86df-9af154bc160e tempest-VolumesSnapshotListTestJSON-343657281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:15:52 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-9e5bfcee-445f-4ab8-86df-9af154bc160e tempest-VolumesSnapshotListTestJSON-343657281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:15:52 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-9e5bfcee-445f-4ab8-86df-9af154bc160e tempest-VolumesSnapshotListTestJSON-343657281 None] Creating offline snapshot 7afa1736-cf71-4de9-bf28-b0bb50981c38 of volume 05aa2d4b-4977-485f-a06e-3601696c34ec {{(pid=86890) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:15:52 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[17671b8d-89ed-4bdc-9c8f-34edadc3b079]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:15:52 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-9e5bfcee-445f-4ab8-86df-9af154bc160e tempest-VolumesSnapshotListTestJSON-343657281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-05aa2d4b-4977-485f-a06e-3601696c34ec {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:52 devstack sudo[99360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-05aa2d4b-4977-485f-a06e-3601696c34ec Nov 02 10:15:52 devstack sudo[99360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:52 devstack sudo[99360]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:52 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-9e5bfcee-445f-4ab8-86df-9af154bc160e tempest-VolumesSnapshotListTestJSON-343657281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-05aa2d4b-4977-485f-a06e-3601696c34ec" returned: 0 in 0.446s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:52 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-9e5bfcee-445f-4ab8-86df-9af154bc160e tempest-VolumesSnapshotListTestJSON-343657281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-05aa2d4b-4977-485f-a06e-3601696c34ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-05aa2d4b-4977-485f-a06e-3601696c34ec.7afa1736-cf71-4de9-bf28-b0bb50981c38 1G {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:52 devstack sudo[99365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-05aa2d4b-4977-485f-a06e-3601696c34ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-05aa2d4b-4977-485f-a06e-3601696c34ec.7afa1736-cf71-4de9-bf28-b0bb50981c38 1G Nov 02 10:15:52 devstack sudo[99365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:53 devstack sudo[99365]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:53 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-9e5bfcee-445f-4ab8-86df-9af154bc160e tempest-VolumesSnapshotListTestJSON-343657281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-05aa2d4b-4977-485f-a06e-3601696c34ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-05aa2d4b-4977-485f-a06e-3601696c34ec.7afa1736-cf71-4de9-bf28-b0bb50981c38 1G" returned: 0 in 0.534s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:53 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-9e5bfcee-445f-4ab8-86df-9af154bc160e tempest-VolumesSnapshotListTestJSON-343657281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05aa2d4b-4977-485f-a06e-3601696c34ec -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-05aa2d4b-4977-485f-a06e-3601696c34ec.7afa1736-cf71-4de9-bf28-b0bb50981c38 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:53 devstack sudo[99371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05aa2d4b-4977-485f-a06e-3601696c34ec -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-05aa2d4b-4977-485f-a06e-3601696c34ec.7afa1736-cf71-4de9-bf28-b0bb50981c38 Nov 02 10:15:53 devstack sudo[99371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:53 devstack sudo[99371]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:53 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-9e5bfcee-445f-4ab8-86df-9af154bc160e tempest-VolumesSnapshotListTestJSON-343657281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05aa2d4b-4977-485f-a06e-3601696c34ec -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-05aa2d4b-4977-485f-a06e-3601696c34ec.7afa1736-cf71-4de9-bf28-b0bb50981c38" returned: 0 in 0.387s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:53 devstack cinder-volume[86890]: WARNING cinder.volume.drivers.remotefs [None req-9e5bfcee-445f-4ab8-86df-9af154bc160e tempest-VolumesSnapshotListTestJSON-343657281 None] /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-05aa2d4b-4977-485f-a06e-3601696c34ec.7afa1736-cf71-4de9-bf28-b0bb50981c38 is being set with open permissions: ugo+rw Nov 02 10:15:53 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-9e5bfcee-445f-4ab8-86df-9af154bc160e tempest-VolumesSnapshotListTestJSON-343657281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-05aa2d4b-4977-485f-a06e-3601696c34ec.7afa1736-cf71-4de9-bf28-b0bb50981c38 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:53 devstack sudo[99377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-05aa2d4b-4977-485f-a06e-3601696c34ec.7afa1736-cf71-4de9-bf28-b0bb50981c38 Nov 02 10:15:53 devstack sudo[99377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:54 devstack sudo[99377]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:54 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-9e5bfcee-445f-4ab8-86df-9af154bc160e tempest-VolumesSnapshotListTestJSON-343657281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-05aa2d4b-4977-485f-a06e-3601696c34ec.7afa1736-cf71-4de9-bf28-b0bb50981c38" returned: 0 in 0.304s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:54 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-9e5bfcee-445f-4ab8-86df-9af154bc160e tempest-VolumesSnapshotListTestJSON-343657281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-05aa2d4b-4977-485f-a06e-3601696c34ec.info {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:54 devstack sudo[99381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-05aa2d4b-4977-485f-a06e-3601696c34ec.info Nov 02 10:15:54 devstack sudo[99381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:54 devstack sudo[99381]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:54 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-9e5bfcee-445f-4ab8-86df-9af154bc160e tempest-VolumesSnapshotListTestJSON-343657281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-05aa2d4b-4977-485f-a06e-3601696c34ec.info" returned: 0 in 0.385s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:54 devstack cinder-volume[86890]: WARNING cinder.volume.drivers.remotefs [None req-9e5bfcee-445f-4ab8-86df-9af154bc160e tempest-VolumesSnapshotListTestJSON-343657281 None] /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-05aa2d4b-4977-485f-a06e-3601696c34ec.info is being set with open permissions: ugo+rw Nov 02 10:15:54 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-9e5bfcee-445f-4ab8-86df-9af154bc160e tempest-VolumesSnapshotListTestJSON-343657281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-05aa2d4b-4977-485f-a06e-3601696c34ec.info {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:54 devstack sudo[99391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-05aa2d4b-4977-485f-a06e-3601696c34ec.info Nov 02 10:15:54 devstack sudo[99391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:54 devstack sudo[99391]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:54 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-9e5bfcee-445f-4ab8-86df-9af154bc160e tempest-VolumesSnapshotListTestJSON-343657281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-05aa2d4b-4977-485f-a06e-3601696c34ec.info" returned: 0 in 0.374s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:54 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-9e5bfcee-445f-4ab8-86df-9af154bc160e tempest-VolumesSnapshotListTestJSON-343657281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.557s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:15:54 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-9e5bfcee-445f-4ab8-86df-9af154bc160e tempest-VolumesSnapshotListTestJSON-343657281 None] Create snapshot completed successfully Nov 02 10:15:55 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c9f5d601-c45b-47e9-ab4e-567334f76722 tempest-VolumesSnapshotListTestJSON-343657281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:15:55 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c9f5d601-c45b-47e9-ab4e-567334f76722 tempest-VolumesSnapshotListTestJSON-343657281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:15:55 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-c9f5d601-c45b-47e9-ab4e-567334f76722 tempest-VolumesSnapshotListTestJSON-343657281 None] Creating offline snapshot 71afcdb1-9abb-4968-a5b6-d7480017327f of volume 05aa2d4b-4977-485f-a06e-3601696c34ec {{(pid=86890) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:15:55 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e24422a-d4e8-4eaa-b21a-a027b2eb92fa]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:15:55 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c9f5d601-c45b-47e9-ab4e-567334f76722 tempest-VolumesSnapshotListTestJSON-343657281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-05aa2d4b-4977-485f-a06e-3601696c34ec.7afa1736-cf71-4de9-bf28-b0bb50981c38 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:55 devstack sudo[99394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-05aa2d4b-4977-485f-a06e-3601696c34ec.7afa1736-cf71-4de9-bf28-b0bb50981c38 Nov 02 10:15:55 devstack sudo[99394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:56 devstack sudo[99394]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:56 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c9f5d601-c45b-47e9-ab4e-567334f76722 tempest-VolumesSnapshotListTestJSON-343657281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-05aa2d4b-4977-485f-a06e-3601696c34ec.7afa1736-cf71-4de9-bf28-b0bb50981c38" returned: 0 in 0.487s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:56 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-c9f5d601-c45b-47e9-ab4e-567334f76722 tempest-VolumesSnapshotListTestJSON-343657281 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-05aa2d4b-4977-485f-a06e-3601696c34ec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86890) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:15:56 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c9f5d601-c45b-47e9-ab4e-567334f76722 tempest-VolumesSnapshotListTestJSON-343657281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-05aa2d4b-4977-485f-a06e-3601696c34ec.7afa1736-cf71-4de9-bf28-b0bb50981c38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-05aa2d4b-4977-485f-a06e-3601696c34ec.71afcdb1-9abb-4968-a5b6-d7480017327f 1G {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:56 devstack sudo[99399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-05aa2d4b-4977-485f-a06e-3601696c34ec.7afa1736-cf71-4de9-bf28-b0bb50981c38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-05aa2d4b-4977-485f-a06e-3601696c34ec.71afcdb1-9abb-4968-a5b6-d7480017327f 1G Nov 02 10:15:56 devstack sudo[99399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:56 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc4403fe-03bb-45ce-8324-1f956a7406db tempest-TestServerVolumeAttachmentScenario-797186756 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:15:56 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-fc4403fe-03bb-45ce-8324-1f956a7406db tempest-TestServerVolumeAttachmentScenario-797186756 None] Flow 'volume_create_manager' (5166d73b-1d6a-4c9d-a1cb-95ffadfdc122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:15:56 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-fc4403fe-03bb-45ce-8324-1f956a7406db tempest-TestServerVolumeAttachmentScenario-797186756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2aaba74-56f7-458e-9f3e-44eff9e21738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:56 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-fc4403fe-03bb-45ce-8324-1f956a7406db tempest-TestServerVolumeAttachmentScenario-797186756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2aaba74-56f7-458e-9f3e-44eff9e21738) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:15:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-183594700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fac22651-77ef-4699-a672-591630a9a269,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5eceaf9b11e4b3daf7ce8fe128c281f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:15:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:15:56Z,use_quota=True,user_id='1dddf5c7bf6f45feb76d68b95f0134e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:56 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-fc4403fe-03bb-45ce-8324-1f956a7406db tempest-TestServerVolumeAttachmentScenario-797186756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (853ec23b-9777-4838-b147-64856ffd32f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:56 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-fc4403fe-03bb-45ce-8324-1f956a7406db tempest-TestServerVolumeAttachmentScenario-797186756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (853ec23b-9777-4838-b147-64856ffd32f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:56 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-fc4403fe-03bb-45ce-8324-1f956a7406db tempest-TestServerVolumeAttachmentScenario-797186756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2143709-65c5-4a01-a8eb-fa38b2c0b19a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:56 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-fc4403fe-03bb-45ce-8324-1f956a7406db tempest-TestServerVolumeAttachmentScenario-797186756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2143709-65c5-4a01-a8eb-fa38b2c0b19a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fac22651-77ef-4699-a672-591630a9a269', 'volume_name': 'volume-fac22651-77ef-4699-a672-591630a9a269', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:56 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-fc4403fe-03bb-45ce-8324-1f956a7406db tempest-TestServerVolumeAttachmentScenario-797186756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d5ccaa4-45f7-4b89-a75c-ceb313c297d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:56 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-fc4403fe-03bb-45ce-8324-1f956a7406db tempest-TestServerVolumeAttachmentScenario-797186756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d5ccaa4-45f7-4b89-a75c-ceb313c297d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:56 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-fc4403fe-03bb-45ce-8324-1f956a7406db tempest-TestServerVolumeAttachmentScenario-797186756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd2816c3-bbd8-4099-a3fe-650ee15331bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:56 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-fc4403fe-03bb-45ce-8324-1f956a7406db tempest-TestServerVolumeAttachmentScenario-797186756 None] Volume fac22651-77ef-4699-a672-591630a9a269: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fac22651-77ef-4699-a672-591630a9a269', 'volume_size': 1} Nov 02 10:15:56 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-fc4403fe-03bb-45ce-8324-1f956a7406db tempest-TestServerVolumeAttachmentScenario-797186756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:15:56 devstack sudo[99399]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:56 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c9f5d601-c45b-47e9-ab4e-567334f76722 tempest-VolumesSnapshotListTestJSON-343657281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-05aa2d4b-4977-485f-a06e-3601696c34ec.7afa1736-cf71-4de9-bf28-b0bb50981c38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-05aa2d4b-4977-485f-a06e-3601696c34ec.71afcdb1-9abb-4968-a5b6-d7480017327f 1G" returned: 0 in 0.647s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:56 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c9f5d601-c45b-47e9-ab4e-567334f76722 tempest-VolumesSnapshotListTestJSON-343657281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05aa2d4b-4977-485f-a06e-3601696c34ec.7afa1736-cf71-4de9-bf28-b0bb50981c38 -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-05aa2d4b-4977-485f-a06e-3601696c34ec.71afcdb1-9abb-4968-a5b6-d7480017327f {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:56 devstack sudo[99406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05aa2d4b-4977-485f-a06e-3601696c34ec.7afa1736-cf71-4de9-bf28-b0bb50981c38 -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-05aa2d4b-4977-485f-a06e-3601696c34ec.71afcdb1-9abb-4968-a5b6-d7480017327f Nov 02 10:15:56 devstack sudo[99406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:56 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-b666f8ed-a5c0-4629-bdf2-9e2f2c258cad tempest-TestServerVolumeAttachmentScenario-797186756 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:15:56 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-b666f8ed-a5c0-4629-bdf2-9e2f2c258cad tempest-TestServerVolumeAttachmentScenario-797186756 None] Flow 'volume_create_manager' (dba9615b-9249-4f58-b2f8-3e3b8b61632d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:15:56 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-b666f8ed-a5c0-4629-bdf2-9e2f2c258cad tempest-TestServerVolumeAttachmentScenario-797186756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e655b4f-420e-4faa-884c-95c4fb294153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:57 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-b666f8ed-a5c0-4629-bdf2-9e2f2c258cad tempest-TestServerVolumeAttachmentScenario-797186756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e655b4f-420e-4faa-884c-95c4fb294153) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:15:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-956318660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0327f29c-175c-45da-ae49-cf93395c03c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5eceaf9b11e4b3daf7ce8fe128c281f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:15:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:15:57Z,use_quota=True,user_id='1dddf5c7bf6f45feb76d68b95f0134e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:57 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-b666f8ed-a5c0-4629-bdf2-9e2f2c258cad tempest-TestServerVolumeAttachmentScenario-797186756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (418cdf3f-9108-458a-b5c1-0a768d267c0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:57 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-b666f8ed-a5c0-4629-bdf2-9e2f2c258cad tempest-TestServerVolumeAttachmentScenario-797186756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (418cdf3f-9108-458a-b5c1-0a768d267c0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:57 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-b666f8ed-a5c0-4629-bdf2-9e2f2c258cad tempest-TestServerVolumeAttachmentScenario-797186756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ae0e945-9520-40f2-88d4-54d1c2a3ec66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:57 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-b666f8ed-a5c0-4629-bdf2-9e2f2c258cad tempest-TestServerVolumeAttachmentScenario-797186756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ae0e945-9520-40f2-88d4-54d1c2a3ec66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0327f29c-175c-45da-ae49-cf93395c03c7', 'volume_name': 'volume-0327f29c-175c-45da-ae49-cf93395c03c7', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:57 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-b666f8ed-a5c0-4629-bdf2-9e2f2c258cad tempest-TestServerVolumeAttachmentScenario-797186756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae40d073-7e0a-4a53-ac37-f3815d921deb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:57 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-b666f8ed-a5c0-4629-bdf2-9e2f2c258cad tempest-TestServerVolumeAttachmentScenario-797186756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae40d073-7e0a-4a53-ac37-f3815d921deb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:57 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-b666f8ed-a5c0-4629-bdf2-9e2f2c258cad tempest-TestServerVolumeAttachmentScenario-797186756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (beeea8a6-2269-45cc-9cdd-2d281bda0943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:57 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-b666f8ed-a5c0-4629-bdf2-9e2f2c258cad tempest-TestServerVolumeAttachmentScenario-797186756 None] Volume 0327f29c-175c-45da-ae49-cf93395c03c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0327f29c-175c-45da-ae49-cf93395c03c7', 'volume_size': 1} Nov 02 10:15:57 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-b666f8ed-a5c0-4629-bdf2-9e2f2c258cad tempest-TestServerVolumeAttachmentScenario-797186756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:15:57 devstack sudo[99406]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:57 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c9f5d601-c45b-47e9-ab4e-567334f76722 tempest-VolumesSnapshotListTestJSON-343657281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05aa2d4b-4977-485f-a06e-3601696c34ec.7afa1736-cf71-4de9-bf28-b0bb50981c38 -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-05aa2d4b-4977-485f-a06e-3601696c34ec.71afcdb1-9abb-4968-a5b6-d7480017327f" returned: 0 in 0.415s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:57 devstack cinder-volume[86890]: WARNING cinder.volume.drivers.remotefs [None req-c9f5d601-c45b-47e9-ab4e-567334f76722 tempest-VolumesSnapshotListTestJSON-343657281 None] /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-05aa2d4b-4977-485f-a06e-3601696c34ec.71afcdb1-9abb-4968-a5b6-d7480017327f is being set with open permissions: ugo+rw Nov 02 10:15:57 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c9f5d601-c45b-47e9-ab4e-567334f76722 tempest-VolumesSnapshotListTestJSON-343657281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-05aa2d4b-4977-485f-a06e-3601696c34ec.71afcdb1-9abb-4968-a5b6-d7480017327f {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:57 devstack sudo[99411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-05aa2d4b-4977-485f-a06e-3601696c34ec.71afcdb1-9abb-4968-a5b6-d7480017327f Nov 02 10:15:57 devstack sudo[99411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:57 devstack sudo[99411]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:57 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c9f5d601-c45b-47e9-ab4e-567334f76722 tempest-VolumesSnapshotListTestJSON-343657281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-05aa2d4b-4977-485f-a06e-3601696c34ec.71afcdb1-9abb-4968-a5b6-d7480017327f" returned: 0 in 0.279s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:57 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c9f5d601-c45b-47e9-ab4e-567334f76722 tempest-VolumesSnapshotListTestJSON-343657281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.972s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:15:57 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-fc4403fe-03bb-45ce-8324-1f956a7406db tempest-TestServerVolumeAttachmentScenario-797186756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.206s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:15:57 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-fc4403fe-03bb-45ce-8324-1f956a7406db tempest-TestServerVolumeAttachmentScenario-797186756 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:15:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-183594700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fac22651-77ef-4699-a672-591630a9a269,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5eceaf9b11e4b3daf7ce8fe128c281f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:15:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:15:56Z,use_quota=True,user_id='1dddf5c7bf6f45feb76d68b95f0134e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:15:57 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-fc4403fe-03bb-45ce-8324-1f956a7406db tempest-TestServerVolumeAttachmentScenario-797186756 None] Creating volume fac22651-77ef-4699-a672-591630a9a269 {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:15:57 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-fc4403fe-03bb-45ce-8324-1f956a7406db tempest-TestServerVolumeAttachmentScenario-797186756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:15:57 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-fc4403fe-03bb-45ce-8324-1f956a7406db tempest-TestServerVolumeAttachmentScenario-797186756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:15:57 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-fc4403fe-03bb-45ce-8324-1f956a7406db tempest-TestServerVolumeAttachmentScenario-797186756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:15:57 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-fc4403fe-03bb-45ce-8324-1f956a7406db tempest-TestServerVolumeAttachmentScenario-797186756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:15:57 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-fc4403fe-03bb-45ce-8324-1f956a7406db tempest-TestServerVolumeAttachmentScenario-797186756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:15:57 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-fc4403fe-03bb-45ce-8324-1f956a7406db tempest-TestServerVolumeAttachmentScenario-797186756 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:15:57 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-fc4403fe-03bb-45ce-8324-1f956a7406db tempest-TestServerVolumeAttachmentScenario-797186756 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:15:57 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-fc4403fe-03bb-45ce-8324-1f956a7406db tempest-TestServerVolumeAttachmentScenario-797186756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-fac22651-77ef-4699-a672-591630a9a269 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:57 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-c9f5d601-c45b-47e9-ab4e-567334f76722 tempest-VolumesSnapshotListTestJSON-343657281 None] Create snapshot completed successfully Nov 02 10:15:57 devstack sudo[99414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-fac22651-77ef-4699-a672-591630a9a269 1073741824 Nov 02 10:15:57 devstack sudo[99414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:58 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-8203a694-8095-4b19-a2a3-c7e359bac000 tempest-VolumesSnapshotListTestJSON-343657281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:15:58 devstack sudo[99414]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:58 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-fc4403fe-03bb-45ce-8324-1f956a7406db tempest-TestServerVolumeAttachmentScenario-797186756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-fac22651-77ef-4699-a672-591630a9a269 1073741824" returned: 0 in 0.659s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:58 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-fc4403fe-03bb-45ce-8324-1f956a7406db tempest-TestServerVolumeAttachmentScenario-797186756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-fac22651-77ef-4699-a672-591630a9a269 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:58 devstack sudo[99420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-fac22651-77ef-4699-a672-591630a9a269 Nov 02 10:15:58 devstack sudo[99420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:58 devstack sudo[99420]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:58 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-fc4403fe-03bb-45ce-8324-1f956a7406db tempest-TestServerVolumeAttachmentScenario-797186756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-fac22651-77ef-4699-a672-591630a9a269" returned: 0 in 0.268s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:58 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-fc4403fe-03bb-45ce-8324-1f956a7406db tempest-TestServerVolumeAttachmentScenario-797186756 None] <== create_volume: return (982ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:15:58 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-fc4403fe-03bb-45ce-8324-1f956a7406db tempest-TestServerVolumeAttachmentScenario-797186756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.986s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:15:58 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-b666f8ed-a5c0-4629-bdf2-9e2f2c258cad tempest-TestServerVolumeAttachmentScenario-797186756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.613s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:15:58 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-b666f8ed-a5c0-4629-bdf2-9e2f2c258cad tempest-TestServerVolumeAttachmentScenario-797186756 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:15:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-956318660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0327f29c-175c-45da-ae49-cf93395c03c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5eceaf9b11e4b3daf7ce8fe128c281f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:15:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:15:57Z,use_quota=True,user_id='1dddf5c7bf6f45feb76d68b95f0134e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:15:58 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-b666f8ed-a5c0-4629-bdf2-9e2f2c258cad tempest-TestServerVolumeAttachmentScenario-797186756 None] Creating volume 0327f29c-175c-45da-ae49-cf93395c03c7 {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:15:58 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-b666f8ed-a5c0-4629-bdf2-9e2f2c258cad tempest-TestServerVolumeAttachmentScenario-797186756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:15:58 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-b666f8ed-a5c0-4629-bdf2-9e2f2c258cad tempest-TestServerVolumeAttachmentScenario-797186756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:15:58 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-b666f8ed-a5c0-4629-bdf2-9e2f2c258cad tempest-TestServerVolumeAttachmentScenario-797186756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:15:58 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-b666f8ed-a5c0-4629-bdf2-9e2f2c258cad tempest-TestServerVolumeAttachmentScenario-797186756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:15:58 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-b666f8ed-a5c0-4629-bdf2-9e2f2c258cad tempest-TestServerVolumeAttachmentScenario-797186756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:15:58 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-b666f8ed-a5c0-4629-bdf2-9e2f2c258cad tempest-TestServerVolumeAttachmentScenario-797186756 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:15:58 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-b666f8ed-a5c0-4629-bdf2-9e2f2c258cad tempest-TestServerVolumeAttachmentScenario-797186756 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:15:58 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-b666f8ed-a5c0-4629-bdf2-9e2f2c258cad tempest-TestServerVolumeAttachmentScenario-797186756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-0327f29c-175c-45da-ae49-cf93395c03c7 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:58 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-fc4403fe-03bb-45ce-8324-1f956a7406db tempest-TestServerVolumeAttachmentScenario-797186756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd2816c3-bbd8-4099-a3fe-650ee15331bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fac22651-77ef-4699-a672-591630a9a269', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:58 devstack sudo[99423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-0327f29c-175c-45da-ae49-cf93395c03c7 1073741824 Nov 02 10:15:58 devstack sudo[99423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:58 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-fc4403fe-03bb-45ce-8324-1f956a7406db tempest-TestServerVolumeAttachmentScenario-797186756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a392d12-5cce-49bd-8e25-6e470e260e2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:58 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-fc4403fe-03bb-45ce-8324-1f956a7406db tempest-TestServerVolumeAttachmentScenario-797186756 None] Volume volume-fac22651-77ef-4699-a672-591630a9a269 (fac22651-77ef-4699-a672-591630a9a269): created successfully Nov 02 10:15:58 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-fc4403fe-03bb-45ce-8324-1f956a7406db tempest-TestServerVolumeAttachmentScenario-797186756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a392d12-5cce-49bd-8e25-6e470e260e2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:58 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-fc4403fe-03bb-45ce-8324-1f956a7406db tempest-TestServerVolumeAttachmentScenario-797186756 None] Flow 'volume_create_manager' (5166d73b-1d6a-4c9d-a1cb-95ffadfdc122) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:15:58 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-fc4403fe-03bb-45ce-8324-1f956a7406db tempest-TestServerVolumeAttachmentScenario-797186756 None] Created volume successfully. Nov 02 10:15:59 devstack sudo[99423]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:59 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-b666f8ed-a5c0-4629-bdf2-9e2f2c258cad tempest-TestServerVolumeAttachmentScenario-797186756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-0327f29c-175c-45da-ae49-cf93395c03c7 1073741824" returned: 0 in 0.580s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:59 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-b666f8ed-a5c0-4629-bdf2-9e2f2c258cad tempest-TestServerVolumeAttachmentScenario-797186756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-0327f29c-175c-45da-ae49-cf93395c03c7 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:59 devstack sudo[99429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-0327f29c-175c-45da-ae49-cf93395c03c7 Nov 02 10:15:59 devstack sudo[99429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:59 devstack sudo[99429]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:59 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-b666f8ed-a5c0-4629-bdf2-9e2f2c258cad tempest-TestServerVolumeAttachmentScenario-797186756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-0327f29c-175c-45da-ae49-cf93395c03c7" returned: 0 in 0.323s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:59 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-b666f8ed-a5c0-4629-bdf2-9e2f2c258cad tempest-TestServerVolumeAttachmentScenario-797186756 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:15:59 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-b666f8ed-a5c0-4629-bdf2-9e2f2c258cad tempest-TestServerVolumeAttachmentScenario-797186756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.977s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:15:59 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-8203a694-8095-4b19-a2a3-c7e359bac000 tempest-VolumesSnapshotListTestJSON-343657281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.505s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:15:59 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-b666f8ed-a5c0-4629-bdf2-9e2f2c258cad tempest-TestServerVolumeAttachmentScenario-797186756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (beeea8a6-2269-45cc-9cdd-2d281bda0943) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0327f29c-175c-45da-ae49-cf93395c03c7', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:59 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-b666f8ed-a5c0-4629-bdf2-9e2f2c258cad tempest-TestServerVolumeAttachmentScenario-797186756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6354d484-5c07-47cd-b49c-dffeba2747db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:59 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-8203a694-8095-4b19-a2a3-c7e359bac000 tempest-VolumesSnapshotListTestJSON-343657281 None] Creating offline snapshot ee98d54a-5851-4a62-ac65-9cc818d4c21c of volume 05aa2d4b-4977-485f-a06e-3601696c34ec {{(pid=86890) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:15:59 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-b666f8ed-a5c0-4629-bdf2-9e2f2c258cad tempest-TestServerVolumeAttachmentScenario-797186756 None] Volume volume-0327f29c-175c-45da-ae49-cf93395c03c7 (0327f29c-175c-45da-ae49-cf93395c03c7): created successfully Nov 02 10:15:59 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-b666f8ed-a5c0-4629-bdf2-9e2f2c258cad tempest-TestServerVolumeAttachmentScenario-797186756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6354d484-5c07-47cd-b49c-dffeba2747db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:59 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-b666f8ed-a5c0-4629-bdf2-9e2f2c258cad tempest-TestServerVolumeAttachmentScenario-797186756 None] Flow 'volume_create_manager' (dba9615b-9249-4f58-b2f8-3e3b8b61632d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:15:59 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7336c54-e703-43cc-b7f3-7501987c903b]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:15:59 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8203a694-8095-4b19-a2a3-c7e359bac000 tempest-VolumesSnapshotListTestJSON-343657281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-05aa2d4b-4977-485f-a06e-3601696c34ec.71afcdb1-9abb-4968-a5b6-d7480017327f {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:59 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-b666f8ed-a5c0-4629-bdf2-9e2f2c258cad tempest-TestServerVolumeAttachmentScenario-797186756 None] Created volume successfully. Nov 02 10:15:59 devstack sudo[99432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-05aa2d4b-4977-485f-a06e-3601696c34ec.71afcdb1-9abb-4968-a5b6-d7480017327f Nov 02 10:15:59 devstack sudo[99432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:00 devstack sudo[99432]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:00 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8203a694-8095-4b19-a2a3-c7e359bac000 tempest-VolumesSnapshotListTestJSON-343657281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-05aa2d4b-4977-485f-a06e-3601696c34ec.71afcdb1-9abb-4968-a5b6-d7480017327f" returned: 0 in 0.449s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:00 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-8203a694-8095-4b19-a2a3-c7e359bac000 tempest-VolumesSnapshotListTestJSON-343657281 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-05aa2d4b-4977-485f-a06e-3601696c34ec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86890) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:16:00 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8203a694-8095-4b19-a2a3-c7e359bac000 tempest-VolumesSnapshotListTestJSON-343657281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-05aa2d4b-4977-485f-a06e-3601696c34ec.71afcdb1-9abb-4968-a5b6-d7480017327f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-05aa2d4b-4977-485f-a06e-3601696c34ec.ee98d54a-5851-4a62-ac65-9cc818d4c21c 1G {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:00 devstack sudo[99438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-05aa2d4b-4977-485f-a06e-3601696c34ec.71afcdb1-9abb-4968-a5b6-d7480017327f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-05aa2d4b-4977-485f-a06e-3601696c34ec.ee98d54a-5851-4a62-ac65-9cc818d4c21c 1G Nov 02 10:16:00 devstack sudo[99438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:00 devstack sudo[99438]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:00 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8203a694-8095-4b19-a2a3-c7e359bac000 tempest-VolumesSnapshotListTestJSON-343657281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-05aa2d4b-4977-485f-a06e-3601696c34ec.71afcdb1-9abb-4968-a5b6-d7480017327f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-05aa2d4b-4977-485f-a06e-3601696c34ec.ee98d54a-5851-4a62-ac65-9cc818d4c21c 1G" returned: 0 in 0.696s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:00 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8203a694-8095-4b19-a2a3-c7e359bac000 tempest-VolumesSnapshotListTestJSON-343657281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05aa2d4b-4977-485f-a06e-3601696c34ec.71afcdb1-9abb-4968-a5b6-d7480017327f -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-05aa2d4b-4977-485f-a06e-3601696c34ec.ee98d54a-5851-4a62-ac65-9cc818d4c21c {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:00 devstack sudo[99447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05aa2d4b-4977-485f-a06e-3601696c34ec.71afcdb1-9abb-4968-a5b6-d7480017327f -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-05aa2d4b-4977-485f-a06e-3601696c34ec.ee98d54a-5851-4a62-ac65-9cc818d4c21c Nov 02 10:16:00 devstack sudo[99447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:01 devstack sudo[99447]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:01 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8203a694-8095-4b19-a2a3-c7e359bac000 tempest-VolumesSnapshotListTestJSON-343657281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05aa2d4b-4977-485f-a06e-3601696c34ec.71afcdb1-9abb-4968-a5b6-d7480017327f -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-05aa2d4b-4977-485f-a06e-3601696c34ec.ee98d54a-5851-4a62-ac65-9cc818d4c21c" returned: 0 in 0.370s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:01 devstack cinder-volume[86890]: WARNING cinder.volume.drivers.remotefs [None req-8203a694-8095-4b19-a2a3-c7e359bac000 tempest-VolumesSnapshotListTestJSON-343657281 None] /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-05aa2d4b-4977-485f-a06e-3601696c34ec.ee98d54a-5851-4a62-ac65-9cc818d4c21c is being set with open permissions: ugo+rw Nov 02 10:16:01 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8203a694-8095-4b19-a2a3-c7e359bac000 tempest-VolumesSnapshotListTestJSON-343657281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-05aa2d4b-4977-485f-a06e-3601696c34ec.ee98d54a-5851-4a62-ac65-9cc818d4c21c {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:01 devstack sudo[99452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-05aa2d4b-4977-485f-a06e-3601696c34ec.ee98d54a-5851-4a62-ac65-9cc818d4c21c Nov 02 10:16:01 devstack sudo[99452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:01 devstack sudo[99452]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:01 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8203a694-8095-4b19-a2a3-c7e359bac000 tempest-VolumesSnapshotListTestJSON-343657281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-05aa2d4b-4977-485f-a06e-3601696c34ec.ee98d54a-5851-4a62-ac65-9cc818d4c21c" returned: 0 in 0.282s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:01 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-8203a694-8095-4b19-a2a3-c7e359bac000 tempest-VolumesSnapshotListTestJSON-343657281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.981s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:16:01 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-8203a694-8095-4b19-a2a3-c7e359bac000 tempest-VolumesSnapshotListTestJSON-343657281 None] Create snapshot completed successfully Nov 02 10:16:03 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-3bed4557-eb32-4822-b986-334e07e8a304 tempest-VolumesSnapshotListTestJSON-343657281 None] Acquiring lock "cinder-ee98d54a-5851-4a62-ac65-9cc818d4c21c-delete_snapshot" by "delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:16:03 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-3bed4557-eb32-4822-b986-334e07e8a304 tempest-VolumesSnapshotListTestJSON-343657281 None] Lock "cinder-ee98d54a-5851-4a62-ac65-9cc818d4c21c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:16:03 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-3bed4557-eb32-4822-b986-334e07e8a304 tempest-VolumesSnapshotListTestJSON-343657281 None] Acquiring lock "cinder-quobyte-05aa2d4b-4977-485f-a06e-3601696c34ec" by "delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:16:03 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-3bed4557-eb32-4822-b986-334e07e8a304 tempest-VolumesSnapshotListTestJSON-343657281 None] Lock "cinder-quobyte-05aa2d4b-4977-485f-a06e-3601696c34ec" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:16:03 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-3bed4557-eb32-4822-b986-334e07e8a304 tempest-VolumesSnapshotListTestJSON-343657281 None] Acquiring lock "cinder-quobyte-ee98d54a-5851-4a62-ac65-9cc818d4c21c" by "_delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:16:03 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-3bed4557-eb32-4822-b986-334e07e8a304 tempest-VolumesSnapshotListTestJSON-343657281 None] Lock "cinder-quobyte-ee98d54a-5851-4a62-ac65-9cc818d4c21c" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:16:03 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-3bed4557-eb32-4822-b986-334e07e8a304 tempest-VolumesSnapshotListTestJSON-343657281 None] Deleting offline snapshot ee98d54a-5851-4a62-ac65-9cc818d4c21c of volume 05aa2d4b-4977-485f-a06e-3601696c34ec {{(pid=86890) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:16:03 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-3bed4557-eb32-4822-b986-334e07e8a304 tempest-VolumesSnapshotListTestJSON-343657281 None] snapshot_file for this snap is: volume-05aa2d4b-4977-485f-a06e-3601696c34ec.ee98d54a-5851-4a62-ac65-9cc818d4c21c {{(pid=86890) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:16:03 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8e805e2-c4f6-4883-957a-d73fe50cdf4c]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:16:03 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-3bed4557-eb32-4822-b986-334e07e8a304 tempest-VolumesSnapshotListTestJSON-343657281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-05aa2d4b-4977-485f-a06e-3601696c34ec.ee98d54a-5851-4a62-ac65-9cc818d4c21c {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:03 devstack sudo[99472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-05aa2d4b-4977-485f-a06e-3601696c34ec.ee98d54a-5851-4a62-ac65-9cc818d4c21c Nov 02 10:16:03 devstack sudo[99472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:04 devstack sudo[99472]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:04 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-3bed4557-eb32-4822-b986-334e07e8a304 tempest-VolumesSnapshotListTestJSON-343657281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-05aa2d4b-4977-485f-a06e-3601696c34ec.ee98d54a-5851-4a62-ac65-9cc818d4c21c" returned: 0 in 0.502s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:04 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-3bed4557-eb32-4822-b986-334e07e8a304 tempest-VolumesSnapshotListTestJSON-343657281 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-05aa2d4b-4977-485f-a06e-3601696c34ec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86890) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:16:04 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c1f21fe-bfbc-4344-b058-b56044a11fa3]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:16:04 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-3bed4557-eb32-4822-b986-334e07e8a304 tempest-VolumesSnapshotListTestJSON-343657281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-05aa2d4b-4977-485f-a06e-3601696c34ec.71afcdb1-9abb-4968-a5b6-d7480017327f {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:04 devstack sudo[99477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-05aa2d4b-4977-485f-a06e-3601696c34ec.71afcdb1-9abb-4968-a5b6-d7480017327f Nov 02 10:16:04 devstack sudo[99477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:04 devstack sudo[99477]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:04 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-3bed4557-eb32-4822-b986-334e07e8a304 tempest-VolumesSnapshotListTestJSON-343657281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-05aa2d4b-4977-485f-a06e-3601696c34ec.71afcdb1-9abb-4968-a5b6-d7480017327f" returned: 0 in 0.488s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:04 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-3bed4557-eb32-4822-b986-334e07e8a304 tempest-VolumesSnapshotListTestJSON-343657281 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-05aa2d4b-4977-485f-a06e-3601696c34ec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86890) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:16:04 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-3bed4557-eb32-4822-b986-334e07e8a304 tempest-VolumesSnapshotListTestJSON-343657281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-05aa2d4b-4977-485f-a06e-3601696c34ec.ee98d54a-5851-4a62-ac65-9cc818d4c21c {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:04 devstack sudo[99483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-05aa2d4b-4977-485f-a06e-3601696c34ec.ee98d54a-5851-4a62-ac65-9cc818d4c21c Nov 02 10:16:04 devstack sudo[99483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:05 devstack sudo[99483]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:05 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-3bed4557-eb32-4822-b986-334e07e8a304 tempest-VolumesSnapshotListTestJSON-343657281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-05aa2d4b-4977-485f-a06e-3601696c34ec.ee98d54a-5851-4a62-ac65-9cc818d4c21c" returned: 0 in 0.585s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:05 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-3bed4557-eb32-4822-b986-334e07e8a304 tempest-VolumesSnapshotListTestJSON-343657281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-05aa2d4b-4977-485f-a06e-3601696c34ec.ee98d54a-5851-4a62-ac65-9cc818d4c21c {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:05 devstack sudo[99489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-05aa2d4b-4977-485f-a06e-3601696c34ec.ee98d54a-5851-4a62-ac65-9cc818d4c21c Nov 02 10:16:05 devstack sudo[99489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:05 devstack sudo[99489]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:05 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-3bed4557-eb32-4822-b986-334e07e8a304 tempest-VolumesSnapshotListTestJSON-343657281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-05aa2d4b-4977-485f-a06e-3601696c34ec.ee98d54a-5851-4a62-ac65-9cc818d4c21c" returned: 0 in 0.359s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:05 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-3bed4557-eb32-4822-b986-334e07e8a304 tempest-VolumesSnapshotListTestJSON-343657281 None] Lock "cinder-quobyte-ee98d54a-5851-4a62-ac65-9cc818d4c21c" released by "_delete_snapshot" :: held 2.074s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:16:05 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-3bed4557-eb32-4822-b986-334e07e8a304 tempest-VolumesSnapshotListTestJSON-343657281 None] Lock "cinder-quobyte-05aa2d4b-4977-485f-a06e-3601696c34ec" released by "delete_snapshot" :: held 2.104s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:16:05 devstack cinder-volume[86890]: DEBUG dbcounter [-] [86890] Writing DB stats cinder:INSERT=49,cinder:UPDATE=157,cinder:DELETE=17,cinder:SELECT=116 {{(pid=86890) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:16:05 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-3bed4557-eb32-4822-b986-334e07e8a304 tempest-VolumesSnapshotListTestJSON-343657281 None] Created reservations ['5c2fd1c7-2195-462e-b815-929602a30361', '9393cdc0-2f34-4b05-b11b-bcc951e16321', 'dfb13421-8e4b-4d6d-b786-f6bed3ed349d', '66536975-46aa-4b85-8b1a-705afaeffc39'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:16:05 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-3bed4557-eb32-4822-b986-334e07e8a304 tempest-VolumesSnapshotListTestJSON-343657281 None] Delete snapshot completed successfully. Nov 02 10:16:06 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-3bed4557-eb32-4822-b986-334e07e8a304 tempest-VolumesSnapshotListTestJSON-343657281 None] Lock "cinder-ee98d54a-5851-4a62-ac65-9cc818d4c21c-delete_snapshot" released by "delete_snapshot" :: held 2.342s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:16:06 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-af603529-97cd-45c6-985e-27db66b8b557 tempest-VolumesSnapshotListTestJSON-343657281 None] Acquiring lock "cinder-71afcdb1-9abb-4968-a5b6-d7480017327f-delete_snapshot" by "delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:16:06 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-af603529-97cd-45c6-985e-27db66b8b557 tempest-VolumesSnapshotListTestJSON-343657281 None] Lock "cinder-71afcdb1-9abb-4968-a5b6-d7480017327f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:16:06 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-af603529-97cd-45c6-985e-27db66b8b557 tempest-VolumesSnapshotListTestJSON-343657281 None] Acquiring lock "cinder-quobyte-05aa2d4b-4977-485f-a06e-3601696c34ec" by "delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:16:06 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-af603529-97cd-45c6-985e-27db66b8b557 tempest-VolumesSnapshotListTestJSON-343657281 None] Lock "cinder-quobyte-05aa2d4b-4977-485f-a06e-3601696c34ec" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:16:06 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-af603529-97cd-45c6-985e-27db66b8b557 tempest-VolumesSnapshotListTestJSON-343657281 None] Acquiring lock "cinder-quobyte-71afcdb1-9abb-4968-a5b6-d7480017327f" by "_delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:16:06 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-af603529-97cd-45c6-985e-27db66b8b557 tempest-VolumesSnapshotListTestJSON-343657281 None] Lock "cinder-quobyte-71afcdb1-9abb-4968-a5b6-d7480017327f" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:16:06 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-af603529-97cd-45c6-985e-27db66b8b557 tempest-VolumesSnapshotListTestJSON-343657281 None] Deleting offline snapshot 71afcdb1-9abb-4968-a5b6-d7480017327f of volume 05aa2d4b-4977-485f-a06e-3601696c34ec {{(pid=86890) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:16:07 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-af603529-97cd-45c6-985e-27db66b8b557 tempest-VolumesSnapshotListTestJSON-343657281 None] snapshot_file for this snap is: volume-05aa2d4b-4977-485f-a06e-3601696c34ec.71afcdb1-9abb-4968-a5b6-d7480017327f {{(pid=86890) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:16:07 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[84fb27ce-beac-4717-b5b6-7a9ac1780dbd]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:16:07 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-af603529-97cd-45c6-985e-27db66b8b557 tempest-VolumesSnapshotListTestJSON-343657281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-05aa2d4b-4977-485f-a06e-3601696c34ec.71afcdb1-9abb-4968-a5b6-d7480017327f {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:07 devstack sudo[99494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-05aa2d4b-4977-485f-a06e-3601696c34ec.71afcdb1-9abb-4968-a5b6-d7480017327f Nov 02 10:16:07 devstack sudo[99494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:07 devstack sudo[99494]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:07 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-af603529-97cd-45c6-985e-27db66b8b557 tempest-VolumesSnapshotListTestJSON-343657281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-05aa2d4b-4977-485f-a06e-3601696c34ec.71afcdb1-9abb-4968-a5b6-d7480017327f" returned: 0 in 0.498s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:07 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-af603529-97cd-45c6-985e-27db66b8b557 tempest-VolumesSnapshotListTestJSON-343657281 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-05aa2d4b-4977-485f-a06e-3601696c34ec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86890) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:16:07 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dc9ac1c-d5e7-4cc9-9120-3c5d82af9c86]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:16:07 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-af603529-97cd-45c6-985e-27db66b8b557 tempest-VolumesSnapshotListTestJSON-343657281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-05aa2d4b-4977-485f-a06e-3601696c34ec.7afa1736-cf71-4de9-bf28-b0bb50981c38 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:07 devstack sudo[99499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-05aa2d4b-4977-485f-a06e-3601696c34ec.7afa1736-cf71-4de9-bf28-b0bb50981c38 Nov 02 10:16:07 devstack sudo[99499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:08 devstack sudo[99499]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:08 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-af603529-97cd-45c6-985e-27db66b8b557 tempest-VolumesSnapshotListTestJSON-343657281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-05aa2d4b-4977-485f-a06e-3601696c34ec.7afa1736-cf71-4de9-bf28-b0bb50981c38" returned: 0 in 0.704s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:08 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-af603529-97cd-45c6-985e-27db66b8b557 tempest-VolumesSnapshotListTestJSON-343657281 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-05aa2d4b-4977-485f-a06e-3601696c34ec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86890) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:16:08 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-af603529-97cd-45c6-985e-27db66b8b557 tempest-VolumesSnapshotListTestJSON-343657281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-05aa2d4b-4977-485f-a06e-3601696c34ec.71afcdb1-9abb-4968-a5b6-d7480017327f {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:08 devstack sudo[99520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-05aa2d4b-4977-485f-a06e-3601696c34ec.71afcdb1-9abb-4968-a5b6-d7480017327f Nov 02 10:16:08 devstack sudo[99520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:09 devstack sudo[99520]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:09 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-af603529-97cd-45c6-985e-27db66b8b557 tempest-VolumesSnapshotListTestJSON-343657281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-05aa2d4b-4977-485f-a06e-3601696c34ec.71afcdb1-9abb-4968-a5b6-d7480017327f" returned: 0 in 0.869s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:09 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-af603529-97cd-45c6-985e-27db66b8b557 tempest-VolumesSnapshotListTestJSON-343657281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-05aa2d4b-4977-485f-a06e-3601696c34ec.71afcdb1-9abb-4968-a5b6-d7480017327f {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:09 devstack sudo[99574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-05aa2d4b-4977-485f-a06e-3601696c34ec.71afcdb1-9abb-4968-a5b6-d7480017327f Nov 02 10:16:09 devstack sudo[99574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:09 devstack sudo[99574]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:09 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-af603529-97cd-45c6-985e-27db66b8b557 tempest-VolumesSnapshotListTestJSON-343657281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-05aa2d4b-4977-485f-a06e-3601696c34ec.71afcdb1-9abb-4968-a5b6-d7480017327f" returned: 0 in 0.453s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:09 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-af603529-97cd-45c6-985e-27db66b8b557 tempest-VolumesSnapshotListTestJSON-343657281 None] Lock "cinder-quobyte-71afcdb1-9abb-4968-a5b6-d7480017327f" released by "_delete_snapshot" :: held 2.703s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:16:09 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-af603529-97cd-45c6-985e-27db66b8b557 tempest-VolumesSnapshotListTestJSON-343657281 None] Lock "cinder-quobyte-05aa2d4b-4977-485f-a06e-3601696c34ec" released by "delete_snapshot" :: held 2.742s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:16:09 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3349306-d9a3-4d07-bd5f-9e15b93f9175 tempest-VolumesSnapshotTestJSON-1952456970 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:16:09 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-f3349306-d9a3-4d07-bd5f-9e15b93f9175 tempest-VolumesSnapshotTestJSON-1952456970 None] Flow 'volume_create_manager' (1b9d63b7-a4ad-47e0-947a-bc0522cc0194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:16:09 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-f3349306-d9a3-4d07-bd5f-9e15b93f9175 tempest-VolumesSnapshotTestJSON-1952456970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7e01040-d572-477a-89ba-48f17b7ff5b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:09 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-f3349306-d9a3-4d07-bd5f-9e15b93f9175 tempest-VolumesSnapshotTestJSON-1952456970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7e01040-d572-477a-89ba-48f17b7ff5b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:16:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1634721713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=301f95fb-4d6d-45a0-af53-1e46222ea8dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f0cc30a11e44c8294d8872570bdc5f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:16:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:16:10Z,use_quota=True,user_id='959cfb1854eb4418aa6d558022bda4ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:09 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-f3349306-d9a3-4d07-bd5f-9e15b93f9175 tempest-VolumesSnapshotTestJSON-1952456970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51e1144a-52c5-422a-acc5-8c9ec379fd69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:09 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-f3349306-d9a3-4d07-bd5f-9e15b93f9175 tempest-VolumesSnapshotTestJSON-1952456970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51e1144a-52c5-422a-acc5-8c9ec379fd69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:09 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-f3349306-d9a3-4d07-bd5f-9e15b93f9175 tempest-VolumesSnapshotTestJSON-1952456970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (287036b5-e6c9-413d-a60b-34a2ad69787a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:09 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-f3349306-d9a3-4d07-bd5f-9e15b93f9175 tempest-VolumesSnapshotTestJSON-1952456970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (287036b5-e6c9-413d-a60b-34a2ad69787a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '301f95fb-4d6d-45a0-af53-1e46222ea8dd', 'volume_name': 'volume-301f95fb-4d6d-45a0-af53-1e46222ea8dd', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:09 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-f3349306-d9a3-4d07-bd5f-9e15b93f9175 tempest-VolumesSnapshotTestJSON-1952456970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8469ddc-281b-4ab3-8538-b7df3a122ca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:09 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-f3349306-d9a3-4d07-bd5f-9e15b93f9175 tempest-VolumesSnapshotTestJSON-1952456970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8469ddc-281b-4ab3-8538-b7df3a122ca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:09 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-f3349306-d9a3-4d07-bd5f-9e15b93f9175 tempest-VolumesSnapshotTestJSON-1952456970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79796200-ddd2-4389-84fa-cacc9a64bb50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:09 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-f3349306-d9a3-4d07-bd5f-9e15b93f9175 tempest-VolumesSnapshotTestJSON-1952456970 None] Volume 301f95fb-4d6d-45a0-af53-1e46222ea8dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-301f95fb-4d6d-45a0-af53-1e46222ea8dd', 'volume_size': 1} Nov 02 10:16:09 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-f3349306-d9a3-4d07-bd5f-9e15b93f9175 tempest-VolumesSnapshotTestJSON-1952456970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:16:09 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-f3349306-d9a3-4d07-bd5f-9e15b93f9175 tempest-VolumesSnapshotTestJSON-1952456970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:16:09 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-f3349306-d9a3-4d07-bd5f-9e15b93f9175 tempest-VolumesSnapshotTestJSON-1952456970 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:16:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1634721713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=301f95fb-4d6d-45a0-af53-1e46222ea8dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f0cc30a11e44c8294d8872570bdc5f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:16:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:16:10Z,use_quota=True,user_id='959cfb1854eb4418aa6d558022bda4ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:16:09 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-f3349306-d9a3-4d07-bd5f-9e15b93f9175 tempest-VolumesSnapshotTestJSON-1952456970 None] Creating volume 301f95fb-4d6d-45a0-af53-1e46222ea8dd {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:16:09 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-f3349306-d9a3-4d07-bd5f-9e15b93f9175 tempest-VolumesSnapshotTestJSON-1952456970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:16:09 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-f3349306-d9a3-4d07-bd5f-9e15b93f9175 tempest-VolumesSnapshotTestJSON-1952456970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:16:09 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-f3349306-d9a3-4d07-bd5f-9e15b93f9175 tempest-VolumesSnapshotTestJSON-1952456970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:16:09 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-f3349306-d9a3-4d07-bd5f-9e15b93f9175 tempest-VolumesSnapshotTestJSON-1952456970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:16:09 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-f3349306-d9a3-4d07-bd5f-9e15b93f9175 tempest-VolumesSnapshotTestJSON-1952456970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:16:09 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-f3349306-d9a3-4d07-bd5f-9e15b93f9175 tempest-VolumesSnapshotTestJSON-1952456970 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:16:09 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-f3349306-d9a3-4d07-bd5f-9e15b93f9175 tempest-VolumesSnapshotTestJSON-1952456970 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:16:09 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-f3349306-d9a3-4d07-bd5f-9e15b93f9175 tempest-VolumesSnapshotTestJSON-1952456970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-301f95fb-4d6d-45a0-af53-1e46222ea8dd 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:09 devstack sudo[99580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-301f95fb-4d6d-45a0-af53-1e46222ea8dd 1073741824 Nov 02 10:16:09 devstack sudo[99580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:09 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-af603529-97cd-45c6-985e-27db66b8b557 tempest-VolumesSnapshotListTestJSON-343657281 None] Created reservations ['fffd87d7-f38d-4674-aca7-728eec5806c8', '1196f8af-92fb-4ea6-81de-40ec2daa3e2b', 'e1bdfe6f-9d6e-43b3-aaaf-04921eb619dc', '03345b03-9faf-4316-9479-c271327721f4'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:16:10 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-af603529-97cd-45c6-985e-27db66b8b557 tempest-VolumesSnapshotListTestJSON-343657281 None] Delete snapshot completed successfully. Nov 02 10:16:10 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-af603529-97cd-45c6-985e-27db66b8b557 tempest-VolumesSnapshotListTestJSON-343657281 None] Lock "cinder-71afcdb1-9abb-4968-a5b6-d7480017327f-delete_snapshot" released by "delete_snapshot" :: held 3.090s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:16:10 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-e67e2186-15e1-4ad5-9e5b-704b849c2f06 tempest-VolumesSnapshotListTestJSON-343657281 None] Acquiring lock "cinder-7afa1736-cf71-4de9-bf28-b0bb50981c38-delete_snapshot" by "delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:16:10 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-e67e2186-15e1-4ad5-9e5b-704b849c2f06 tempest-VolumesSnapshotListTestJSON-343657281 None] Lock "cinder-7afa1736-cf71-4de9-bf28-b0bb50981c38-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:16:10 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-e67e2186-15e1-4ad5-9e5b-704b849c2f06 tempest-VolumesSnapshotListTestJSON-343657281 None] Acquiring lock "cinder-quobyte-05aa2d4b-4977-485f-a06e-3601696c34ec" by "delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:16:10 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-e67e2186-15e1-4ad5-9e5b-704b849c2f06 tempest-VolumesSnapshotListTestJSON-343657281 None] Lock "cinder-quobyte-05aa2d4b-4977-485f-a06e-3601696c34ec" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:16:10 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-e67e2186-15e1-4ad5-9e5b-704b849c2f06 tempest-VolumesSnapshotListTestJSON-343657281 None] Acquiring lock "cinder-quobyte-7afa1736-cf71-4de9-bf28-b0bb50981c38" by "_delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:16:10 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-e67e2186-15e1-4ad5-9e5b-704b849c2f06 tempest-VolumesSnapshotListTestJSON-343657281 None] Lock "cinder-quobyte-7afa1736-cf71-4de9-bf28-b0bb50981c38" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:16:10 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-e67e2186-15e1-4ad5-9e5b-704b849c2f06 tempest-VolumesSnapshotListTestJSON-343657281 None] Deleting offline snapshot 7afa1736-cf71-4de9-bf28-b0bb50981c38 of volume 05aa2d4b-4977-485f-a06e-3601696c34ec {{(pid=86890) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:16:10 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-e67e2186-15e1-4ad5-9e5b-704b849c2f06 tempest-VolumesSnapshotListTestJSON-343657281 None] snapshot_file for this snap is: volume-05aa2d4b-4977-485f-a06e-3601696c34ec.7afa1736-cf71-4de9-bf28-b0bb50981c38 {{(pid=86890) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:16:10 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d442e80-1fc7-4a01-9051-91ba83b76039]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:16:10 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-e67e2186-15e1-4ad5-9e5b-704b849c2f06 tempest-VolumesSnapshotListTestJSON-343657281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-05aa2d4b-4977-485f-a06e-3601696c34ec.7afa1736-cf71-4de9-bf28-b0bb50981c38 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:10 devstack sudo[99585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-05aa2d4b-4977-485f-a06e-3601696c34ec.7afa1736-cf71-4de9-bf28-b0bb50981c38 Nov 02 10:16:10 devstack sudo[99585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:10 devstack sudo[99580]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:10 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-f3349306-d9a3-4d07-bd5f-9e15b93f9175 tempest-VolumesSnapshotTestJSON-1952456970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-301f95fb-4d6d-45a0-af53-1e46222ea8dd 1073741824" returned: 0 in 0.783s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:10 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-f3349306-d9a3-4d07-bd5f-9e15b93f9175 tempest-VolumesSnapshotTestJSON-1952456970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-301f95fb-4d6d-45a0-af53-1e46222ea8dd {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:10 devstack sudo[99590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-301f95fb-4d6d-45a0-af53-1e46222ea8dd Nov 02 10:16:10 devstack sudo[99590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:10 devstack sudo[99585]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:10 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-e67e2186-15e1-4ad5-9e5b-704b849c2f06 tempest-VolumesSnapshotListTestJSON-343657281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-05aa2d4b-4977-485f-a06e-3601696c34ec.7afa1736-cf71-4de9-bf28-b0bb50981c38" returned: 0 in 0.619s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:10 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-e67e2186-15e1-4ad5-9e5b-704b849c2f06 tempest-VolumesSnapshotListTestJSON-343657281 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-05aa2d4b-4977-485f-a06e-3601696c34ec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86890) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:16:10 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0967887-bb30-4500-8c05-5d462097bb2b]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:16:10 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-e67e2186-15e1-4ad5-9e5b-704b849c2f06 tempest-VolumesSnapshotListTestJSON-343657281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-05aa2d4b-4977-485f-a06e-3601696c34ec {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:11 devstack sudo[99595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-05aa2d4b-4977-485f-a06e-3601696c34ec Nov 02 10:16:11 devstack sudo[99595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:11 devstack sudo[99590]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:11 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-f3349306-d9a3-4d07-bd5f-9e15b93f9175 tempest-VolumesSnapshotTestJSON-1952456970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-301f95fb-4d6d-45a0-af53-1e46222ea8dd" returned: 0 in 0.417s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:11 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-f3349306-d9a3-4d07-bd5f-9e15b93f9175 tempest-VolumesSnapshotTestJSON-1952456970 None] <== create_volume: return (1284ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:16:11 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-f3349306-d9a3-4d07-bd5f-9e15b93f9175 tempest-VolumesSnapshotTestJSON-1952456970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.286s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:16:11 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-f3349306-d9a3-4d07-bd5f-9e15b93f9175 tempest-VolumesSnapshotTestJSON-1952456970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79796200-ddd2-4389-84fa-cacc9a64bb50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-301f95fb-4d6d-45a0-af53-1e46222ea8dd', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:11 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-f3349306-d9a3-4d07-bd5f-9e15b93f9175 tempest-VolumesSnapshotTestJSON-1952456970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae9162fe-14f0-4973-87f9-3f39bc352bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:11 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-f3349306-d9a3-4d07-bd5f-9e15b93f9175 tempest-VolumesSnapshotTestJSON-1952456970 None] Volume volume-301f95fb-4d6d-45a0-af53-1e46222ea8dd (301f95fb-4d6d-45a0-af53-1e46222ea8dd): created successfully Nov 02 10:16:11 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-f3349306-d9a3-4d07-bd5f-9e15b93f9175 tempest-VolumesSnapshotTestJSON-1952456970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae9162fe-14f0-4973-87f9-3f39bc352bd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:11 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-f3349306-d9a3-4d07-bd5f-9e15b93f9175 tempest-VolumesSnapshotTestJSON-1952456970 None] Flow 'volume_create_manager' (1b9d63b7-a4ad-47e0-947a-bc0522cc0194) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:16:11 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-f3349306-d9a3-4d07-bd5f-9e15b93f9175 tempest-VolumesSnapshotTestJSON-1952456970 None] Created volume successfully. Nov 02 10:16:11 devstack sudo[99595]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:11 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-e67e2186-15e1-4ad5-9e5b-704b849c2f06 tempest-VolumesSnapshotListTestJSON-343657281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-05aa2d4b-4977-485f-a06e-3601696c34ec" returned: 0 in 0.444s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:11 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-e67e2186-15e1-4ad5-9e5b-704b849c2f06 tempest-VolumesSnapshotListTestJSON-343657281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-05aa2d4b-4977-485f-a06e-3601696c34ec.7afa1736-cf71-4de9-bf28-b0bb50981c38 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:11 devstack sudo[99601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-05aa2d4b-4977-485f-a06e-3601696c34ec.7afa1736-cf71-4de9-bf28-b0bb50981c38 Nov 02 10:16:11 devstack sudo[99601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:11 devstack sudo[99601]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:11 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-e67e2186-15e1-4ad5-9e5b-704b849c2f06 tempest-VolumesSnapshotListTestJSON-343657281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-05aa2d4b-4977-485f-a06e-3601696c34ec.7afa1736-cf71-4de9-bf28-b0bb50981c38" returned: 0 in 0.413s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:11 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-e67e2186-15e1-4ad5-9e5b-704b849c2f06 tempest-VolumesSnapshotListTestJSON-343657281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-05aa2d4b-4977-485f-a06e-3601696c34ec.7afa1736-cf71-4de9-bf28-b0bb50981c38 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:11 devstack sudo[99607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-05aa2d4b-4977-485f-a06e-3601696c34ec.7afa1736-cf71-4de9-bf28-b0bb50981c38 Nov 02 10:16:11 devstack sudo[99607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:12 devstack sudo[99607]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:12 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-e67e2186-15e1-4ad5-9e5b-704b849c2f06 tempest-VolumesSnapshotListTestJSON-343657281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-05aa2d4b-4977-485f-a06e-3601696c34ec.7afa1736-cf71-4de9-bf28-b0bb50981c38" returned: 0 in 0.349s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:12 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-e67e2186-15e1-4ad5-9e5b-704b849c2f06 tempest-VolumesSnapshotListTestJSON-343657281 None] Lock "cinder-quobyte-7afa1736-cf71-4de9-bf28-b0bb50981c38" released by "_delete_snapshot" :: held 2.011s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:16:12 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-e67e2186-15e1-4ad5-9e5b-704b849c2f06 tempest-VolumesSnapshotListTestJSON-343657281 None] Lock "cinder-quobyte-05aa2d4b-4977-485f-a06e-3601696c34ec" released by "delete_snapshot" :: held 2.045s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:16:12 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-a5e329ef-cc98-454e-ae2a-3655fc1a9a14 tempest-VolumesSnapshotTestJSON-1952456970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:16:12 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-a5e329ef-cc98-454e-ae2a-3655fc1a9a14 tempest-VolumesSnapshotTestJSON-1952456970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:16:12 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-a5e329ef-cc98-454e-ae2a-3655fc1a9a14 tempest-VolumesSnapshotTestJSON-1952456970 None] Creating offline snapshot 057857e7-c94f-45a6-900e-0d12dda44d33 of volume 301f95fb-4d6d-45a0-af53-1e46222ea8dd {{(pid=86890) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:16:12 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[16ff04bc-f852-4899-bc14-d9cbf2422ee7]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:16:12 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a5e329ef-cc98-454e-ae2a-3655fc1a9a14 tempest-VolumesSnapshotTestJSON-1952456970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-301f95fb-4d6d-45a0-af53-1e46222ea8dd {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:12 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-e67e2186-15e1-4ad5-9e5b-704b849c2f06 tempest-VolumesSnapshotListTestJSON-343657281 None] Created reservations ['c2883aba-9038-4463-88dc-2ac00cb09419', '8fd0b8bc-ec05-4d33-94c2-092da1cf8519', '507855d5-067c-4d06-b8c6-35e870bd5170', 'fd980bcf-c474-4514-961f-662bda020be5'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:16:12 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-e67e2186-15e1-4ad5-9e5b-704b849c2f06 tempest-VolumesSnapshotListTestJSON-343657281 None] Delete snapshot completed successfully. Nov 02 10:16:12 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-e67e2186-15e1-4ad5-9e5b-704b849c2f06 tempest-VolumesSnapshotListTestJSON-343657281 None] Lock "cinder-7afa1736-cf71-4de9-bf28-b0bb50981c38-delete_snapshot" released by "delete_snapshot" :: held 2.295s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:16:12 devstack sudo[99610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-301f95fb-4d6d-45a0-af53-1e46222ea8dd Nov 02 10:16:12 devstack sudo[99610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:12 devstack sudo[99610]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:12 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a5e329ef-cc98-454e-ae2a-3655fc1a9a14 tempest-VolumesSnapshotTestJSON-1952456970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-301f95fb-4d6d-45a0-af53-1e46222ea8dd" returned: 0 in 0.453s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:12 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a5e329ef-cc98-454e-ae2a-3655fc1a9a14 tempest-VolumesSnapshotTestJSON-1952456970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-301f95fb-4d6d-45a0-af53-1e46222ea8dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-301f95fb-4d6d-45a0-af53-1e46222ea8dd.057857e7-c94f-45a6-900e-0d12dda44d33 1G {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:12 devstack sudo[99615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-301f95fb-4d6d-45a0-af53-1e46222ea8dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-301f95fb-4d6d-45a0-af53-1e46222ea8dd.057857e7-c94f-45a6-900e-0d12dda44d33 1G Nov 02 10:16:12 devstack sudo[99615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:13 devstack sudo[99615]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:13 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a5e329ef-cc98-454e-ae2a-3655fc1a9a14 tempest-VolumesSnapshotTestJSON-1952456970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-301f95fb-4d6d-45a0-af53-1e46222ea8dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-301f95fb-4d6d-45a0-af53-1e46222ea8dd.057857e7-c94f-45a6-900e-0d12dda44d33 1G" returned: 0 in 0.615s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:13 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a5e329ef-cc98-454e-ae2a-3655fc1a9a14 tempest-VolumesSnapshotTestJSON-1952456970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-301f95fb-4d6d-45a0-af53-1e46222ea8dd -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-301f95fb-4d6d-45a0-af53-1e46222ea8dd.057857e7-c94f-45a6-900e-0d12dda44d33 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:13 devstack sudo[99622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-301f95fb-4d6d-45a0-af53-1e46222ea8dd -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-301f95fb-4d6d-45a0-af53-1e46222ea8dd.057857e7-c94f-45a6-900e-0d12dda44d33 Nov 02 10:16:13 devstack sudo[99622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:13 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-9cbcf8cb-6d89-42e0-9d63-e386392cb63a tempest-VolumesSnapshotListTestJSON-343657281 None] Acquiring lock "cinder-05aa2d4b-4977-485f-a06e-3601696c34ec-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:16:13 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-9cbcf8cb-6d89-42e0-9d63-e386392cb63a tempest-VolumesSnapshotListTestJSON-343657281 None] Lock "cinder-05aa2d4b-4977-485f-a06e-3601696c34ec-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:16:13 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-9cbcf8cb-6d89-42e0-9d63-e386392cb63a tempest-VolumesSnapshotListTestJSON-343657281 None] Acquiring lock "cinder-quobyte-05aa2d4b-4977-485f-a06e-3601696c34ec" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:16:13 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-9cbcf8cb-6d89-42e0-9d63-e386392cb63a tempest-VolumesSnapshotListTestJSON-343657281 None] Lock "cinder-quobyte-05aa2d4b-4977-485f-a06e-3601696c34ec" acquired by "delete_volume" :: waited 0.025s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:16:13 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6d9afca-28e6-479b-b0fd-835c3c012635]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:16:13 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-9cbcf8cb-6d89-42e0-9d63-e386392cb63a tempest-VolumesSnapshotListTestJSON-343657281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-05aa2d4b-4977-485f-a06e-3601696c34ec {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:13 devstack sudo[99622]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:13 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a5e329ef-cc98-454e-ae2a-3655fc1a9a14 tempest-VolumesSnapshotTestJSON-1952456970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-301f95fb-4d6d-45a0-af53-1e46222ea8dd -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-301f95fb-4d6d-45a0-af53-1e46222ea8dd.057857e7-c94f-45a6-900e-0d12dda44d33" returned: 0 in 0.411s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:13 devstack cinder-volume[86890]: WARNING cinder.volume.drivers.remotefs [None req-a5e329ef-cc98-454e-ae2a-3655fc1a9a14 tempest-VolumesSnapshotTestJSON-1952456970 None] /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-301f95fb-4d6d-45a0-af53-1e46222ea8dd.057857e7-c94f-45a6-900e-0d12dda44d33 is being set with open permissions: ugo+rw Nov 02 10:16:13 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a5e329ef-cc98-454e-ae2a-3655fc1a9a14 tempest-VolumesSnapshotTestJSON-1952456970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-301f95fb-4d6d-45a0-af53-1e46222ea8dd.057857e7-c94f-45a6-900e-0d12dda44d33 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:13 devstack sudo[99631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-301f95fb-4d6d-45a0-af53-1e46222ea8dd.057857e7-c94f-45a6-900e-0d12dda44d33 Nov 02 10:16:13 devstack sudo[99631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:13 devstack sudo[99626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-05aa2d4b-4977-485f-a06e-3601696c34ec Nov 02 10:16:13 devstack sudo[99626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:14 devstack sudo[99631]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:14 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a5e329ef-cc98-454e-ae2a-3655fc1a9a14 tempest-VolumesSnapshotTestJSON-1952456970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-301f95fb-4d6d-45a0-af53-1e46222ea8dd.057857e7-c94f-45a6-900e-0d12dda44d33" returned: 0 in 0.322s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:14 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a5e329ef-cc98-454e-ae2a-3655fc1a9a14 tempest-VolumesSnapshotTestJSON-1952456970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-301f95fb-4d6d-45a0-af53-1e46222ea8dd.info {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:14 devstack sudo[99626]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:14 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-9cbcf8cb-6d89-42e0-9d63-e386392cb63a tempest-VolumesSnapshotListTestJSON-343657281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-05aa2d4b-4977-485f-a06e-3601696c34ec" returned: 0 in 0.517s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:14 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-9cbcf8cb-6d89-42e0-9d63-e386392cb63a tempest-VolumesSnapshotListTestJSON-343657281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-05aa2d4b-4977-485f-a06e-3601696c34ec {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:14 devstack sudo[99639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-301f95fb-4d6d-45a0-af53-1e46222ea8dd.info Nov 02 10:16:14 devstack sudo[99639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:14 devstack sudo[99640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-05aa2d4b-4977-485f-a06e-3601696c34ec Nov 02 10:16:14 devstack sudo[99640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:14 devstack sudo[99639]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:14 devstack sudo[99640]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:14 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a5e329ef-cc98-454e-ae2a-3655fc1a9a14 tempest-VolumesSnapshotTestJSON-1952456970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-301f95fb-4d6d-45a0-af53-1e46222ea8dd.info" returned: 0 in 0.319s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:14 devstack cinder-volume[86890]: WARNING cinder.volume.drivers.remotefs [None req-a5e329ef-cc98-454e-ae2a-3655fc1a9a14 tempest-VolumesSnapshotTestJSON-1952456970 None] /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-301f95fb-4d6d-45a0-af53-1e46222ea8dd.info is being set with open permissions: ugo+rw Nov 02 10:16:14 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a5e329ef-cc98-454e-ae2a-3655fc1a9a14 tempest-VolumesSnapshotTestJSON-1952456970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-301f95fb-4d6d-45a0-af53-1e46222ea8dd.info {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:14 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-9cbcf8cb-6d89-42e0-9d63-e386392cb63a tempest-VolumesSnapshotListTestJSON-343657281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-05aa2d4b-4977-485f-a06e-3601696c34ec" returned: 0 in 0.304s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:14 devstack sudo[99645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-301f95fb-4d6d-45a0-af53-1e46222ea8dd.info Nov 02 10:16:14 devstack sudo[99645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:14 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-9cbcf8cb-6d89-42e0-9d63-e386392cb63a tempest-VolumesSnapshotListTestJSON-343657281 None] Lock "cinder-quobyte-05aa2d4b-4977-485f-a06e-3601696c34ec" released by "delete_volume" :: held 0.924s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:16:14 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-9cbcf8cb-6d89-42e0-9d63-e386392cb63a tempest-VolumesSnapshotListTestJSON-343657281 None] Created reservations ['91cd0fb0-964d-44b1-9064-80d6526faf5e', 'e885948e-6758-4fe0-9ce7-d18000810639', '2096be26-7f12-41e2-9399-219f67985753', 'edf4f1c6-9d14-47c4-81b0-9c8bf1fa77f2'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:16:14 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-9cbcf8cb-6d89-42e0-9d63-e386392cb63a tempest-VolumesSnapshotListTestJSON-343657281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:16:14 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-9cbcf8cb-6d89-42e0-9d63-e386392cb63a tempest-VolumesSnapshotListTestJSON-343657281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:16:14 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-9cbcf8cb-6d89-42e0-9d63-e386392cb63a tempest-VolumesSnapshotListTestJSON-343657281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:16:14 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-9cbcf8cb-6d89-42e0-9d63-e386392cb63a tempest-VolumesSnapshotListTestJSON-343657281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:16:14 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-9cbcf8cb-6d89-42e0-9d63-e386392cb63a tempest-VolumesSnapshotListTestJSON-343657281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:16:14 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-9cbcf8cb-6d89-42e0-9d63-e386392cb63a tempest-VolumesSnapshotListTestJSON-343657281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:14 devstack sudo[99647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:16:14 devstack sudo[99647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:14 devstack sudo[99645]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:14 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a5e329ef-cc98-454e-ae2a-3655fc1a9a14 tempest-VolumesSnapshotTestJSON-1952456970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-301f95fb-4d6d-45a0-af53-1e46222ea8dd.info" returned: 0 in 0.305s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:14 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-a5e329ef-cc98-454e-ae2a-3655fc1a9a14 tempest-VolumesSnapshotTestJSON-1952456970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.552s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:16:14 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-a5e329ef-cc98-454e-ae2a-3655fc1a9a14 tempest-VolumesSnapshotTestJSON-1952456970 None] Create snapshot completed successfully Nov 02 10:16:15 devstack sudo[99647]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:15 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-9cbcf8cb-6d89-42e0-9d63-e386392cb63a tempest-VolumesSnapshotListTestJSON-343657281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.340s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:15 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-9cbcf8cb-6d89-42e0-9d63-e386392cb63a tempest-VolumesSnapshotListTestJSON-343657281 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:16:15 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-9cbcf8cb-6d89-42e0-9d63-e386392cb63a tempest-VolumesSnapshotListTestJSON-343657281 None] Deleted volume successfully. Nov 02 10:16:15 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-9cbcf8cb-6d89-42e0-9d63-e386392cb63a tempest-VolumesSnapshotListTestJSON-343657281 None] Lock "cinder-05aa2d4b-4977-485f-a06e-3601696c34ec-delete_volume" released by "delete_volume" :: held 1.552s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:16:15 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-bb1a52ef-8e6d-4255-bb5c-cc0e307aa0c5 tempest-VolumesSnapshotTestJSON-1952456970 None] Acquiring lock "cinder-057857e7-c94f-45a6-900e-0d12dda44d33-delete_snapshot" by "delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:16:15 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-bb1a52ef-8e6d-4255-bb5c-cc0e307aa0c5 tempest-VolumesSnapshotTestJSON-1952456970 None] Lock "cinder-057857e7-c94f-45a6-900e-0d12dda44d33-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:16:15 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-bb1a52ef-8e6d-4255-bb5c-cc0e307aa0c5 tempest-VolumesSnapshotTestJSON-1952456970 None] Acquiring lock "cinder-quobyte-301f95fb-4d6d-45a0-af53-1e46222ea8dd" by "delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:16:15 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-bb1a52ef-8e6d-4255-bb5c-cc0e307aa0c5 tempest-VolumesSnapshotTestJSON-1952456970 None] Lock "cinder-quobyte-301f95fb-4d6d-45a0-af53-1e46222ea8dd" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:16:15 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-bb1a52ef-8e6d-4255-bb5c-cc0e307aa0c5 tempest-VolumesSnapshotTestJSON-1952456970 None] Acquiring lock "cinder-quobyte-057857e7-c94f-45a6-900e-0d12dda44d33" by "_delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:16:15 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-bb1a52ef-8e6d-4255-bb5c-cc0e307aa0c5 tempest-VolumesSnapshotTestJSON-1952456970 None] Lock "cinder-quobyte-057857e7-c94f-45a6-900e-0d12dda44d33" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:16:15 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-bb1a52ef-8e6d-4255-bb5c-cc0e307aa0c5 tempest-VolumesSnapshotTestJSON-1952456970 None] Deleting offline snapshot 057857e7-c94f-45a6-900e-0d12dda44d33 of volume 301f95fb-4d6d-45a0-af53-1e46222ea8dd {{(pid=86890) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:16:15 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-bb1a52ef-8e6d-4255-bb5c-cc0e307aa0c5 tempest-VolumesSnapshotTestJSON-1952456970 None] snapshot_file for this snap is: volume-301f95fb-4d6d-45a0-af53-1e46222ea8dd.057857e7-c94f-45a6-900e-0d12dda44d33 {{(pid=86890) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:16:15 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c6130d2-1744-4999-96ce-7b088d7d68f3]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:16:15 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-bb1a52ef-8e6d-4255-bb5c-cc0e307aa0c5 tempest-VolumesSnapshotTestJSON-1952456970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-301f95fb-4d6d-45a0-af53-1e46222ea8dd.057857e7-c94f-45a6-900e-0d12dda44d33 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:16 devstack sudo[99687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-301f95fb-4d6d-45a0-af53-1e46222ea8dd.057857e7-c94f-45a6-900e-0d12dda44d33 Nov 02 10:16:16 devstack sudo[99687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:16 devstack sudo[99687]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:16 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-bb1a52ef-8e6d-4255-bb5c-cc0e307aa0c5 tempest-VolumesSnapshotTestJSON-1952456970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-301f95fb-4d6d-45a0-af53-1e46222ea8dd.057857e7-c94f-45a6-900e-0d12dda44d33" returned: 0 in 0.483s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:16 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-bb1a52ef-8e6d-4255-bb5c-cc0e307aa0c5 tempest-VolumesSnapshotTestJSON-1952456970 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-301f95fb-4d6d-45a0-af53-1e46222ea8dd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86890) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:16:16 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc5e9df5-3c25-41ef-bd92-d9b76aceeaba]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:16:16 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-bb1a52ef-8e6d-4255-bb5c-cc0e307aa0c5 tempest-VolumesSnapshotTestJSON-1952456970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-301f95fb-4d6d-45a0-af53-1e46222ea8dd {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:16 devstack sudo[99698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-301f95fb-4d6d-45a0-af53-1e46222ea8dd Nov 02 10:16:16 devstack sudo[99698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:16 devstack sudo[99698]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:16 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-bb1a52ef-8e6d-4255-bb5c-cc0e307aa0c5 tempest-VolumesSnapshotTestJSON-1952456970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-301f95fb-4d6d-45a0-af53-1e46222ea8dd" returned: 0 in 0.487s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:16 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-bb1a52ef-8e6d-4255-bb5c-cc0e307aa0c5 tempest-VolumesSnapshotTestJSON-1952456970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-301f95fb-4d6d-45a0-af53-1e46222ea8dd.057857e7-c94f-45a6-900e-0d12dda44d33 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:16 devstack sudo[99706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-301f95fb-4d6d-45a0-af53-1e46222ea8dd.057857e7-c94f-45a6-900e-0d12dda44d33 Nov 02 10:16:16 devstack sudo[99706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:17 devstack sudo[99706]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:17 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-bb1a52ef-8e6d-4255-bb5c-cc0e307aa0c5 tempest-VolumesSnapshotTestJSON-1952456970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-301f95fb-4d6d-45a0-af53-1e46222ea8dd.057857e7-c94f-45a6-900e-0d12dda44d33" returned: 0 in 0.385s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:17 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-bb1a52ef-8e6d-4255-bb5c-cc0e307aa0c5 tempest-VolumesSnapshotTestJSON-1952456970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-301f95fb-4d6d-45a0-af53-1e46222ea8dd.057857e7-c94f-45a6-900e-0d12dda44d33 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:17 devstack sudo[99711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-301f95fb-4d6d-45a0-af53-1e46222ea8dd.057857e7-c94f-45a6-900e-0d12dda44d33 Nov 02 10:16:17 devstack sudo[99711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:17 devstack sudo[99711]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:17 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-bb1a52ef-8e6d-4255-bb5c-cc0e307aa0c5 tempest-VolumesSnapshotTestJSON-1952456970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-301f95fb-4d6d-45a0-af53-1e46222ea8dd.057857e7-c94f-45a6-900e-0d12dda44d33" returned: 0 in 0.262s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:17 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-bb1a52ef-8e6d-4255-bb5c-cc0e307aa0c5 tempest-VolumesSnapshotTestJSON-1952456970 None] Lock "cinder-quobyte-057857e7-c94f-45a6-900e-0d12dda44d33" released by "_delete_snapshot" :: held 1.782s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:16:17 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-bb1a52ef-8e6d-4255-bb5c-cc0e307aa0c5 tempest-VolumesSnapshotTestJSON-1952456970 None] Lock "cinder-quobyte-301f95fb-4d6d-45a0-af53-1e46222ea8dd" released by "delete_snapshot" :: held 1.811s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:16:17 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-bb1a52ef-8e6d-4255-bb5c-cc0e307aa0c5 tempest-VolumesSnapshotTestJSON-1952456970 None] Created reservations ['dd050257-4749-4da0-bced-d918fe84830a', '66e0729e-d4f9-48f1-8482-704dffda69bd', 'dcadff6f-7813-44b5-8246-7c5ad428c85f', '8fcd8db7-e093-4bb8-ac06-6a3bf9f9140b'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:16:17 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-bb1a52ef-8e6d-4255-bb5c-cc0e307aa0c5 tempest-VolumesSnapshotTestJSON-1952456970 None] Delete snapshot completed successfully. Nov 02 10:16:17 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-bb1a52ef-8e6d-4255-bb5c-cc0e307aa0c5 tempest-VolumesSnapshotTestJSON-1952456970 None] Lock "cinder-057857e7-c94f-45a6-900e-0d12dda44d33-delete_snapshot" released by "delete_snapshot" :: held 2.052s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:16:18 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-77bf16f5-525c-4e94-98f8-0f0c8ab42bc7 tempest-VolumesSnapshotTestJSON-1952456970 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:16:18 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-77bf16f5-525c-4e94-98f8-0f0c8ab42bc7 tempest-VolumesSnapshotTestJSON-1952456970 None] Flow 'volume_create_manager' (53b53bc5-fdc6-46df-955e-b5cd15ae108c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:16:18 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-77bf16f5-525c-4e94-98f8-0f0c8ab42bc7 tempest-VolumesSnapshotTestJSON-1952456970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc582d4d-768b-4f3f-97c2-26e797f04884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:18 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-77bf16f5-525c-4e94-98f8-0f0c8ab42bc7 tempest-VolumesSnapshotTestJSON-1952456970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc582d4d-768b-4f3f-97c2-26e797f04884) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:16:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1985394669',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58a515a4-f972-4cf0-bf61-75f1b187e380,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f0cc30a11e44c8294d8872570bdc5f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:16:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:16:19Z,use_quota=True,user_id='959cfb1854eb4418aa6d558022bda4ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:18 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-77bf16f5-525c-4e94-98f8-0f0c8ab42bc7 tempest-VolumesSnapshotTestJSON-1952456970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (213f2756-f72e-438f-9dda-5eae6470fa1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:18 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-77bf16f5-525c-4e94-98f8-0f0c8ab42bc7 tempest-VolumesSnapshotTestJSON-1952456970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (213f2756-f72e-438f-9dda-5eae6470fa1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:18 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-77bf16f5-525c-4e94-98f8-0f0c8ab42bc7 tempest-VolumesSnapshotTestJSON-1952456970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (545e0a53-2b42-4348-9b00-337aec060c2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:18 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-77bf16f5-525c-4e94-98f8-0f0c8ab42bc7 tempest-VolumesSnapshotTestJSON-1952456970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (545e0a53-2b42-4348-9b00-337aec060c2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58a515a4-f972-4cf0-bf61-75f1b187e380', 'volume_name': 'volume-58a515a4-f972-4cf0-bf61-75f1b187e380', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:18 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-77bf16f5-525c-4e94-98f8-0f0c8ab42bc7 tempest-VolumesSnapshotTestJSON-1952456970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6930d958-54d3-4925-b14a-4fac944678f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:18 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-77bf16f5-525c-4e94-98f8-0f0c8ab42bc7 tempest-VolumesSnapshotTestJSON-1952456970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6930d958-54d3-4925-b14a-4fac944678f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:18 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-77bf16f5-525c-4e94-98f8-0f0c8ab42bc7 tempest-VolumesSnapshotTestJSON-1952456970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (982e2915-5c87-4694-b95b-af3f9238b035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:18 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-77bf16f5-525c-4e94-98f8-0f0c8ab42bc7 tempest-VolumesSnapshotTestJSON-1952456970 None] Volume 58a515a4-f972-4cf0-bf61-75f1b187e380: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58a515a4-f972-4cf0-bf61-75f1b187e380', 'volume_size': 1} Nov 02 10:16:18 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-77bf16f5-525c-4e94-98f8-0f0c8ab42bc7 tempest-VolumesSnapshotTestJSON-1952456970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:16:18 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-77bf16f5-525c-4e94-98f8-0f0c8ab42bc7 tempest-VolumesSnapshotTestJSON-1952456970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:16:18 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-77bf16f5-525c-4e94-98f8-0f0c8ab42bc7 tempest-VolumesSnapshotTestJSON-1952456970 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:16:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1985394669',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58a515a4-f972-4cf0-bf61-75f1b187e380,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f0cc30a11e44c8294d8872570bdc5f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:16:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:16:19Z,use_quota=True,user_id='959cfb1854eb4418aa6d558022bda4ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:16:18 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-77bf16f5-525c-4e94-98f8-0f0c8ab42bc7 tempest-VolumesSnapshotTestJSON-1952456970 None] Creating volume 58a515a4-f972-4cf0-bf61-75f1b187e380 {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:16:18 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-77bf16f5-525c-4e94-98f8-0f0c8ab42bc7 tempest-VolumesSnapshotTestJSON-1952456970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:16:18 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-77bf16f5-525c-4e94-98f8-0f0c8ab42bc7 tempest-VolumesSnapshotTestJSON-1952456970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:16:18 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-77bf16f5-525c-4e94-98f8-0f0c8ab42bc7 tempest-VolumesSnapshotTestJSON-1952456970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:16:18 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-77bf16f5-525c-4e94-98f8-0f0c8ab42bc7 tempest-VolumesSnapshotTestJSON-1952456970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:16:18 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-77bf16f5-525c-4e94-98f8-0f0c8ab42bc7 tempest-VolumesSnapshotTestJSON-1952456970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:16:18 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-77bf16f5-525c-4e94-98f8-0f0c8ab42bc7 tempest-VolumesSnapshotTestJSON-1952456970 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:16:18 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-77bf16f5-525c-4e94-98f8-0f0c8ab42bc7 tempest-VolumesSnapshotTestJSON-1952456970 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:16:18 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-77bf16f5-525c-4e94-98f8-0f0c8ab42bc7 tempest-VolumesSnapshotTestJSON-1952456970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-58a515a4-f972-4cf0-bf61-75f1b187e380 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:18 devstack sudo[99715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-58a515a4-f972-4cf0-bf61-75f1b187e380 1073741824 Nov 02 10:16:18 devstack sudo[99715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:19 devstack sudo[99715]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:19 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-77bf16f5-525c-4e94-98f8-0f0c8ab42bc7 tempest-VolumesSnapshotTestJSON-1952456970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-58a515a4-f972-4cf0-bf61-75f1b187e380 1073741824" returned: 0 in 0.498s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:19 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-77bf16f5-525c-4e94-98f8-0f0c8ab42bc7 tempest-VolumesSnapshotTestJSON-1952456970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-58a515a4-f972-4cf0-bf61-75f1b187e380 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:19 devstack sudo[99720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-58a515a4-f972-4cf0-bf61-75f1b187e380 Nov 02 10:16:19 devstack sudo[99720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:19 devstack sudo[99720]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:19 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-77bf16f5-525c-4e94-98f8-0f0c8ab42bc7 tempest-VolumesSnapshotTestJSON-1952456970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-58a515a4-f972-4cf0-bf61-75f1b187e380" returned: 0 in 0.319s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:19 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-77bf16f5-525c-4e94-98f8-0f0c8ab42bc7 tempest-VolumesSnapshotTestJSON-1952456970 None] <== create_volume: return (876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:16:19 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-77bf16f5-525c-4e94-98f8-0f0c8ab42bc7 tempest-VolumesSnapshotTestJSON-1952456970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.878s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:16:19 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-77bf16f5-525c-4e94-98f8-0f0c8ab42bc7 tempest-VolumesSnapshotTestJSON-1952456970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (982e2915-5c87-4694-b95b-af3f9238b035) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58a515a4-f972-4cf0-bf61-75f1b187e380', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:19 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-77bf16f5-525c-4e94-98f8-0f0c8ab42bc7 tempest-VolumesSnapshotTestJSON-1952456970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7775dde9-c7fa-4380-93cf-7544c7857258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:19 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-784fd458-dbe1-4ff2-809b-7559dbdead6d tempest-VolumesSnapshotNegativeTestJSON-1934088382 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:16:19 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-784fd458-dbe1-4ff2-809b-7559dbdead6d tempest-VolumesSnapshotNegativeTestJSON-1934088382 None] Flow 'volume_create_manager' (1fcbc466-9248-4cac-9187-b8213424ef8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:16:19 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-784fd458-dbe1-4ff2-809b-7559dbdead6d tempest-VolumesSnapshotNegativeTestJSON-1934088382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (104b6aa7-0861-413d-89ed-7826d9e5e828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:19 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-77bf16f5-525c-4e94-98f8-0f0c8ab42bc7 tempest-VolumesSnapshotTestJSON-1952456970 None] Volume volume-58a515a4-f972-4cf0-bf61-75f1b187e380 (58a515a4-f972-4cf0-bf61-75f1b187e380): created successfully Nov 02 10:16:19 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-77bf16f5-525c-4e94-98f8-0f0c8ab42bc7 tempest-VolumesSnapshotTestJSON-1952456970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7775dde9-c7fa-4380-93cf-7544c7857258) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:19 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-77bf16f5-525c-4e94-98f8-0f0c8ab42bc7 tempest-VolumesSnapshotTestJSON-1952456970 None] Flow 'volume_create_manager' (53b53bc5-fdc6-46df-955e-b5cd15ae108c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:16:19 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-784fd458-dbe1-4ff2-809b-7559dbdead6d tempest-VolumesSnapshotNegativeTestJSON-1934088382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (104b6aa7-0861-413d-89ed-7826d9e5e828) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:16:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1500690721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc22c4a0-ec75-46ce-aabd-9ca5bd8bff4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='976b3e1d157849bab654eb5e1300d132',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:16:20Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:16:20Z,use_quota=True,user_id='98fe0f150fb34f4e9f046ddbd129d64c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:19 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-784fd458-dbe1-4ff2-809b-7559dbdead6d tempest-VolumesSnapshotNegativeTestJSON-1934088382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2150a2b2-d354-47f6-b53e-901ece2ce653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:19 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-784fd458-dbe1-4ff2-809b-7559dbdead6d tempest-VolumesSnapshotNegativeTestJSON-1934088382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2150a2b2-d354-47f6-b53e-901ece2ce653) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:19 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-784fd458-dbe1-4ff2-809b-7559dbdead6d tempest-VolumesSnapshotNegativeTestJSON-1934088382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8068349c-c856-4ebb-affc-71d63b3133b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:19 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-784fd458-dbe1-4ff2-809b-7559dbdead6d tempest-VolumesSnapshotNegativeTestJSON-1934088382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8068349c-c856-4ebb-affc-71d63b3133b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc22c4a0-ec75-46ce-aabd-9ca5bd8bff4c', 'volume_name': 'volume-dc22c4a0-ec75-46ce-aabd-9ca5bd8bff4c', 'volume_size': 2}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:19 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-784fd458-dbe1-4ff2-809b-7559dbdead6d tempest-VolumesSnapshotNegativeTestJSON-1934088382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f6cad6f-bac3-4609-b993-bc41989cde30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:19 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-784fd458-dbe1-4ff2-809b-7559dbdead6d tempest-VolumesSnapshotNegativeTestJSON-1934088382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f6cad6f-bac3-4609-b993-bc41989cde30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:19 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-784fd458-dbe1-4ff2-809b-7559dbdead6d tempest-VolumesSnapshotNegativeTestJSON-1934088382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (044413e9-26f7-4e9b-851e-a29fc89afad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:19 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-784fd458-dbe1-4ff2-809b-7559dbdead6d tempest-VolumesSnapshotNegativeTestJSON-1934088382 None] Volume dc22c4a0-ec75-46ce-aabd-9ca5bd8bff4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc22c4a0-ec75-46ce-aabd-9ca5bd8bff4c', 'volume_size': 2} Nov 02 10:16:19 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-784fd458-dbe1-4ff2-809b-7559dbdead6d tempest-VolumesSnapshotNegativeTestJSON-1934088382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:16:19 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-784fd458-dbe1-4ff2-809b-7559dbdead6d tempest-VolumesSnapshotNegativeTestJSON-1934088382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:16:19 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-784fd458-dbe1-4ff2-809b-7559dbdead6d tempest-VolumesSnapshotNegativeTestJSON-1934088382 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:16:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1500690721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc22c4a0-ec75-46ce-aabd-9ca5bd8bff4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='976b3e1d157849bab654eb5e1300d132',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:16:20Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:16:20Z,use_quota=True,user_id='98fe0f150fb34f4e9f046ddbd129d64c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:16:19 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-784fd458-dbe1-4ff2-809b-7559dbdead6d tempest-VolumesSnapshotNegativeTestJSON-1934088382 None] Creating volume dc22c4a0-ec75-46ce-aabd-9ca5bd8bff4c {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:16:19 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-784fd458-dbe1-4ff2-809b-7559dbdead6d tempest-VolumesSnapshotNegativeTestJSON-1934088382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:16:19 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-784fd458-dbe1-4ff2-809b-7559dbdead6d tempest-VolumesSnapshotNegativeTestJSON-1934088382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:16:19 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-784fd458-dbe1-4ff2-809b-7559dbdead6d tempest-VolumesSnapshotNegativeTestJSON-1934088382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:16:19 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-784fd458-dbe1-4ff2-809b-7559dbdead6d tempest-VolumesSnapshotNegativeTestJSON-1934088382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:16:19 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-784fd458-dbe1-4ff2-809b-7559dbdead6d tempest-VolumesSnapshotNegativeTestJSON-1934088382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:16:19 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-784fd458-dbe1-4ff2-809b-7559dbdead6d tempest-VolumesSnapshotNegativeTestJSON-1934088382 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:16:19 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-784fd458-dbe1-4ff2-809b-7559dbdead6d tempest-VolumesSnapshotNegativeTestJSON-1934088382 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:16:19 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-784fd458-dbe1-4ff2-809b-7559dbdead6d tempest-VolumesSnapshotNegativeTestJSON-1934088382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dc22c4a0-ec75-46ce-aabd-9ca5bd8bff4c 2147483648 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:19 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-77bf16f5-525c-4e94-98f8-0f0c8ab42bc7 tempest-VolumesSnapshotTestJSON-1952456970 None] Created volume successfully. Nov 02 10:16:19 devstack sudo[99723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dc22c4a0-ec75-46ce-aabd-9ca5bd8bff4c 2147483648 Nov 02 10:16:19 devstack sudo[99723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:20 devstack sudo[99723]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:20 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-784fd458-dbe1-4ff2-809b-7559dbdead6d tempest-VolumesSnapshotNegativeTestJSON-1934088382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dc22c4a0-ec75-46ce-aabd-9ca5bd8bff4c 2147483648" returned: 0 in 0.464s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:20 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-784fd458-dbe1-4ff2-809b-7559dbdead6d tempest-VolumesSnapshotNegativeTestJSON-1934088382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dc22c4a0-ec75-46ce-aabd-9ca5bd8bff4c {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:20 devstack sudo[99728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dc22c4a0-ec75-46ce-aabd-9ca5bd8bff4c Nov 02 10:16:20 devstack sudo[99728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:20 devstack sudo[99728]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:20 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-784fd458-dbe1-4ff2-809b-7559dbdead6d tempest-VolumesSnapshotNegativeTestJSON-1934088382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dc22c4a0-ec75-46ce-aabd-9ca5bd8bff4c" returned: 0 in 0.244s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:20 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-784fd458-dbe1-4ff2-809b-7559dbdead6d tempest-VolumesSnapshotNegativeTestJSON-1934088382 None] <== create_volume: return (747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:16:20 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-784fd458-dbe1-4ff2-809b-7559dbdead6d tempest-VolumesSnapshotNegativeTestJSON-1934088382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.749s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:16:20 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-784fd458-dbe1-4ff2-809b-7559dbdead6d tempest-VolumesSnapshotNegativeTestJSON-1934088382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (044413e9-26f7-4e9b-851e-a29fc89afad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc22c4a0-ec75-46ce-aabd-9ca5bd8bff4c', 'volume_size': 2}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:20 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-784fd458-dbe1-4ff2-809b-7559dbdead6d tempest-VolumesSnapshotNegativeTestJSON-1934088382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b254a451-1a03-4519-946a-6af3345e7c05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:20 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-784fd458-dbe1-4ff2-809b-7559dbdead6d tempest-VolumesSnapshotNegativeTestJSON-1934088382 None] Volume volume-dc22c4a0-ec75-46ce-aabd-9ca5bd8bff4c (dc22c4a0-ec75-46ce-aabd-9ca5bd8bff4c): created successfully Nov 02 10:16:20 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-784fd458-dbe1-4ff2-809b-7559dbdead6d tempest-VolumesSnapshotNegativeTestJSON-1934088382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b254a451-1a03-4519-946a-6af3345e7c05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:20 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-784fd458-dbe1-4ff2-809b-7559dbdead6d tempest-VolumesSnapshotNegativeTestJSON-1934088382 None] Flow 'volume_create_manager' (1fcbc466-9248-4cac-9187-b8213424ef8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:16:20 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-784fd458-dbe1-4ff2-809b-7559dbdead6d tempest-VolumesSnapshotNegativeTestJSON-1934088382 None] Created volume successfully. Nov 02 10:16:20 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-5c3ed143-d5be-469c-b1ab-3c0cadf15d92 tempest-VolumesSnapshotTestJSON-1952456970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:16:20 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-5c3ed143-d5be-469c-b1ab-3c0cadf15d92 tempest-VolumesSnapshotTestJSON-1952456970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:16:20 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-5c3ed143-d5be-469c-b1ab-3c0cadf15d92 tempest-VolumesSnapshotTestJSON-1952456970 None] Creating offline snapshot 4cfc7969-9aa8-4b04-adb4-c8366ea57a03 of volume 58a515a4-f972-4cf0-bf61-75f1b187e380 {{(pid=86890) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:16:20 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[9526dbb7-ad1f-4a8a-9a74-7c272e423795]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:16:20 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-5c3ed143-d5be-469c-b1ab-3c0cadf15d92 tempest-VolumesSnapshotTestJSON-1952456970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-58a515a4-f972-4cf0-bf61-75f1b187e380 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:20 devstack sudo[99731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-58a515a4-f972-4cf0-bf61-75f1b187e380 Nov 02 10:16:20 devstack sudo[99731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:21 devstack sudo[99731]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:21 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-5c3ed143-d5be-469c-b1ab-3c0cadf15d92 tempest-VolumesSnapshotTestJSON-1952456970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-58a515a4-f972-4cf0-bf61-75f1b187e380" returned: 0 in 0.359s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:21 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-5c3ed143-d5be-469c-b1ab-3c0cadf15d92 tempest-VolumesSnapshotTestJSON-1952456970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-58a515a4-f972-4cf0-bf61-75f1b187e380,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-58a515a4-f972-4cf0-bf61-75f1b187e380.4cfc7969-9aa8-4b04-adb4-c8366ea57a03 1G {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:21 devstack sudo[99736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-58a515a4-f972-4cf0-bf61-75f1b187e380,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-58a515a4-f972-4cf0-bf61-75f1b187e380.4cfc7969-9aa8-4b04-adb4-c8366ea57a03 1G Nov 02 10:16:21 devstack sudo[99736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:21 devstack sudo[99736]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:21 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-5c3ed143-d5be-469c-b1ab-3c0cadf15d92 tempest-VolumesSnapshotTestJSON-1952456970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-58a515a4-f972-4cf0-bf61-75f1b187e380,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-58a515a4-f972-4cf0-bf61-75f1b187e380.4cfc7969-9aa8-4b04-adb4-c8366ea57a03 1G" returned: 0 in 0.417s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:21 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-5c3ed143-d5be-469c-b1ab-3c0cadf15d92 tempest-VolumesSnapshotTestJSON-1952456970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58a515a4-f972-4cf0-bf61-75f1b187e380 -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-58a515a4-f972-4cf0-bf61-75f1b187e380.4cfc7969-9aa8-4b04-adb4-c8366ea57a03 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:21 devstack sudo[99742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58a515a4-f972-4cf0-bf61-75f1b187e380 -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-58a515a4-f972-4cf0-bf61-75f1b187e380.4cfc7969-9aa8-4b04-adb4-c8366ea57a03 Nov 02 10:16:21 devstack sudo[99742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:21 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-2a4ae729-6873-4703-862f-028a59d8c61b tempest-VolumesSnapshotNegativeTestJSON-1934088382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:16:22 devstack sudo[99742]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:22 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-5c3ed143-d5be-469c-b1ab-3c0cadf15d92 tempest-VolumesSnapshotTestJSON-1952456970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58a515a4-f972-4cf0-bf61-75f1b187e380 -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-58a515a4-f972-4cf0-bf61-75f1b187e380.4cfc7969-9aa8-4b04-adb4-c8366ea57a03" returned: 0 in 0.377s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:22 devstack cinder-volume[86890]: WARNING cinder.volume.drivers.remotefs [None req-5c3ed143-d5be-469c-b1ab-3c0cadf15d92 tempest-VolumesSnapshotTestJSON-1952456970 None] /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-58a515a4-f972-4cf0-bf61-75f1b187e380.4cfc7969-9aa8-4b04-adb4-c8366ea57a03 is being set with open permissions: ugo+rw Nov 02 10:16:22 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-5c3ed143-d5be-469c-b1ab-3c0cadf15d92 tempest-VolumesSnapshotTestJSON-1952456970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-58a515a4-f972-4cf0-bf61-75f1b187e380.4cfc7969-9aa8-4b04-adb4-c8366ea57a03 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:22 devstack sudo[99747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-58a515a4-f972-4cf0-bf61-75f1b187e380.4cfc7969-9aa8-4b04-adb4-c8366ea57a03 Nov 02 10:16:22 devstack sudo[99747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:22 devstack sudo[99747]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:22 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-5c3ed143-d5be-469c-b1ab-3c0cadf15d92 tempest-VolumesSnapshotTestJSON-1952456970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-58a515a4-f972-4cf0-bf61-75f1b187e380.4cfc7969-9aa8-4b04-adb4-c8366ea57a03" returned: 0 in 0.263s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:22 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-5c3ed143-d5be-469c-b1ab-3c0cadf15d92 tempest-VolumesSnapshotTestJSON-1952456970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-58a515a4-f972-4cf0-bf61-75f1b187e380.info {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:22 devstack sudo[99750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-58a515a4-f972-4cf0-bf61-75f1b187e380.info Nov 02 10:16:22 devstack sudo[99750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:22 devstack sudo[99750]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:22 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-5c3ed143-d5be-469c-b1ab-3c0cadf15d92 tempest-VolumesSnapshotTestJSON-1952456970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-58a515a4-f972-4cf0-bf61-75f1b187e380.info" returned: 0 in 0.249s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:22 devstack cinder-volume[86890]: WARNING cinder.volume.drivers.remotefs [None req-5c3ed143-d5be-469c-b1ab-3c0cadf15d92 tempest-VolumesSnapshotTestJSON-1952456970 None] /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-58a515a4-f972-4cf0-bf61-75f1b187e380.info is being set with open permissions: ugo+rw Nov 02 10:16:22 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-5c3ed143-d5be-469c-b1ab-3c0cadf15d92 tempest-VolumesSnapshotTestJSON-1952456970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-58a515a4-f972-4cf0-bf61-75f1b187e380.info {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:22 devstack sudo[99753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-58a515a4-f972-4cf0-bf61-75f1b187e380.info Nov 02 10:16:22 devstack sudo[99753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:22 devstack sudo[99753]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:22 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-5c3ed143-d5be-469c-b1ab-3c0cadf15d92 tempest-VolumesSnapshotTestJSON-1952456970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-58a515a4-f972-4cf0-bf61-75f1b187e380.info" returned: 0 in 0.254s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:22 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-5c3ed143-d5be-469c-b1ab-3c0cadf15d92 tempest-VolumesSnapshotTestJSON-1952456970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.012s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:16:22 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-2a4ae729-6873-4703-862f-028a59d8c61b tempest-VolumesSnapshotNegativeTestJSON-1934088382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.958s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:16:22 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-2a4ae729-6873-4703-862f-028a59d8c61b tempest-VolumesSnapshotNegativeTestJSON-1934088382 None] Creating offline snapshot 68a52e03-0fac-4089-87d8-98087bfff0b7 of volume dc22c4a0-ec75-46ce-aabd-9ca5bd8bff4c {{(pid=86890) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:16:22 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-5c3ed143-d5be-469c-b1ab-3c0cadf15d92 tempest-VolumesSnapshotTestJSON-1952456970 None] Create snapshot completed successfully Nov 02 10:16:22 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[4971dc5a-969e-427e-9e15-6416c101cdff]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:16:22 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-2a4ae729-6873-4703-862f-028a59d8c61b tempest-VolumesSnapshotNegativeTestJSON-1934088382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dc22c4a0-ec75-46ce-aabd-9ca5bd8bff4c {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:23 devstack sudo[99756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dc22c4a0-ec75-46ce-aabd-9ca5bd8bff4c Nov 02 10:16:23 devstack sudo[99756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:23 devstack sudo[99756]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:23 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-2a4ae729-6873-4703-862f-028a59d8c61b tempest-VolumesSnapshotNegativeTestJSON-1934088382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dc22c4a0-ec75-46ce-aabd-9ca5bd8bff4c" returned: 0 in 0.458s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:23 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-2a4ae729-6873-4703-862f-028a59d8c61b tempest-VolumesSnapshotNegativeTestJSON-1934088382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dc22c4a0-ec75-46ce-aabd-9ca5bd8bff4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dc22c4a0-ec75-46ce-aabd-9ca5bd8bff4c.68a52e03-0fac-4089-87d8-98087bfff0b7 2G {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:23 devstack sudo[99775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dc22c4a0-ec75-46ce-aabd-9ca5bd8bff4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dc22c4a0-ec75-46ce-aabd-9ca5bd8bff4c.68a52e03-0fac-4089-87d8-98087bfff0b7 2G Nov 02 10:16:23 devstack sudo[99775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:23 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-b63a9e8b-464b-4c80-870f-c876d33d3379 tempest-VolumesSnapshotTestJSON-1952456970 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:16:23 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-b63a9e8b-464b-4c80-870f-c876d33d3379 tempest-VolumesSnapshotTestJSON-1952456970 None] Flow 'volume_create_manager' (f416782a-92dc-4a65-a068-6f63c602a081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:16:23 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-b63a9e8b-464b-4c80-870f-c876d33d3379 tempest-VolumesSnapshotTestJSON-1952456970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (844751da-7821-4ad9-9d06-ef84d4e04588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:23 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-b63a9e8b-464b-4c80-870f-c876d33d3379 tempest-VolumesSnapshotTestJSON-1952456970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (844751da-7821-4ad9-9d06-ef84d4e04588) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:16:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1962427763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60675a28-386c-49d0-b384-e5d5f6b0a731,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f0cc30a11e44c8294d8872570bdc5f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:16:24Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=4cfc7969-9aa8-4b04-adb4-c8366ea57a03,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:16:24Z,use_quota=True,user_id='959cfb1854eb4418aa6d558022bda4ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:23 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-b63a9e8b-464b-4c80-870f-c876d33d3379 tempest-VolumesSnapshotTestJSON-1952456970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e05c153d-83b4-4aeb-9b19-eae28407b738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:23 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-b63a9e8b-464b-4c80-870f-c876d33d3379 tempest-VolumesSnapshotTestJSON-1952456970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e05c153d-83b4-4aeb-9b19-eae28407b738) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:23 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-b63a9e8b-464b-4c80-870f-c876d33d3379 tempest-VolumesSnapshotTestJSON-1952456970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fc52493-f435-4bc5-abbc-6e5f973e9b6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:23 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-b63a9e8b-464b-4c80-870f-c876d33d3379 tempest-VolumesSnapshotTestJSON-1952456970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fc52493-f435-4bc5-abbc-6e5f973e9b6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '60675a28-386c-49d0-b384-e5d5f6b0a731', 'volume_name': 'volume-60675a28-386c-49d0-b384-e5d5f6b0a731', 'volume_size': 2, 'snapshot_id': '4cfc7969-9aa8-4b04-adb4-c8366ea57a03'}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:23 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-b63a9e8b-464b-4c80-870f-c876d33d3379 tempest-VolumesSnapshotTestJSON-1952456970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb041429-6b07-482c-b3aa-31c9a0ffd45e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:23 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-b63a9e8b-464b-4c80-870f-c876d33d3379 tempest-VolumesSnapshotTestJSON-1952456970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb041429-6b07-482c-b3aa-31c9a0ffd45e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:23 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-b63a9e8b-464b-4c80-870f-c876d33d3379 tempest-VolumesSnapshotTestJSON-1952456970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c801924c-2222-47b5-8dec-82ef04ce01ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:23 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-b63a9e8b-464b-4c80-870f-c876d33d3379 tempest-VolumesSnapshotTestJSON-1952456970 None] Volume 60675a28-386c-49d0-b384-e5d5f6b0a731: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-60675a28-386c-49d0-b384-e5d5f6b0a731', 'volume_size': 2, 'snapshot_id': '4cfc7969-9aa8-4b04-adb4-c8366ea57a03'} Nov 02 10:16:23 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-b63a9e8b-464b-4c80-870f-c876d33d3379 tempest-VolumesSnapshotTestJSON-1952456970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:16:23 devstack sudo[99775]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:23 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-2a4ae729-6873-4703-862f-028a59d8c61b tempest-VolumesSnapshotNegativeTestJSON-1934088382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dc22c4a0-ec75-46ce-aabd-9ca5bd8bff4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dc22c4a0-ec75-46ce-aabd-9ca5bd8bff4c.68a52e03-0fac-4089-87d8-98087bfff0b7 2G" returned: 0 in 0.439s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:23 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-2a4ae729-6873-4703-862f-028a59d8c61b tempest-VolumesSnapshotNegativeTestJSON-1934088382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc22c4a0-ec75-46ce-aabd-9ca5bd8bff4c -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dc22c4a0-ec75-46ce-aabd-9ca5bd8bff4c.68a52e03-0fac-4089-87d8-98087bfff0b7 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:23 devstack sudo[99781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc22c4a0-ec75-46ce-aabd-9ca5bd8bff4c -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dc22c4a0-ec75-46ce-aabd-9ca5bd8bff4c.68a52e03-0fac-4089-87d8-98087bfff0b7 Nov 02 10:16:23 devstack sudo[99781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:24 devstack sudo[99781]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:24 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-2a4ae729-6873-4703-862f-028a59d8c61b tempest-VolumesSnapshotNegativeTestJSON-1934088382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc22c4a0-ec75-46ce-aabd-9ca5bd8bff4c -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dc22c4a0-ec75-46ce-aabd-9ca5bd8bff4c.68a52e03-0fac-4089-87d8-98087bfff0b7" returned: 0 in 0.288s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:24 devstack cinder-volume[86890]: WARNING cinder.volume.drivers.remotefs [None req-2a4ae729-6873-4703-862f-028a59d8c61b tempest-VolumesSnapshotNegativeTestJSON-1934088382 None] /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dc22c4a0-ec75-46ce-aabd-9ca5bd8bff4c.68a52e03-0fac-4089-87d8-98087bfff0b7 is being set with open permissions: ugo+rw Nov 02 10:16:24 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-2a4ae729-6873-4703-862f-028a59d8c61b tempest-VolumesSnapshotNegativeTestJSON-1934088382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dc22c4a0-ec75-46ce-aabd-9ca5bd8bff4c.68a52e03-0fac-4089-87d8-98087bfff0b7 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:24 devstack sudo[99786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dc22c4a0-ec75-46ce-aabd-9ca5bd8bff4c.68a52e03-0fac-4089-87d8-98087bfff0b7 Nov 02 10:16:24 devstack sudo[99786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:24 devstack sudo[99786]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:24 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-2a4ae729-6873-4703-862f-028a59d8c61b tempest-VolumesSnapshotNegativeTestJSON-1934088382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dc22c4a0-ec75-46ce-aabd-9ca5bd8bff4c.68a52e03-0fac-4089-87d8-98087bfff0b7" returned: 0 in 0.255s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:24 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-2a4ae729-6873-4703-862f-028a59d8c61b tempest-VolumesSnapshotNegativeTestJSON-1934088382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dc22c4a0-ec75-46ce-aabd-9ca5bd8bff4c.info {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:24 devstack sudo[99789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dc22c4a0-ec75-46ce-aabd-9ca5bd8bff4c.info Nov 02 10:16:24 devstack sudo[99789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:24 devstack sudo[99789]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:24 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-2a4ae729-6873-4703-862f-028a59d8c61b tempest-VolumesSnapshotNegativeTestJSON-1934088382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dc22c4a0-ec75-46ce-aabd-9ca5bd8bff4c.info" returned: 0 in 0.253s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:24 devstack cinder-volume[86890]: WARNING cinder.volume.drivers.remotefs [None req-2a4ae729-6873-4703-862f-028a59d8c61b tempest-VolumesSnapshotNegativeTestJSON-1934088382 None] /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dc22c4a0-ec75-46ce-aabd-9ca5bd8bff4c.info is being set with open permissions: ugo+rw Nov 02 10:16:24 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-2a4ae729-6873-4703-862f-028a59d8c61b tempest-VolumesSnapshotNegativeTestJSON-1934088382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dc22c4a0-ec75-46ce-aabd-9ca5bd8bff4c.info {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:24 devstack sudo[99792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dc22c4a0-ec75-46ce-aabd-9ca5bd8bff4c.info Nov 02 10:16:24 devstack sudo[99792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:24 devstack sudo[99792]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:24 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-2a4ae729-6873-4703-862f-028a59d8c61b tempest-VolumesSnapshotNegativeTestJSON-1934088382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dc22c4a0-ec75-46ce-aabd-9ca5bd8bff4c.info" returned: 0 in 0.237s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:24 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-2a4ae729-6873-4703-862f-028a59d8c61b tempest-VolumesSnapshotNegativeTestJSON-1934088382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.035s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:16:24 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-b63a9e8b-464b-4c80-870f-c876d33d3379 tempest-VolumesSnapshotTestJSON-1952456970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.136s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:16:24 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-b63a9e8b-464b-4c80-870f-c876d33d3379 tempest-VolumesSnapshotTestJSON-1952456970 None] Acquiring lock "cinder-quobyte-4cfc7969-9aa8-4b04-adb4-c8366ea57a03-60675a28-386c-49d0-b384-e5d5f6b0a731" by "_create_volume_from_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:16:24 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-b63a9e8b-464b-4c80-870f-c876d33d3379 tempest-VolumesSnapshotTestJSON-1952456970 None] Lock "cinder-quobyte-4cfc7969-9aa8-4b04-adb4-c8366ea57a03-60675a28-386c-49d0-b384-e5d5f6b0a731" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:16:24 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-b63a9e8b-464b-4c80-870f-c876d33d3379 tempest-VolumesSnapshotTestJSON-1952456970 None] Creating volume 60675a28-386c-49d0-b384-e5d5f6b0a731 from snapshot 4cfc7969-9aa8-4b04-adb4-c8366ea57a03 {{(pid=86890) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 02 10:16:24 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-b63a9e8b-464b-4c80-870f-c876d33d3379 tempest-VolumesSnapshotTestJSON-1952456970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:16:24 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-b63a9e8b-464b-4c80-870f-c876d33d3379 tempest-VolumesSnapshotTestJSON-1952456970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:16:24 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-b63a9e8b-464b-4c80-870f-c876d33d3379 tempest-VolumesSnapshotTestJSON-1952456970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:16:24 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-b63a9e8b-464b-4c80-870f-c876d33d3379 tempest-VolumesSnapshotTestJSON-1952456970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:16:24 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-b63a9e8b-464b-4c80-870f-c876d33d3379 tempest-VolumesSnapshotTestJSON-1952456970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:16:24 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-b63a9e8b-464b-4c80-870f-c876d33d3379 tempest-VolumesSnapshotTestJSON-1952456970 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:16:24 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-b63a9e8b-464b-4c80-870f-c876d33d3379 tempest-VolumesSnapshotTestJSON-1952456970 None] Acquiring lock "cinder-quobyte-60675a28-386c-49d0-b384-e5d5f6b0a731" by "_copy_volume_from_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:16:24 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-2a4ae729-6873-4703-862f-028a59d8c61b tempest-VolumesSnapshotNegativeTestJSON-1934088382 None] Create snapshot completed successfully Nov 02 10:16:24 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-b63a9e8b-464b-4c80-870f-c876d33d3379 tempest-VolumesSnapshotTestJSON-1952456970 None] Lock "cinder-quobyte-60675a28-386c-49d0-b384-e5d5f6b0a731" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:16:24 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-b63a9e8b-464b-4c80-870f-c876d33d3379 tempest-VolumesSnapshotTestJSON-1952456970 None] snapshot: 4cfc7969-9aa8-4b04-adb4-c8366ea57a03, volume: 60675a28-386c-49d0-b384-e5d5f6b0a731, {{(pid=86890) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 10:16:24 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-b63a9e8b-464b-4c80-870f-c876d33d3379 tempest-VolumesSnapshotTestJSON-1952456970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:16:24 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-b63a9e8b-464b-4c80-870f-c876d33d3379 tempest-VolumesSnapshotTestJSON-1952456970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:16:24 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-b63a9e8b-464b-4c80-870f-c876d33d3379 tempest-VolumesSnapshotTestJSON-1952456970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:16:24 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-b63a9e8b-464b-4c80-870f-c876d33d3379 tempest-VolumesSnapshotTestJSON-1952456970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:16:24 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-b63a9e8b-464b-4c80-870f-c876d33d3379 tempest-VolumesSnapshotTestJSON-1952456970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:16:25 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4b09ea5-f77c-41da-8e69-b04f5d077272]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:16:25 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-b63a9e8b-464b-4c80-870f-c876d33d3379 tempest-VolumesSnapshotTestJSON-1952456970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-58a515a4-f972-4cf0-bf61-75f1b187e380.4cfc7969-9aa8-4b04-adb4-c8366ea57a03 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:25 devstack sudo[99795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-58a515a4-f972-4cf0-bf61-75f1b187e380.4cfc7969-9aa8-4b04-adb4-c8366ea57a03 Nov 02 10:16:25 devstack sudo[99795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:25 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-f611d7f4-0359-4ac6-8898-87f2483d2d46 tempest-VolumesSnapshotNegativeTestJSON-1934088382 None] Acquiring lock "cinder-68a52e03-0fac-4089-87d8-98087bfff0b7-delete_snapshot" by "delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:16:25 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-f611d7f4-0359-4ac6-8898-87f2483d2d46 tempest-VolumesSnapshotNegativeTestJSON-1934088382 None] Lock "cinder-68a52e03-0fac-4089-87d8-98087bfff0b7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:16:25 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-f611d7f4-0359-4ac6-8898-87f2483d2d46 tempest-VolumesSnapshotNegativeTestJSON-1934088382 None] Acquiring lock "cinder-quobyte-dc22c4a0-ec75-46ce-aabd-9ca5bd8bff4c" by "delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:16:25 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-f611d7f4-0359-4ac6-8898-87f2483d2d46 tempest-VolumesSnapshotNegativeTestJSON-1934088382 None] Lock "cinder-quobyte-dc22c4a0-ec75-46ce-aabd-9ca5bd8bff4c" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:16:25 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-f611d7f4-0359-4ac6-8898-87f2483d2d46 tempest-VolumesSnapshotNegativeTestJSON-1934088382 None] Acquiring lock "cinder-quobyte-68a52e03-0fac-4089-87d8-98087bfff0b7" by "_delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:16:25 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-f611d7f4-0359-4ac6-8898-87f2483d2d46 tempest-VolumesSnapshotNegativeTestJSON-1934088382 None] Lock "cinder-quobyte-68a52e03-0fac-4089-87d8-98087bfff0b7" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:16:25 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-f611d7f4-0359-4ac6-8898-87f2483d2d46 tempest-VolumesSnapshotNegativeTestJSON-1934088382 None] Deleting offline snapshot 68a52e03-0fac-4089-87d8-98087bfff0b7 of volume dc22c4a0-ec75-46ce-aabd-9ca5bd8bff4c {{(pid=86890) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:16:25 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-f611d7f4-0359-4ac6-8898-87f2483d2d46 tempest-VolumesSnapshotNegativeTestJSON-1934088382 None] snapshot_file for this snap is: volume-dc22c4a0-ec75-46ce-aabd-9ca5bd8bff4c.68a52e03-0fac-4089-87d8-98087bfff0b7 {{(pid=86890) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:16:25 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2b513c9-41a6-4287-85ec-fedcef80ffd5]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:16:25 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-f611d7f4-0359-4ac6-8898-87f2483d2d46 tempest-VolumesSnapshotNegativeTestJSON-1934088382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dc22c4a0-ec75-46ce-aabd-9ca5bd8bff4c.68a52e03-0fac-4089-87d8-98087bfff0b7 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:25 devstack sudo[99797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dc22c4a0-ec75-46ce-aabd-9ca5bd8bff4c.68a52e03-0fac-4089-87d8-98087bfff0b7 Nov 02 10:16:25 devstack sudo[99797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:25 devstack sudo[99795]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:25 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-b63a9e8b-464b-4c80-870f-c876d33d3379 tempest-VolumesSnapshotTestJSON-1952456970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-58a515a4-f972-4cf0-bf61-75f1b187e380.4cfc7969-9aa8-4b04-adb4-c8366ea57a03" returned: 0 in 0.386s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:25 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-b63a9e8b-464b-4c80-870f-c876d33d3379 tempest-VolumesSnapshotTestJSON-1952456970 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-58a515a4-f972-4cf0-bf61-75f1b187e380(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86890) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:16:25 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[cde0c3a5-548f-4efb-9d39-b23d039e9b66]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:16:25 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-b63a9e8b-464b-4c80-870f-c876d33d3379 tempest-VolumesSnapshotTestJSON-1952456970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-58a515a4-f972-4cf0-bf61-75f1b187e380 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:25 devstack sudo[99802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-58a515a4-f972-4cf0-bf61-75f1b187e380 Nov 02 10:16:25 devstack sudo[99802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:25 devstack sudo[99797]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:25 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-f611d7f4-0359-4ac6-8898-87f2483d2d46 tempest-VolumesSnapshotNegativeTestJSON-1934088382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dc22c4a0-ec75-46ce-aabd-9ca5bd8bff4c.68a52e03-0fac-4089-87d8-98087bfff0b7" returned: 0 in 0.378s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:25 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-f611d7f4-0359-4ac6-8898-87f2483d2d46 tempest-VolumesSnapshotNegativeTestJSON-1934088382 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dc22c4a0-ec75-46ce-aabd-9ca5bd8bff4c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86890) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:16:25 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[c281cfa8-a782-4a3c-a191-b8b53ed3319a]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:16:25 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-f611d7f4-0359-4ac6-8898-87f2483d2d46 tempest-VolumesSnapshotNegativeTestJSON-1934088382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dc22c4a0-ec75-46ce-aabd-9ca5bd8bff4c {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:25 devstack sudo[99807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dc22c4a0-ec75-46ce-aabd-9ca5bd8bff4c Nov 02 10:16:25 devstack sudo[99807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:25 devstack sudo[99802]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:25 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-b63a9e8b-464b-4c80-870f-c876d33d3379 tempest-VolumesSnapshotTestJSON-1952456970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-58a515a4-f972-4cf0-bf61-75f1b187e380" returned: 0 in 0.373s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:25 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-b63a9e8b-464b-4c80-870f-c876d33d3379 tempest-VolumesSnapshotTestJSON-1952456970 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-58a515a4-f972-4cf0-bf61-75f1b187e380 {{(pid=86890) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 10:16:25 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-b63a9e8b-464b-4c80-870f-c876d33d3379 tempest-VolumesSnapshotTestJSON-1952456970 None] Creating direct copy from snapshot {{(pid=86890) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 10:16:25 devstack cinder-volume[86890]: DEBUG cinder.utils [None req-b63a9e8b-464b-4c80-870f-c876d33d3379 tempest-VolumesSnapshotTestJSON-1952456970 None] Path /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-60675a28-386c-49d0-b384-e5d5f6b0a731 not found in is_blk_device check {{(pid=86890) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 10:16:25 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-b63a9e8b-464b-4c80-870f-c876d33d3379 tempest-VolumesSnapshotTestJSON-1952456970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-58a515a4-f972-4cf0-bf61-75f1b187e380 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-60675a28-386c-49d0-b384-e5d5f6b0a731 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:25 devstack sudo[99812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-58a515a4-f972-4cf0-bf61-75f1b187e380 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-60675a28-386c-49d0-b384-e5d5f6b0a731 Nov 02 10:16:25 devstack sudo[99812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:26 devstack sudo[99807]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:26 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-f611d7f4-0359-4ac6-8898-87f2483d2d46 tempest-VolumesSnapshotNegativeTestJSON-1934088382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dc22c4a0-ec75-46ce-aabd-9ca5bd8bff4c" returned: 0 in 0.367s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:26 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-f611d7f4-0359-4ac6-8898-87f2483d2d46 tempest-VolumesSnapshotNegativeTestJSON-1934088382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dc22c4a0-ec75-46ce-aabd-9ca5bd8bff4c.68a52e03-0fac-4089-87d8-98087bfff0b7 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:26 devstack sudo[99819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dc22c4a0-ec75-46ce-aabd-9ca5bd8bff4c.68a52e03-0fac-4089-87d8-98087bfff0b7 Nov 02 10:16:26 devstack sudo[99819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:26 devstack sudo[99819]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:26 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-f611d7f4-0359-4ac6-8898-87f2483d2d46 tempest-VolumesSnapshotNegativeTestJSON-1934088382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dc22c4a0-ec75-46ce-aabd-9ca5bd8bff4c.68a52e03-0fac-4089-87d8-98087bfff0b7" returned: 0 in 0.493s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:26 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-f611d7f4-0359-4ac6-8898-87f2483d2d46 tempest-VolumesSnapshotNegativeTestJSON-1934088382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dc22c4a0-ec75-46ce-aabd-9ca5bd8bff4c.68a52e03-0fac-4089-87d8-98087bfff0b7 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:26 devstack sudo[99832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dc22c4a0-ec75-46ce-aabd-9ca5bd8bff4c.68a52e03-0fac-4089-87d8-98087bfff0b7 Nov 02 10:16:26 devstack sudo[99832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:27 devstack sudo[99832]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:27 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-f611d7f4-0359-4ac6-8898-87f2483d2d46 tempest-VolumesSnapshotNegativeTestJSON-1934088382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dc22c4a0-ec75-46ce-aabd-9ca5bd8bff4c.68a52e03-0fac-4089-87d8-98087bfff0b7" returned: 0 in 0.542s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:27 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-f611d7f4-0359-4ac6-8898-87f2483d2d46 tempest-VolumesSnapshotNegativeTestJSON-1934088382 None] Lock "cinder-quobyte-68a52e03-0fac-4089-87d8-98087bfff0b7" released by "_delete_snapshot" :: held 1.933s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:16:27 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-f611d7f4-0359-4ac6-8898-87f2483d2d46 tempest-VolumesSnapshotNegativeTestJSON-1934088382 None] Lock "cinder-quobyte-dc22c4a0-ec75-46ce-aabd-9ca5bd8bff4c" released by "delete_snapshot" :: held 1.968s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:16:27 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-f611d7f4-0359-4ac6-8898-87f2483d2d46 tempest-VolumesSnapshotNegativeTestJSON-1934088382 None] Created reservations ['1392835a-d5ac-4cb1-9810-fc9c5afa166b', '081b8a5e-6333-4913-8ffe-5263197f7830', '08c83133-d17f-41c1-8293-84d2197fd754', 'bef6c4c0-167a-4f32-a710-15238d44550e'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:16:27 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-f611d7f4-0359-4ac6-8898-87f2483d2d46 tempest-VolumesSnapshotNegativeTestJSON-1934088382 None] Delete snapshot completed successfully. Nov 02 10:16:27 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-f611d7f4-0359-4ac6-8898-87f2483d2d46 tempest-VolumesSnapshotNegativeTestJSON-1934088382 None] Lock "cinder-68a52e03-0fac-4089-87d8-98087bfff0b7-delete_snapshot" released by "delete_snapshot" :: held 2.212s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:16:28 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-87e13b62-41d8-49b9-a500-0dce703f3093 tempest-VolumesSnapshotNegativeTestJSON-1934088382 None] Acquiring lock "cinder-dc22c4a0-ec75-46ce-aabd-9ca5bd8bff4c-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:16:28 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-87e13b62-41d8-49b9-a500-0dce703f3093 tempest-VolumesSnapshotNegativeTestJSON-1934088382 None] Lock "cinder-dc22c4a0-ec75-46ce-aabd-9ca5bd8bff4c-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:16:28 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-87e13b62-41d8-49b9-a500-0dce703f3093 tempest-VolumesSnapshotNegativeTestJSON-1934088382 None] Acquiring lock "cinder-quobyte-dc22c4a0-ec75-46ce-aabd-9ca5bd8bff4c" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:16:28 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-87e13b62-41d8-49b9-a500-0dce703f3093 tempest-VolumesSnapshotNegativeTestJSON-1934088382 None] Lock "cinder-quobyte-dc22c4a0-ec75-46ce-aabd-9ca5bd8bff4c" acquired by "delete_volume" :: waited 0.040s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:16:28 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c974453-c08e-498d-beeb-d25438d9b535]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:16:28 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-87e13b62-41d8-49b9-a500-0dce703f3093 tempest-VolumesSnapshotNegativeTestJSON-1934088382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dc22c4a0-ec75-46ce-aabd-9ca5bd8bff4c {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:28 devstack sudo[99835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dc22c4a0-ec75-46ce-aabd-9ca5bd8bff4c Nov 02 10:16:28 devstack sudo[99835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:29 devstack sudo[99835]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:29 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-87e13b62-41d8-49b9-a500-0dce703f3093 tempest-VolumesSnapshotNegativeTestJSON-1934088382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dc22c4a0-ec75-46ce-aabd-9ca5bd8bff4c" returned: 0 in 0.760s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:29 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-87e13b62-41d8-49b9-a500-0dce703f3093 tempest-VolumesSnapshotNegativeTestJSON-1934088382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dc22c4a0-ec75-46ce-aabd-9ca5bd8bff4c {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:29 devstack sudo[99840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dc22c4a0-ec75-46ce-aabd-9ca5bd8bff4c Nov 02 10:16:29 devstack sudo[99840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:29 devstack sudo[99840]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:29 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-87e13b62-41d8-49b9-a500-0dce703f3093 tempest-VolumesSnapshotNegativeTestJSON-1934088382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dc22c4a0-ec75-46ce-aabd-9ca5bd8bff4c" returned: 0 in 0.476s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:30 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-87e13b62-41d8-49b9-a500-0dce703f3093 tempest-VolumesSnapshotNegativeTestJSON-1934088382 None] Lock "cinder-quobyte-dc22c4a0-ec75-46ce-aabd-9ca5bd8bff4c" released by "delete_volume" :: held 1.393s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:16:30 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-87e13b62-41d8-49b9-a500-0dce703f3093 tempest-VolumesSnapshotNegativeTestJSON-1934088382 None] Created reservations ['f7cced8b-ae75-4859-a531-47da71fb5fda', '125d959f-c064-4c70-bbac-1bc059fca8e1', '5451bcd9-788e-4b9a-b630-b18d7e3990ba', '6ff12009-bc86-421d-aa71-c7fd9d93f081'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:16:30 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-87e13b62-41d8-49b9-a500-0dce703f3093 tempest-VolumesSnapshotNegativeTestJSON-1934088382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:16:30 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-87e13b62-41d8-49b9-a500-0dce703f3093 tempest-VolumesSnapshotNegativeTestJSON-1934088382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:16:30 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-87e13b62-41d8-49b9-a500-0dce703f3093 tempest-VolumesSnapshotNegativeTestJSON-1934088382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:16:30 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-87e13b62-41d8-49b9-a500-0dce703f3093 tempest-VolumesSnapshotNegativeTestJSON-1934088382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:16:30 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-87e13b62-41d8-49b9-a500-0dce703f3093 tempest-VolumesSnapshotNegativeTestJSON-1934088382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:16:30 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-87e13b62-41d8-49b9-a500-0dce703f3093 tempest-VolumesSnapshotNegativeTestJSON-1934088382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:30 devstack sudo[99843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:16:30 devstack sudo[99843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:30 devstack sudo[99843]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:30 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-87e13b62-41d8-49b9-a500-0dce703f3093 tempest-VolumesSnapshotNegativeTestJSON-1934088382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.437s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:30 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-87e13b62-41d8-49b9-a500-0dce703f3093 tempest-VolumesSnapshotNegativeTestJSON-1934088382 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:16:30 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-87e13b62-41d8-49b9-a500-0dce703f3093 tempest-VolumesSnapshotNegativeTestJSON-1934088382 None] Deleted volume successfully. Nov 02 10:16:30 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-87e13b62-41d8-49b9-a500-0dce703f3093 tempest-VolumesSnapshotNegativeTestJSON-1934088382 None] Lock "cinder-dc22c4a0-ec75-46ce-aabd-9ca5bd8bff4c-delete_volume" released by "delete_volume" :: held 2.252s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:16:32 devstack sudo[99812]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:32 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-b63a9e8b-464b-4c80-870f-c876d33d3379 tempest-VolumesSnapshotTestJSON-1952456970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-58a515a4-f972-4cf0-bf61-75f1b187e380 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-60675a28-386c-49d0-b384-e5d5f6b0a731" returned: 0 in 6.995s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:32 devstack cinder-volume[86890]: DEBUG cinder.image.image_utils [None req-b63a9e8b-464b-4c80-870f-c876d33d3379 tempest-VolumesSnapshotTestJSON-1952456970 None] Image conversion details: src /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-58a515a4-f972-4cf0-bf61-75f1b187e380, size 1024.00 MB, duration 7.00 sec, destination /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-60675a28-386c-49d0-b384-e5d5f6b0a731 {{(pid=86890) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 10:16:32 devstack cinder-volume[86890]: INFO cinder.image.image_utils [None req-b63a9e8b-464b-4c80-870f-c876d33d3379 tempest-VolumesSnapshotTestJSON-1952456970 None] Converted 1024.00 MB image at 146.32 MB/s Nov 02 10:16:32 devstack cinder-volume[86890]: WARNING cinder.volume.drivers.remotefs [None req-b63a9e8b-464b-4c80-870f-c876d33d3379 tempest-VolumesSnapshotTestJSON-1952456970 None] /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-60675a28-386c-49d0-b384-e5d5f6b0a731 is being set with open permissions: ugo+rw Nov 02 10:16:32 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-b63a9e8b-464b-4c80-870f-c876d33d3379 tempest-VolumesSnapshotTestJSON-1952456970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-60675a28-386c-49d0-b384-e5d5f6b0a731 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:32 devstack sudo[99847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-60675a28-386c-49d0-b384-e5d5f6b0a731 Nov 02 10:16:32 devstack sudo[99847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:33 devstack sudo[99847]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:33 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-b63a9e8b-464b-4c80-870f-c876d33d3379 tempest-VolumesSnapshotTestJSON-1952456970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-60675a28-386c-49d0-b384-e5d5f6b0a731" returned: 0 in 0.274s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:33 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-b63a9e8b-464b-4c80-870f-c876d33d3379 tempest-VolumesSnapshotTestJSON-1952456970 None] Lock "cinder-quobyte-60675a28-386c-49d0-b384-e5d5f6b0a731" released by "_copy_volume_from_snapshot" :: held 8.127s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:16:33 devstack cinder-volume[86890]: DEBUG dbcounter [-] [86890] Writing DB stats cinder:DELETE=12,cinder:UPDATE=159,cinder:SELECT=121,cinder:INSERT=29 {{(pid=86890) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:16:33 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-b63a9e8b-464b-4c80-870f-c876d33d3379 tempest-VolumesSnapshotTestJSON-1952456970 None] Lock "cinder-quobyte-4cfc7969-9aa8-4b04-adb4-c8366ea57a03-60675a28-386c-49d0-b384-e5d5f6b0a731" released by "_create_volume_from_snapshot" :: held 8.193s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:16:33 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-b63a9e8b-464b-4c80-870f-c876d33d3379 tempest-VolumesSnapshotTestJSON-1952456970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.218s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:16:33 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-b63a9e8b-464b-4c80-870f-c876d33d3379 tempest-VolumesSnapshotTestJSON-1952456970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c801924c-2222-47b5-8dec-82ef04ce01ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60675a28-386c-49d0-b384-e5d5f6b0a731', 'volume_size': 2, 'snapshot_id': '4cfc7969-9aa8-4b04-adb4-c8366ea57a03'}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:33 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-b63a9e8b-464b-4c80-870f-c876d33d3379 tempest-VolumesSnapshotTestJSON-1952456970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99333345-a50f-4b44-b5db-63b158f39205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:33 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-b63a9e8b-464b-4c80-870f-c876d33d3379 tempest-VolumesSnapshotTestJSON-1952456970 None] Volume volume-60675a28-386c-49d0-b384-e5d5f6b0a731 (60675a28-386c-49d0-b384-e5d5f6b0a731): created successfully Nov 02 10:16:33 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-b63a9e8b-464b-4c80-870f-c876d33d3379 tempest-VolumesSnapshotTestJSON-1952456970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99333345-a50f-4b44-b5db-63b158f39205) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:33 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-b63a9e8b-464b-4c80-870f-c876d33d3379 tempest-VolumesSnapshotTestJSON-1952456970 None] Flow 'volume_create_manager' (f416782a-92dc-4a65-a068-6f63c602a081) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:16:33 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-b63a9e8b-464b-4c80-870f-c876d33d3379 tempest-VolumesSnapshotTestJSON-1952456970 None] Created volume successfully. Nov 02 10:16:33 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-3d9d798a-befb-4b20-8e6a-ae4e0ce089e4 tempest-VolumesSnapshotTestJSON-1952456970 None] Acquiring lock "cinder-60675a28-386c-49d0-b384-e5d5f6b0a731-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:16:33 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-3d9d798a-befb-4b20-8e6a-ae4e0ce089e4 tempest-VolumesSnapshotTestJSON-1952456970 None] Lock "cinder-60675a28-386c-49d0-b384-e5d5f6b0a731-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:16:33 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-3d9d798a-befb-4b20-8e6a-ae4e0ce089e4 tempest-VolumesSnapshotTestJSON-1952456970 None] Acquiring lock "cinder-quobyte-60675a28-386c-49d0-b384-e5d5f6b0a731" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:16:33 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-3d9d798a-befb-4b20-8e6a-ae4e0ce089e4 tempest-VolumesSnapshotTestJSON-1952456970 None] Lock "cinder-quobyte-60675a28-386c-49d0-b384-e5d5f6b0a731" acquired by "delete_volume" :: waited 0.019s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:16:33 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e9f7651-4d1e-4f38-b83f-652fcb93890c]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:16:33 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-3d9d798a-befb-4b20-8e6a-ae4e0ce089e4 tempest-VolumesSnapshotTestJSON-1952456970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-60675a28-386c-49d0-b384-e5d5f6b0a731 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:33 devstack sudo[99853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-60675a28-386c-49d0-b384-e5d5f6b0a731 Nov 02 10:16:33 devstack sudo[99853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:34 devstack sudo[99853]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-3d9d798a-befb-4b20-8e6a-ae4e0ce089e4 tempest-VolumesSnapshotTestJSON-1952456970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-60675a28-386c-49d0-b384-e5d5f6b0a731" returned: 0 in 0.423s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-3d9d798a-befb-4b20-8e6a-ae4e0ce089e4 tempest-VolumesSnapshotTestJSON-1952456970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-60675a28-386c-49d0-b384-e5d5f6b0a731 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:34 devstack sudo[99859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-60675a28-386c-49d0-b384-e5d5f6b0a731 Nov 02 10:16:34 devstack sudo[99859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:34 devstack sudo[99859]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-3d9d798a-befb-4b20-8e6a-ae4e0ce089e4 tempest-VolumesSnapshotTestJSON-1952456970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-60675a28-386c-49d0-b384-e5d5f6b0a731" returned: 0 in 0.276s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:34 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-3d9d798a-befb-4b20-8e6a-ae4e0ce089e4 tempest-VolumesSnapshotTestJSON-1952456970 None] Lock "cinder-quobyte-60675a28-386c-49d0-b384-e5d5f6b0a731" released by "delete_volume" :: held 0.766s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:16:34 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-3d9d798a-befb-4b20-8e6a-ae4e0ce089e4 tempest-VolumesSnapshotTestJSON-1952456970 None] Created reservations ['31ae9d44-da05-41c4-98af-6da4af10ecef', 'c37a4d8a-48f3-409b-9f9e-81a0bc187e8f', '475151a6-539b-42c6-b618-433c5b3375c7', 'dbe64af5-07dd-4213-87d0-6386d9c34b9b'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:16:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-3d9d798a-befb-4b20-8e6a-ae4e0ce089e4 tempest-VolumesSnapshotTestJSON-1952456970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:16:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-3d9d798a-befb-4b20-8e6a-ae4e0ce089e4 tempest-VolumesSnapshotTestJSON-1952456970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:16:34 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-3d9d798a-befb-4b20-8e6a-ae4e0ce089e4 tempest-VolumesSnapshotTestJSON-1952456970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:16:34 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-3d9d798a-befb-4b20-8e6a-ae4e0ce089e4 tempest-VolumesSnapshotTestJSON-1952456970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:16:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-3d9d798a-befb-4b20-8e6a-ae4e0ce089e4 tempest-VolumesSnapshotTestJSON-1952456970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:16:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-3d9d798a-befb-4b20-8e6a-ae4e0ce089e4 tempest-VolumesSnapshotTestJSON-1952456970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:34 devstack sudo[99865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:16:34 devstack sudo[99865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:34 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-13fa6019-4215-4b1b-b14f-3f018d051428 tempest-VolumesSnapshotTestJSON-1952456970 None] Acquiring lock "cinder-4cfc7969-9aa8-4b04-adb4-c8366ea57a03-delete_snapshot" by "delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:16:34 devstack cinder-volume[86890]: DEBUG oslo_service.periodic_task [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86890) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:16:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:16:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:16:34 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:16:34 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:16:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:16:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:34 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-13fa6019-4215-4b1b-b14f-3f018d051428 tempest-VolumesSnapshotTestJSON-1952456970 None] Lock "cinder-4cfc7969-9aa8-4b04-adb4-c8366ea57a03-delete_snapshot" acquired by "delete_snapshot" :: waited 0.067s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:16:34 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-13fa6019-4215-4b1b-b14f-3f018d051428 tempest-VolumesSnapshotTestJSON-1952456970 None] Acquiring lock "cinder-quobyte-58a515a4-f972-4cf0-bf61-75f1b187e380" by "delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:16:34 devstack sudo[99868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:16:34 devstack sudo[99868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:34 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-13fa6019-4215-4b1b-b14f-3f018d051428 tempest-VolumesSnapshotTestJSON-1952456970 None] Lock "cinder-quobyte-58a515a4-f972-4cf0-bf61-75f1b187e380" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:16:34 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-13fa6019-4215-4b1b-b14f-3f018d051428 tempest-VolumesSnapshotTestJSON-1952456970 None] Acquiring lock "cinder-quobyte-4cfc7969-9aa8-4b04-adb4-c8366ea57a03" by "_delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:16:34 devstack sudo[99865]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-3d9d798a-befb-4b20-8e6a-ae4e0ce089e4 tempest-VolumesSnapshotTestJSON-1952456970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.381s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:34 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-3d9d798a-befb-4b20-8e6a-ae4e0ce089e4 tempest-VolumesSnapshotTestJSON-1952456970 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:16:34 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-13fa6019-4215-4b1b-b14f-3f018d051428 tempest-VolumesSnapshotTestJSON-1952456970 None] Lock "cinder-quobyte-4cfc7969-9aa8-4b04-adb4-c8366ea57a03" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:16:34 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-13fa6019-4215-4b1b-b14f-3f018d051428 tempest-VolumesSnapshotTestJSON-1952456970 None] Deleting offline snapshot 4cfc7969-9aa8-4b04-adb4-c8366ea57a03 of volume 58a515a4-f972-4cf0-bf61-75f1b187e380 {{(pid=86890) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:16:35 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-13fa6019-4215-4b1b-b14f-3f018d051428 tempest-VolumesSnapshotTestJSON-1952456970 None] snapshot_file for this snap is: volume-58a515a4-f972-4cf0-bf61-75f1b187e380.4cfc7969-9aa8-4b04-adb4-c8366ea57a03 {{(pid=86890) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:16:35 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-3d9d798a-befb-4b20-8e6a-ae4e0ce089e4 tempest-VolumesSnapshotTestJSON-1952456970 None] Deleted volume successfully. Nov 02 10:16:35 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[4626413d-1c41-43c2-a794-fabc115da3c7]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:16:35 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-3d9d798a-befb-4b20-8e6a-ae4e0ce089e4 tempest-VolumesSnapshotTestJSON-1952456970 None] Lock "cinder-60675a28-386c-49d0-b384-e5d5f6b0a731-delete_volume" released by "delete_volume" :: held 1.505s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:16:35 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-13fa6019-4215-4b1b-b14f-3f018d051428 tempest-VolumesSnapshotTestJSON-1952456970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-58a515a4-f972-4cf0-bf61-75f1b187e380.4cfc7969-9aa8-4b04-adb4-c8366ea57a03 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:35 devstack sudo[99870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-58a515a4-f972-4cf0-bf61-75f1b187e380.4cfc7969-9aa8-4b04-adb4-c8366ea57a03 Nov 02 10:16:35 devstack sudo[99870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:35 devstack sudo[99868]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:35 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.423s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:35 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:16:35 devstack cinder-volume[86890]: DEBUG oslo_service.periodic_task [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Running periodic task VolumeManager._thread_info {{(pid=86890) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:16:35 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] thread count: 29 {{(pid=86890) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:16:35 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] thread info: [<_MainThread(MainThread, started 133913319395456)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86890) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:16:35 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [req-b3a767cd-7922-4dcf-bca0-6501c9ad1ce4 req-1d69a3e1-1108-41ab-9c42-e6c12ad9b5b9 tempest-TestServerVolumeAttachmentScenario-797186756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:16:35 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [req-b3a767cd-7922-4dcf-bca0-6501c9ad1ce4 req-1d69a3e1-1108-41ab-9c42-e6c12ad9b5b9 tempest-TestServerVolumeAttachmentScenario-797186756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:16:35 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [req-b3a767cd-7922-4dcf-bca0-6501c9ad1ce4 req-1d69a3e1-1108-41ab-9c42-e6c12ad9b5b9 tempest-TestServerVolumeAttachmentScenario-797186756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:16:35 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [req-b3a767cd-7922-4dcf-bca0-6501c9ad1ce4 req-1d69a3e1-1108-41ab-9c42-e6c12ad9b5b9 tempest-TestServerVolumeAttachmentScenario-797186756 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67', 'name': 'volume-fac22651-77ef-4699-a672-591630a9a269', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c776e157-375e-4f79-b6dc-5b6a0f555698', 'enforce_multipath': True} {{(pid=86890) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:16:35 devstack cinder-volume[86890]: INFO cinder.volume.manager [req-b3a767cd-7922-4dcf-bca0-6501c9ad1ce4 req-1d69a3e1-1108-41ab-9c42-e6c12ad9b5b9 tempest-TestServerVolumeAttachmentScenario-797186756 None] attachment_update completed successfully. Nov 02 10:16:35 devstack sudo[99870]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:35 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-13fa6019-4215-4b1b-b14f-3f018d051428 tempest-VolumesSnapshotTestJSON-1952456970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-58a515a4-f972-4cf0-bf61-75f1b187e380.4cfc7969-9aa8-4b04-adb4-c8366ea57a03" returned: 0 in 0.499s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:35 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-13fa6019-4215-4b1b-b14f-3f018d051428 tempest-VolumesSnapshotTestJSON-1952456970 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-58a515a4-f972-4cf0-bf61-75f1b187e380(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86890) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:16:35 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7afa329-a9dd-479b-936d-59c5d25cbc38]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:16:35 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-13fa6019-4215-4b1b-b14f-3f018d051428 tempest-VolumesSnapshotTestJSON-1952456970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-58a515a4-f972-4cf0-bf61-75f1b187e380 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:35 devstack sudo[99906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-58a515a4-f972-4cf0-bf61-75f1b187e380 Nov 02 10:16:35 devstack sudo[99906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:36 devstack sudo[99906]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:36 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-13fa6019-4215-4b1b-b14f-3f018d051428 tempest-VolumesSnapshotTestJSON-1952456970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-58a515a4-f972-4cf0-bf61-75f1b187e380" returned: 0 in 0.765s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:36 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-13fa6019-4215-4b1b-b14f-3f018d051428 tempest-VolumesSnapshotTestJSON-1952456970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-58a515a4-f972-4cf0-bf61-75f1b187e380.4cfc7969-9aa8-4b04-adb4-c8366ea57a03 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:36 devstack sudo[100305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-58a515a4-f972-4cf0-bf61-75f1b187e380.4cfc7969-9aa8-4b04-adb4-c8366ea57a03 Nov 02 10:16:36 devstack sudo[100305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:36 devstack sudo[100305]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:36 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-13fa6019-4215-4b1b-b14f-3f018d051428 tempest-VolumesSnapshotTestJSON-1952456970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-58a515a4-f972-4cf0-bf61-75f1b187e380.4cfc7969-9aa8-4b04-adb4-c8366ea57a03" returned: 0 in 0.387s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:36 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-13fa6019-4215-4b1b-b14f-3f018d051428 tempest-VolumesSnapshotTestJSON-1952456970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-58a515a4-f972-4cf0-bf61-75f1b187e380.4cfc7969-9aa8-4b04-adb4-c8366ea57a03 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:36 devstack sudo[100311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-58a515a4-f972-4cf0-bf61-75f1b187e380.4cfc7969-9aa8-4b04-adb4-c8366ea57a03 Nov 02 10:16:36 devstack sudo[100311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:37 devstack sudo[100311]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:37 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-13fa6019-4215-4b1b-b14f-3f018d051428 tempest-VolumesSnapshotTestJSON-1952456970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-58a515a4-f972-4cf0-bf61-75f1b187e380.4cfc7969-9aa8-4b04-adb4-c8366ea57a03" returned: 0 in 0.252s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:37 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-13fa6019-4215-4b1b-b14f-3f018d051428 tempest-VolumesSnapshotTestJSON-1952456970 None] Lock "cinder-quobyte-4cfc7969-9aa8-4b04-adb4-c8366ea57a03" released by "_delete_snapshot" :: held 2.097s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:16:37 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-13fa6019-4215-4b1b-b14f-3f018d051428 tempest-VolumesSnapshotTestJSON-1952456970 None] Lock "cinder-quobyte-58a515a4-f972-4cf0-bf61-75f1b187e380" released by "delete_snapshot" :: held 2.136s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:16:37 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-13fa6019-4215-4b1b-b14f-3f018d051428 tempest-VolumesSnapshotTestJSON-1952456970 None] Created reservations ['237b8962-486e-45e6-9f54-148be14f6739', '896d2702-09fd-4dbb-869c-3e7b28097f9c', 'ffe8d903-686c-4018-9428-0a677890e244', '4b669ca6-6ce8-4a59-a3ed-59e69e435983'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:16:37 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-13fa6019-4215-4b1b-b14f-3f018d051428 tempest-VolumesSnapshotTestJSON-1952456970 None] Delete snapshot completed successfully. Nov 02 10:16:37 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-13fa6019-4215-4b1b-b14f-3f018d051428 tempest-VolumesSnapshotTestJSON-1952456970 None] Lock "cinder-4cfc7969-9aa8-4b04-adb4-c8366ea57a03-delete_snapshot" released by "delete_snapshot" :: held 2.297s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:16:38 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-cd06da22-9c2e-4b42-8102-49123f4213d4 tempest-VolumesSnapshotTestJSON-1952456970 None] Acquiring lock "cinder-58a515a4-f972-4cf0-bf61-75f1b187e380-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:16:38 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-cd06da22-9c2e-4b42-8102-49123f4213d4 tempest-VolumesSnapshotTestJSON-1952456970 None] Lock "cinder-58a515a4-f972-4cf0-bf61-75f1b187e380-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:16:38 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-cd06da22-9c2e-4b42-8102-49123f4213d4 tempest-VolumesSnapshotTestJSON-1952456970 None] Acquiring lock "cinder-quobyte-58a515a4-f972-4cf0-bf61-75f1b187e380" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:16:38 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-cd06da22-9c2e-4b42-8102-49123f4213d4 tempest-VolumesSnapshotTestJSON-1952456970 None] Lock "cinder-quobyte-58a515a4-f972-4cf0-bf61-75f1b187e380" acquired by "delete_volume" :: waited 0.020s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:16:38 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[c354f3d9-5581-4b11-a677-30bc64aec72e]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:16:38 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-cd06da22-9c2e-4b42-8102-49123f4213d4 tempest-VolumesSnapshotTestJSON-1952456970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-58a515a4-f972-4cf0-bf61-75f1b187e380 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:38 devstack sudo[100314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-58a515a4-f972-4cf0-bf61-75f1b187e380 Nov 02 10:16:38 devstack sudo[100314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:38 devstack sudo[100314]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:38 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-cd06da22-9c2e-4b42-8102-49123f4213d4 tempest-VolumesSnapshotTestJSON-1952456970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-58a515a4-f972-4cf0-bf61-75f1b187e380" returned: 0 in 0.457s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:38 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-cd06da22-9c2e-4b42-8102-49123f4213d4 tempest-VolumesSnapshotTestJSON-1952456970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-58a515a4-f972-4cf0-bf61-75f1b187e380 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:38 devstack sudo[100319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-58a515a4-f972-4cf0-bf61-75f1b187e380 Nov 02 10:16:38 devstack sudo[100319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:39 devstack sudo[100319]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:39 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-cd06da22-9c2e-4b42-8102-49123f4213d4 tempest-VolumesSnapshotTestJSON-1952456970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-58a515a4-f972-4cf0-bf61-75f1b187e380" returned: 0 in 0.332s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:39 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-cd06da22-9c2e-4b42-8102-49123f4213d4 tempest-VolumesSnapshotTestJSON-1952456970 None] Lock "cinder-quobyte-58a515a4-f972-4cf0-bf61-75f1b187e380" released by "delete_volume" :: held 0.865s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:16:39 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-cd06da22-9c2e-4b42-8102-49123f4213d4 tempest-VolumesSnapshotTestJSON-1952456970 None] Created reservations ['4b37a865-221e-4f0d-a15c-1b3ecca851f3', 'dcc88b9a-3619-4cf2-bdd6-cf1771b5a177', '430a443c-fbea-454e-940c-9ea2e8e0bb2c', '537f361a-e254-4173-b413-a3c72b4d3d4f'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:16:39 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-cd06da22-9c2e-4b42-8102-49123f4213d4 tempest-VolumesSnapshotTestJSON-1952456970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:16:39 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-cd06da22-9c2e-4b42-8102-49123f4213d4 tempest-VolumesSnapshotTestJSON-1952456970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:16:39 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-cd06da22-9c2e-4b42-8102-49123f4213d4 tempest-VolumesSnapshotTestJSON-1952456970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:16:39 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-cd06da22-9c2e-4b42-8102-49123f4213d4 tempest-VolumesSnapshotTestJSON-1952456970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:16:39 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-cd06da22-9c2e-4b42-8102-49123f4213d4 tempest-VolumesSnapshotTestJSON-1952456970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:16:39 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-cd06da22-9c2e-4b42-8102-49123f4213d4 tempest-VolumesSnapshotTestJSON-1952456970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:39 devstack sudo[100322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:16:39 devstack sudo[100322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:39 devstack sudo[100322]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:39 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-cd06da22-9c2e-4b42-8102-49123f4213d4 tempest-VolumesSnapshotTestJSON-1952456970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.311s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:39 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-cd06da22-9c2e-4b42-8102-49123f4213d4 tempest-VolumesSnapshotTestJSON-1952456970 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:16:39 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-cd06da22-9c2e-4b42-8102-49123f4213d4 tempest-VolumesSnapshotTestJSON-1952456970 None] Deleted volume successfully. Nov 02 10:16:39 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-cd06da22-9c2e-4b42-8102-49123f4213d4 tempest-VolumesSnapshotTestJSON-1952456970 None] Lock "cinder-58a515a4-f972-4cf0-bf61-75f1b187e380-delete_volume" released by "delete_volume" :: held 1.475s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:16:40 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-d80b98aa-be59-41ba-a4d0-677077b22fdb tempest-VolumesSnapshotTestJSON-1952456970 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:16:40 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-d80b98aa-be59-41ba-a4d0-677077b22fdb tempest-VolumesSnapshotTestJSON-1952456970 None] Flow 'volume_create_manager' (ba316e43-49a3-4614-9d55-10ca601a8f9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:16:40 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-d80b98aa-be59-41ba-a4d0-677077b22fdb tempest-VolumesSnapshotTestJSON-1952456970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9282ee46-d41b-4a98-82e5-15bfe2477bd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:40 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-d80b98aa-be59-41ba-a4d0-677077b22fdb tempest-VolumesSnapshotTestJSON-1952456970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9282ee46-d41b-4a98-82e5-15bfe2477bd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:16:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2013588264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=feb717f7-9986-4bb6-bf9b-b614d399b259,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f0cc30a11e44c8294d8872570bdc5f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:16:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:16:40Z,use_quota=True,user_id='959cfb1854eb4418aa6d558022bda4ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:40 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-d80b98aa-be59-41ba-a4d0-677077b22fdb tempest-VolumesSnapshotTestJSON-1952456970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d76b656b-3950-4af6-87fa-2c447d9b6f3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:40 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-d80b98aa-be59-41ba-a4d0-677077b22fdb tempest-VolumesSnapshotTestJSON-1952456970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d76b656b-3950-4af6-87fa-2c447d9b6f3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:40 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-d80b98aa-be59-41ba-a4d0-677077b22fdb tempest-VolumesSnapshotTestJSON-1952456970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2670842b-3d1b-44aa-a0c5-ed5b342dc4d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:40 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-d80b98aa-be59-41ba-a4d0-677077b22fdb tempest-VolumesSnapshotTestJSON-1952456970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2670842b-3d1b-44aa-a0c5-ed5b342dc4d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'feb717f7-9986-4bb6-bf9b-b614d399b259', 'volume_name': 'volume-feb717f7-9986-4bb6-bf9b-b614d399b259', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:40 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-d80b98aa-be59-41ba-a4d0-677077b22fdb tempest-VolumesSnapshotTestJSON-1952456970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fed6e160-1229-4ebd-864d-7f198f2a7202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:40 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-d80b98aa-be59-41ba-a4d0-677077b22fdb tempest-VolumesSnapshotTestJSON-1952456970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fed6e160-1229-4ebd-864d-7f198f2a7202) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:40 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-d80b98aa-be59-41ba-a4d0-677077b22fdb tempest-VolumesSnapshotTestJSON-1952456970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ba34a72-44a9-4032-a40c-b2562e33afac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:40 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-d80b98aa-be59-41ba-a4d0-677077b22fdb tempest-VolumesSnapshotTestJSON-1952456970 None] Volume feb717f7-9986-4bb6-bf9b-b614d399b259: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-feb717f7-9986-4bb6-bf9b-b614d399b259', 'volume_size': 1} Nov 02 10:16:40 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-d80b98aa-be59-41ba-a4d0-677077b22fdb tempest-VolumesSnapshotTestJSON-1952456970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:16:40 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-d80b98aa-be59-41ba-a4d0-677077b22fdb tempest-VolumesSnapshotTestJSON-1952456970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:16:40 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-d80b98aa-be59-41ba-a4d0-677077b22fdb tempest-VolumesSnapshotTestJSON-1952456970 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:16:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2013588264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=feb717f7-9986-4bb6-bf9b-b614d399b259,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f0cc30a11e44c8294d8872570bdc5f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:16:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:16:40Z,use_quota=True,user_id='959cfb1854eb4418aa6d558022bda4ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:16:40 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-d80b98aa-be59-41ba-a4d0-677077b22fdb tempest-VolumesSnapshotTestJSON-1952456970 None] Creating volume feb717f7-9986-4bb6-bf9b-b614d399b259 {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:16:40 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-d80b98aa-be59-41ba-a4d0-677077b22fdb tempest-VolumesSnapshotTestJSON-1952456970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:16:40 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-d80b98aa-be59-41ba-a4d0-677077b22fdb tempest-VolumesSnapshotTestJSON-1952456970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:16:40 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-d80b98aa-be59-41ba-a4d0-677077b22fdb tempest-VolumesSnapshotTestJSON-1952456970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:16:40 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-d80b98aa-be59-41ba-a4d0-677077b22fdb tempest-VolumesSnapshotTestJSON-1952456970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:16:40 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-d80b98aa-be59-41ba-a4d0-677077b22fdb tempest-VolumesSnapshotTestJSON-1952456970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:16:40 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-d80b98aa-be59-41ba-a4d0-677077b22fdb tempest-VolumesSnapshotTestJSON-1952456970 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:16:40 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-d80b98aa-be59-41ba-a4d0-677077b22fdb tempest-VolumesSnapshotTestJSON-1952456970 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:16:40 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-d80b98aa-be59-41ba-a4d0-677077b22fdb tempest-VolumesSnapshotTestJSON-1952456970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-feb717f7-9986-4bb6-bf9b-b614d399b259 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:40 devstack sudo[100327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-feb717f7-9986-4bb6-bf9b-b614d399b259 1073741824 Nov 02 10:16:40 devstack sudo[100327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:40 devstack sudo[100327]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:40 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-d80b98aa-be59-41ba-a4d0-677077b22fdb tempest-VolumesSnapshotTestJSON-1952456970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-feb717f7-9986-4bb6-bf9b-b614d399b259 1073741824" returned: 0 in 0.726s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:40 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-d80b98aa-be59-41ba-a4d0-677077b22fdb tempest-VolumesSnapshotTestJSON-1952456970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-feb717f7-9986-4bb6-bf9b-b614d399b259 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:40 devstack sudo[100341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-feb717f7-9986-4bb6-bf9b-b614d399b259 Nov 02 10:16:40 devstack sudo[100341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:41 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [req-ea8e3cfb-d84c-49dd-9a39-e64323cbcab2 req-7382541b-d3f3-42ec-bb25-9be6ce559067 tempest-TestServerVolumeAttachmentScenario-797186756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:16:41 devstack sudo[100341]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:41 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-d80b98aa-be59-41ba-a4d0-677077b22fdb tempest-VolumesSnapshotTestJSON-1952456970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-feb717f7-9986-4bb6-bf9b-b614d399b259" returned: 0 in 0.306s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:41 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-d80b98aa-be59-41ba-a4d0-677077b22fdb tempest-VolumesSnapshotTestJSON-1952456970 None] <== create_volume: return (1101ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:16:41 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-d80b98aa-be59-41ba-a4d0-677077b22fdb tempest-VolumesSnapshotTestJSON-1952456970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.104s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:16:41 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [req-ea8e3cfb-d84c-49dd-9a39-e64323cbcab2 req-7382541b-d3f3-42ec-bb25-9be6ce559067 tempest-TestServerVolumeAttachmentScenario-797186756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.110s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:16:41 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-d80b98aa-be59-41ba-a4d0-677077b22fdb tempest-VolumesSnapshotTestJSON-1952456970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ba34a72-44a9-4032-a40c-b2562e33afac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-feb717f7-9986-4bb6-bf9b-b614d399b259', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:41 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-d80b98aa-be59-41ba-a4d0-677077b22fdb tempest-VolumesSnapshotTestJSON-1952456970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1400e93d-6ff0-48fa-ad3e-d9b4ba384388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:41 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [req-ea8e3cfb-d84c-49dd-9a39-e64323cbcab2 req-7382541b-d3f3-42ec-bb25-9be6ce559067 tempest-TestServerVolumeAttachmentScenario-797186756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:16:41 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-d80b98aa-be59-41ba-a4d0-677077b22fdb tempest-VolumesSnapshotTestJSON-1952456970 None] Volume volume-feb717f7-9986-4bb6-bf9b-b614d399b259 (feb717f7-9986-4bb6-bf9b-b614d399b259): created successfully Nov 02 10:16:41 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-d80b98aa-be59-41ba-a4d0-677077b22fdb tempest-VolumesSnapshotTestJSON-1952456970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1400e93d-6ff0-48fa-ad3e-d9b4ba384388) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:41 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-d80b98aa-be59-41ba-a4d0-677077b22fdb tempest-VolumesSnapshotTestJSON-1952456970 None] Flow 'volume_create_manager' (ba316e43-49a3-4614-9d55-10ca601a8f9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:16:41 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-d80b98aa-be59-41ba-a4d0-677077b22fdb tempest-VolumesSnapshotTestJSON-1952456970 None] Created volume successfully. Nov 02 10:16:41 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [req-ea8e3cfb-d84c-49dd-9a39-e64323cbcab2 req-7382541b-d3f3-42ec-bb25-9be6ce559067 tempest-TestServerVolumeAttachmentScenario-797186756 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67', 'name': 'volume-0327f29c-175c-45da-ae49-cf93395c03c7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0b3a8669-f6ae-4215-a340-96599a3990b2', 'enforce_multipath': True} {{(pid=86890) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:16:41 devstack cinder-volume[86890]: INFO cinder.volume.manager [req-ea8e3cfb-d84c-49dd-9a39-e64323cbcab2 req-7382541b-d3f3-42ec-bb25-9be6ce559067 tempest-TestServerVolumeAttachmentScenario-797186756 None] attachment_update completed successfully. Nov 02 10:16:42 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-003b0df3-aca9-445a-b5f9-0bfd43b4e646 tempest-VolumesSnapshotTestJSON-1952456970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:16:42 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-003b0df3-aca9-445a-b5f9-0bfd43b4e646 tempest-VolumesSnapshotTestJSON-1952456970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:16:42 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-003b0df3-aca9-445a-b5f9-0bfd43b4e646 tempest-VolumesSnapshotTestJSON-1952456970 None] Creating offline snapshot 67206265-0748-4b35-9c35-ad4db835d771 of volume feb717f7-9986-4bb6-bf9b-b614d399b259 {{(pid=86890) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:16:42 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[b536912a-6814-4833-9438-2f3b608f46df]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:16:42 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-003b0df3-aca9-445a-b5f9-0bfd43b4e646 tempest-VolumesSnapshotTestJSON-1952456970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-feb717f7-9986-4bb6-bf9b-b614d399b259 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:42 devstack sudo[100348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-feb717f7-9986-4bb6-bf9b-b614d399b259 Nov 02 10:16:42 devstack sudo[100348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:42 devstack sudo[100348]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:42 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-003b0df3-aca9-445a-b5f9-0bfd43b4e646 tempest-VolumesSnapshotTestJSON-1952456970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-feb717f7-9986-4bb6-bf9b-b614d399b259" returned: 0 in 0.411s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:42 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-003b0df3-aca9-445a-b5f9-0bfd43b4e646 tempest-VolumesSnapshotTestJSON-1952456970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-feb717f7-9986-4bb6-bf9b-b614d399b259,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-feb717f7-9986-4bb6-bf9b-b614d399b259.67206265-0748-4b35-9c35-ad4db835d771 1G {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:43 devstack sudo[100354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-feb717f7-9986-4bb6-bf9b-b614d399b259,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-feb717f7-9986-4bb6-bf9b-b614d399b259.67206265-0748-4b35-9c35-ad4db835d771 1G Nov 02 10:16:43 devstack sudo[100354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:43 devstack sudo[100354]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:43 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-003b0df3-aca9-445a-b5f9-0bfd43b4e646 tempest-VolumesSnapshotTestJSON-1952456970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-feb717f7-9986-4bb6-bf9b-b614d399b259,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-feb717f7-9986-4bb6-bf9b-b614d399b259.67206265-0748-4b35-9c35-ad4db835d771 1G" returned: 0 in 0.575s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:43 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-003b0df3-aca9-445a-b5f9-0bfd43b4e646 tempest-VolumesSnapshotTestJSON-1952456970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-feb717f7-9986-4bb6-bf9b-b614d399b259 -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-feb717f7-9986-4bb6-bf9b-b614d399b259.67206265-0748-4b35-9c35-ad4db835d771 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:43 devstack sudo[100360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-feb717f7-9986-4bb6-bf9b-b614d399b259 -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-feb717f7-9986-4bb6-bf9b-b614d399b259.67206265-0748-4b35-9c35-ad4db835d771 Nov 02 10:16:43 devstack sudo[100360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:43 devstack sudo[100360]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:43 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-003b0df3-aca9-445a-b5f9-0bfd43b4e646 tempest-VolumesSnapshotTestJSON-1952456970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-feb717f7-9986-4bb6-bf9b-b614d399b259 -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-feb717f7-9986-4bb6-bf9b-b614d399b259.67206265-0748-4b35-9c35-ad4db835d771" returned: 0 in 0.338s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:43 devstack cinder-volume[86890]: WARNING cinder.volume.drivers.remotefs [None req-003b0df3-aca9-445a-b5f9-0bfd43b4e646 tempest-VolumesSnapshotTestJSON-1952456970 None] /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-feb717f7-9986-4bb6-bf9b-b614d399b259.67206265-0748-4b35-9c35-ad4db835d771 is being set with open permissions: ugo+rw Nov 02 10:16:43 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-003b0df3-aca9-445a-b5f9-0bfd43b4e646 tempest-VolumesSnapshotTestJSON-1952456970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-feb717f7-9986-4bb6-bf9b-b614d399b259.67206265-0748-4b35-9c35-ad4db835d771 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:43 devstack cinder-volume[86890]: INFO cinder.volume.manager [req-bc1e36f3-7130-433f-932d-86e773d499f1 req-4fc5c97c-4c86-4fae-9a45-54a3edb1bb2c tempest-TestServerVolumeAttachmentScenario-797186756 None] Terminate volume connection completed successfully. Nov 02 10:16:43 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [req-bc1e36f3-7130-433f-932d-86e773d499f1 req-4fc5c97c-4c86-4fae-9a45-54a3edb1bb2c tempest-TestServerVolumeAttachmentScenario-797186756 None] Deleting attachment 0b3a8669-f6ae-4215-a340-96599a3990b2. {{(pid=86890) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:16:43 devstack sudo[100368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-feb717f7-9986-4bb6-bf9b-b614d399b259.67206265-0748-4b35-9c35-ad4db835d771 Nov 02 10:16:43 devstack sudo[100368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:44 devstack sudo[100368]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:44 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-003b0df3-aca9-445a-b5f9-0bfd43b4e646 tempest-VolumesSnapshotTestJSON-1952456970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-feb717f7-9986-4bb6-bf9b-b614d399b259.67206265-0748-4b35-9c35-ad4db835d771" returned: 0 in 0.325s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:44 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-003b0df3-aca9-445a-b5f9-0bfd43b4e646 tempest-VolumesSnapshotTestJSON-1952456970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-feb717f7-9986-4bb6-bf9b-b614d399b259.info {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:44 devstack sudo[100371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-feb717f7-9986-4bb6-bf9b-b614d399b259.info Nov 02 10:16:44 devstack sudo[100371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:44 devstack sudo[100371]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:44 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-003b0df3-aca9-445a-b5f9-0bfd43b4e646 tempest-VolumesSnapshotTestJSON-1952456970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-feb717f7-9986-4bb6-bf9b-b614d399b259.info" returned: 0 in 0.264s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:44 devstack cinder-volume[86890]: WARNING cinder.volume.drivers.remotefs [None req-003b0df3-aca9-445a-b5f9-0bfd43b4e646 tempest-VolumesSnapshotTestJSON-1952456970 None] /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-feb717f7-9986-4bb6-bf9b-b614d399b259.info is being set with open permissions: ugo+rw Nov 02 10:16:44 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-003b0df3-aca9-445a-b5f9-0bfd43b4e646 tempest-VolumesSnapshotTestJSON-1952456970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-feb717f7-9986-4bb6-bf9b-b614d399b259.info {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:44 devstack sudo[100374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-feb717f7-9986-4bb6-bf9b-b614d399b259.info Nov 02 10:16:44 devstack sudo[100374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:44 devstack sudo[100374]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:44 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-003b0df3-aca9-445a-b5f9-0bfd43b4e646 tempest-VolumesSnapshotTestJSON-1952456970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-feb717f7-9986-4bb6-bf9b-b614d399b259.info" returned: 0 in 0.304s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:44 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-003b0df3-aca9-445a-b5f9-0bfd43b4e646 tempest-VolumesSnapshotTestJSON-1952456970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.392s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:16:44 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-003b0df3-aca9-445a-b5f9-0bfd43b4e646 tempest-VolumesSnapshotTestJSON-1952456970 None] Create snapshot completed successfully Nov 02 10:16:45 devstack cinder-volume[86890]: INFO cinder.volume.manager [req-4a5bb1ad-135e-4bb4-b920-c45b600f70d1 req-4fba2f0f-13cf-4a61-b046-a21ea920f18b tempest-TestServerVolumeAttachmentScenario-797186756 None] Terminate volume connection completed successfully. Nov 02 10:16:45 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [req-4a5bb1ad-135e-4bb4-b920-c45b600f70d1 req-4fba2f0f-13cf-4a61-b046-a21ea920f18b tempest-TestServerVolumeAttachmentScenario-797186756 None] Deleting attachment c776e157-375e-4f79-b6dc-5b6a0f555698. {{(pid=86890) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:16:46 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-9dae5211-8e72-4d5b-a5cf-8d69d6eef70d tempest-VolumesSnapshotTestJSON-1952456970 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:16:46 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-9dae5211-8e72-4d5b-a5cf-8d69d6eef70d tempest-VolumesSnapshotTestJSON-1952456970 None] Flow 'volume_create_manager' (997aec7c-0556-450c-b352-14ecce39d474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:16:46 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-9dae5211-8e72-4d5b-a5cf-8d69d6eef70d tempest-VolumesSnapshotTestJSON-1952456970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8333b002-c6bd-44fc-83aa-595d1029a1fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:46 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-9dae5211-8e72-4d5b-a5cf-8d69d6eef70d tempest-VolumesSnapshotTestJSON-1952456970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8333b002-c6bd-44fc-83aa-595d1029a1fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:16:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1293499479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4a59227-e909-4326-b316-51ef27ce5f82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f0cc30a11e44c8294d8872570bdc5f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:16:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=67206265-0748-4b35-9c35-ad4db835d771,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:16:46Z,use_quota=True,user_id='959cfb1854eb4418aa6d558022bda4ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:46 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-9dae5211-8e72-4d5b-a5cf-8d69d6eef70d tempest-VolumesSnapshotTestJSON-1952456970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c3cb28c-2f46-4aeb-b4f9-3167d74fba2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:46 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-9dae5211-8e72-4d5b-a5cf-8d69d6eef70d tempest-VolumesSnapshotTestJSON-1952456970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c3cb28c-2f46-4aeb-b4f9-3167d74fba2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:46 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-9dae5211-8e72-4d5b-a5cf-8d69d6eef70d tempest-VolumesSnapshotTestJSON-1952456970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6dcc498-fc59-4b39-8f9f-8e31f20ae86f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:46 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-9dae5211-8e72-4d5b-a5cf-8d69d6eef70d tempest-VolumesSnapshotTestJSON-1952456970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6dcc498-fc59-4b39-8f9f-8e31f20ae86f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f4a59227-e909-4326-b316-51ef27ce5f82', 'volume_name': 'volume-f4a59227-e909-4326-b316-51ef27ce5f82', 'volume_size': 1, 'snapshot_id': '67206265-0748-4b35-9c35-ad4db835d771'}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:46 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-9dae5211-8e72-4d5b-a5cf-8d69d6eef70d tempest-VolumesSnapshotTestJSON-1952456970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29ce5051-afd0-4c71-a5b0-b27ea8043039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:46 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-9dae5211-8e72-4d5b-a5cf-8d69d6eef70d tempest-VolumesSnapshotTestJSON-1952456970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29ce5051-afd0-4c71-a5b0-b27ea8043039) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:46 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-9dae5211-8e72-4d5b-a5cf-8d69d6eef70d tempest-VolumesSnapshotTestJSON-1952456970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40ba93cd-262a-4874-ace4-a6f5234a542a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:46 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-9dae5211-8e72-4d5b-a5cf-8d69d6eef70d tempest-VolumesSnapshotTestJSON-1952456970 None] Volume f4a59227-e909-4326-b316-51ef27ce5f82: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f4a59227-e909-4326-b316-51ef27ce5f82', 'volume_size': 1, 'snapshot_id': '67206265-0748-4b35-9c35-ad4db835d771'} Nov 02 10:16:46 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-9dae5211-8e72-4d5b-a5cf-8d69d6eef70d tempest-VolumesSnapshotTestJSON-1952456970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:16:46 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-9dae5211-8e72-4d5b-a5cf-8d69d6eef70d tempest-VolumesSnapshotTestJSON-1952456970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:16:46 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-9dae5211-8e72-4d5b-a5cf-8d69d6eef70d tempest-VolumesSnapshotTestJSON-1952456970 None] Acquiring lock "cinder-quobyte-67206265-0748-4b35-9c35-ad4db835d771-f4a59227-e909-4326-b316-51ef27ce5f82" by "_create_volume_from_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:16:46 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-9dae5211-8e72-4d5b-a5cf-8d69d6eef70d tempest-VolumesSnapshotTestJSON-1952456970 None] Lock "cinder-quobyte-67206265-0748-4b35-9c35-ad4db835d771-f4a59227-e909-4326-b316-51ef27ce5f82" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:16:46 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-9dae5211-8e72-4d5b-a5cf-8d69d6eef70d tempest-VolumesSnapshotTestJSON-1952456970 None] Creating volume f4a59227-e909-4326-b316-51ef27ce5f82 from snapshot 67206265-0748-4b35-9c35-ad4db835d771 {{(pid=86890) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 02 10:16:46 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-9dae5211-8e72-4d5b-a5cf-8d69d6eef70d tempest-VolumesSnapshotTestJSON-1952456970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:16:46 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-9dae5211-8e72-4d5b-a5cf-8d69d6eef70d tempest-VolumesSnapshotTestJSON-1952456970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:16:46 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-9dae5211-8e72-4d5b-a5cf-8d69d6eef70d tempest-VolumesSnapshotTestJSON-1952456970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:16:46 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-9dae5211-8e72-4d5b-a5cf-8d69d6eef70d tempest-VolumesSnapshotTestJSON-1952456970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:16:46 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-9dae5211-8e72-4d5b-a5cf-8d69d6eef70d tempest-VolumesSnapshotTestJSON-1952456970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:16:46 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-9dae5211-8e72-4d5b-a5cf-8d69d6eef70d tempest-VolumesSnapshotTestJSON-1952456970 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:16:46 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-9dae5211-8e72-4d5b-a5cf-8d69d6eef70d tempest-VolumesSnapshotTestJSON-1952456970 None] Acquiring lock "cinder-quobyte-f4a59227-e909-4326-b316-51ef27ce5f82" by "_copy_volume_from_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:16:46 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-9dae5211-8e72-4d5b-a5cf-8d69d6eef70d tempest-VolumesSnapshotTestJSON-1952456970 None] Lock "cinder-quobyte-f4a59227-e909-4326-b316-51ef27ce5f82" acquired by "_copy_volume_from_snapshot" :: waited 0.035s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:16:46 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-9dae5211-8e72-4d5b-a5cf-8d69d6eef70d tempest-VolumesSnapshotTestJSON-1952456970 None] snapshot: 67206265-0748-4b35-9c35-ad4db835d771, volume: f4a59227-e909-4326-b316-51ef27ce5f82, {{(pid=86890) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 10:16:46 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-9dae5211-8e72-4d5b-a5cf-8d69d6eef70d tempest-VolumesSnapshotTestJSON-1952456970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:16:46 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-9dae5211-8e72-4d5b-a5cf-8d69d6eef70d tempest-VolumesSnapshotTestJSON-1952456970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:16:46 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-9dae5211-8e72-4d5b-a5cf-8d69d6eef70d tempest-VolumesSnapshotTestJSON-1952456970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:16:46 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-9dae5211-8e72-4d5b-a5cf-8d69d6eef70d tempest-VolumesSnapshotTestJSON-1952456970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:16:46 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-9dae5211-8e72-4d5b-a5cf-8d69d6eef70d tempest-VolumesSnapshotTestJSON-1952456970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:16:46 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bf94863-d792-4061-a3fc-7483428e4465]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:16:46 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-9dae5211-8e72-4d5b-a5cf-8d69d6eef70d tempest-VolumesSnapshotTestJSON-1952456970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-feb717f7-9986-4bb6-bf9b-b614d399b259.67206265-0748-4b35-9c35-ad4db835d771 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:46 devstack sudo[100404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-feb717f7-9986-4bb6-bf9b-b614d399b259.67206265-0748-4b35-9c35-ad4db835d771 Nov 02 10:16:46 devstack sudo[100404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:47 devstack sudo[100404]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:47 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-9dae5211-8e72-4d5b-a5cf-8d69d6eef70d tempest-VolumesSnapshotTestJSON-1952456970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-feb717f7-9986-4bb6-bf9b-b614d399b259.67206265-0748-4b35-9c35-ad4db835d771" returned: 0 in 0.623s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:47 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-9dae5211-8e72-4d5b-a5cf-8d69d6eef70d tempest-VolumesSnapshotTestJSON-1952456970 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-feb717f7-9986-4bb6-bf9b-b614d399b259(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86890) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:16:47 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e667ed2-6670-4f74-94f7-dc5e7895bb11]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:16:47 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-9dae5211-8e72-4d5b-a5cf-8d69d6eef70d tempest-VolumesSnapshotTestJSON-1952456970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-feb717f7-9986-4bb6-bf9b-b614d399b259 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:47 devstack sudo[100430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-feb717f7-9986-4bb6-bf9b-b614d399b259 Nov 02 10:16:47 devstack sudo[100430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:47 devstack sudo[100430]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:47 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-9dae5211-8e72-4d5b-a5cf-8d69d6eef70d tempest-VolumesSnapshotTestJSON-1952456970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-feb717f7-9986-4bb6-bf9b-b614d399b259" returned: 0 in 0.453s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:47 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-9dae5211-8e72-4d5b-a5cf-8d69d6eef70d tempest-VolumesSnapshotTestJSON-1952456970 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-feb717f7-9986-4bb6-bf9b-b614d399b259 {{(pid=86890) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 10:16:47 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-9dae5211-8e72-4d5b-a5cf-8d69d6eef70d tempest-VolumesSnapshotTestJSON-1952456970 None] Creating direct copy from snapshot {{(pid=86890) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 10:16:47 devstack cinder-volume[86890]: DEBUG cinder.utils [None req-9dae5211-8e72-4d5b-a5cf-8d69d6eef70d tempest-VolumesSnapshotTestJSON-1952456970 None] Path /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-f4a59227-e909-4326-b316-51ef27ce5f82 not found in is_blk_device check {{(pid=86890) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 10:16:47 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-9dae5211-8e72-4d5b-a5cf-8d69d6eef70d tempest-VolumesSnapshotTestJSON-1952456970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-feb717f7-9986-4bb6-bf9b-b614d399b259 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-f4a59227-e909-4326-b316-51ef27ce5f82 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:47 devstack sudo[100436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-feb717f7-9986-4bb6-bf9b-b614d399b259 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-f4a59227-e909-4326-b316-51ef27ce5f82 Nov 02 10:16:47 devstack sudo[100436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:54 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-da6a403d-e97f-4755-93f0-4657bd9874f6 tempest-TestServerVolumeAttachmentScenario-797186756 None] Acquiring lock "cinder-0327f29c-175c-45da-ae49-cf93395c03c7-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:16:54 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-da6a403d-e97f-4755-93f0-4657bd9874f6 tempest-TestServerVolumeAttachmentScenario-797186756 None] Lock "cinder-0327f29c-175c-45da-ae49-cf93395c03c7-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:16:54 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-da6a403d-e97f-4755-93f0-4657bd9874f6 tempest-TestServerVolumeAttachmentScenario-797186756 None] Acquiring lock "cinder-quobyte-0327f29c-175c-45da-ae49-cf93395c03c7" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:16:54 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-da6a403d-e97f-4755-93f0-4657bd9874f6 tempest-TestServerVolumeAttachmentScenario-797186756 None] Lock "cinder-quobyte-0327f29c-175c-45da-ae49-cf93395c03c7" acquired by "delete_volume" :: waited 0.043s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:16:54 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[03d128ce-8710-47a8-9269-2d694f05cac6]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:16:54 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-da6a403d-e97f-4755-93f0-4657bd9874f6 tempest-TestServerVolumeAttachmentScenario-797186756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-0327f29c-175c-45da-ae49-cf93395c03c7 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:54 devstack sudo[100454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-0327f29c-175c-45da-ae49-cf93395c03c7 Nov 02 10:16:54 devstack sudo[100454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:55 devstack sudo[100454]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:55 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-da6a403d-e97f-4755-93f0-4657bd9874f6 tempest-TestServerVolumeAttachmentScenario-797186756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-0327f29c-175c-45da-ae49-cf93395c03c7" returned: 0 in 0.689s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:55 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-da6a403d-e97f-4755-93f0-4657bd9874f6 tempest-TestServerVolumeAttachmentScenario-797186756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-0327f29c-175c-45da-ae49-cf93395c03c7 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:55 devstack sudo[100459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-0327f29c-175c-45da-ae49-cf93395c03c7 Nov 02 10:16:55 devstack sudo[100459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:55 devstack sudo[100459]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:55 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-da6a403d-e97f-4755-93f0-4657bd9874f6 tempest-TestServerVolumeAttachmentScenario-797186756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-0327f29c-175c-45da-ae49-cf93395c03c7" returned: 0 in 0.459s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:55 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-da6a403d-e97f-4755-93f0-4657bd9874f6 tempest-TestServerVolumeAttachmentScenario-797186756 None] Lock "cinder-quobyte-0327f29c-175c-45da-ae49-cf93395c03c7" released by "delete_volume" :: held 1.282s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:16:55 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-da6a403d-e97f-4755-93f0-4657bd9874f6 tempest-TestServerVolumeAttachmentScenario-797186756 None] Created reservations ['c021c6b6-ecd4-4948-9181-ea54a1eb6caa', '4ce6a32b-8803-4c5d-84b3-4a0a193f4a88', '14c59327-dccb-43be-ba7f-3fdbf78cd0dd', 'c8cd8e05-c486-4801-a509-8ee8af23e51a'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:16:56 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-da6a403d-e97f-4755-93f0-4657bd9874f6 tempest-TestServerVolumeAttachmentScenario-797186756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:16:56 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-da6a403d-e97f-4755-93f0-4657bd9874f6 tempest-TestServerVolumeAttachmentScenario-797186756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:16:56 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-da6a403d-e97f-4755-93f0-4657bd9874f6 tempest-TestServerVolumeAttachmentScenario-797186756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:16:56 devstack sudo[100436]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:56 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-da6a403d-e97f-4755-93f0-4657bd9874f6 tempest-TestServerVolumeAttachmentScenario-797186756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:16:56 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-da6a403d-e97f-4755-93f0-4657bd9874f6 tempest-TestServerVolumeAttachmentScenario-797186756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:16:56 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-da6a403d-e97f-4755-93f0-4657bd9874f6 tempest-TestServerVolumeAttachmentScenario-797186756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:56 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-9dae5211-8e72-4d5b-a5cf-8d69d6eef70d tempest-VolumesSnapshotTestJSON-1952456970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-feb717f7-9986-4bb6-bf9b-b614d399b259 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-f4a59227-e909-4326-b316-51ef27ce5f82" returned: 0 in 8.347s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:56 devstack cinder-volume[86890]: DEBUG cinder.image.image_utils [None req-9dae5211-8e72-4d5b-a5cf-8d69d6eef70d tempest-VolumesSnapshotTestJSON-1952456970 None] Image conversion details: src /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-feb717f7-9986-4bb6-bf9b-b614d399b259, size 1024.00 MB, duration 8.35 sec, destination /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-f4a59227-e909-4326-b316-51ef27ce5f82 {{(pid=86890) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 10:16:56 devstack cinder-volume[86890]: INFO cinder.image.image_utils [None req-9dae5211-8e72-4d5b-a5cf-8d69d6eef70d tempest-VolumesSnapshotTestJSON-1952456970 None] Converted 1024.00 MB image at 122.65 MB/s Nov 02 10:16:56 devstack cinder-volume[86890]: WARNING cinder.volume.drivers.remotefs [None req-9dae5211-8e72-4d5b-a5cf-8d69d6eef70d tempest-VolumesSnapshotTestJSON-1952456970 None] /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-f4a59227-e909-4326-b316-51ef27ce5f82 is being set with open permissions: ugo+rw Nov 02 10:16:56 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-9dae5211-8e72-4d5b-a5cf-8d69d6eef70d tempest-VolumesSnapshotTestJSON-1952456970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-f4a59227-e909-4326-b316-51ef27ce5f82 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:56 devstack sudo[100463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-f4a59227-e909-4326-b316-51ef27ce5f82 Nov 02 10:16:56 devstack sudo[100463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:56 devstack sudo[100462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:16:56 devstack sudo[100462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:56 devstack sudo[100462]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:56 devstack sudo[100463]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:56 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-da6a403d-e97f-4755-93f0-4657bd9874f6 tempest-TestServerVolumeAttachmentScenario-797186756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.273s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:56 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-da6a403d-e97f-4755-93f0-4657bd9874f6 tempest-TestServerVolumeAttachmentScenario-797186756 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:16:56 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-9dae5211-8e72-4d5b-a5cf-8d69d6eef70d tempest-VolumesSnapshotTestJSON-1952456970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-f4a59227-e909-4326-b316-51ef27ce5f82" returned: 0 in 0.262s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:56 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-da6a403d-e97f-4755-93f0-4657bd9874f6 tempest-TestServerVolumeAttachmentScenario-797186756 None] Deleted volume successfully. Nov 02 10:16:56 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-9dae5211-8e72-4d5b-a5cf-8d69d6eef70d tempest-VolumesSnapshotTestJSON-1952456970 None] Lock "cinder-quobyte-f4a59227-e909-4326-b316-51ef27ce5f82" released by "_copy_volume_from_snapshot" :: held 9.841s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:16:56 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-da6a403d-e97f-4755-93f0-4657bd9874f6 tempest-TestServerVolumeAttachmentScenario-797186756 None] Lock "cinder-0327f29c-175c-45da-ae49-cf93395c03c7-delete_volume" released by "delete_volume" :: held 2.089s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:16:56 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-9dae5211-8e72-4d5b-a5cf-8d69d6eef70d tempest-VolumesSnapshotTestJSON-1952456970 None] Lock "cinder-quobyte-67206265-0748-4b35-9c35-ad4db835d771-f4a59227-e909-4326-b316-51ef27ce5f82" released by "_create_volume_from_snapshot" :: held 9.930s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:16:56 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-9dae5211-8e72-4d5b-a5cf-8d69d6eef70d tempest-VolumesSnapshotTestJSON-1952456970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.950s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:16:56 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-9dae5211-8e72-4d5b-a5cf-8d69d6eef70d tempest-VolumesSnapshotTestJSON-1952456970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40ba93cd-262a-4874-ace4-a6f5234a542a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4a59227-e909-4326-b316-51ef27ce5f82', 'volume_size': 1, 'snapshot_id': '67206265-0748-4b35-9c35-ad4db835d771'}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:56 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-9dae5211-8e72-4d5b-a5cf-8d69d6eef70d tempest-VolumesSnapshotTestJSON-1952456970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eff9f642-c5d5-4ceb-90b5-5447bb3e99b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:56 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-9dae5211-8e72-4d5b-a5cf-8d69d6eef70d tempest-VolumesSnapshotTestJSON-1952456970 None] Volume volume-f4a59227-e909-4326-b316-51ef27ce5f82 (f4a59227-e909-4326-b316-51ef27ce5f82): created successfully Nov 02 10:16:56 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-9dae5211-8e72-4d5b-a5cf-8d69d6eef70d tempest-VolumesSnapshotTestJSON-1952456970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eff9f642-c5d5-4ceb-90b5-5447bb3e99b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:56 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-9dae5211-8e72-4d5b-a5cf-8d69d6eef70d tempest-VolumesSnapshotTestJSON-1952456970 None] Flow 'volume_create_manager' (997aec7c-0556-450c-b352-14ecce39d474) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:16:56 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-9dae5211-8e72-4d5b-a5cf-8d69d6eef70d tempest-VolumesSnapshotTestJSON-1952456970 None] Created volume successfully. Nov 02 10:16:56 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-80d9fe69-c579-4999-b449-861afd04362b tempest-TestServerVolumeAttachmentScenario-797186756 None] Acquiring lock "cinder-fac22651-77ef-4699-a672-591630a9a269-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:16:56 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-80d9fe69-c579-4999-b449-861afd04362b tempest-TestServerVolumeAttachmentScenario-797186756 None] Lock "cinder-fac22651-77ef-4699-a672-591630a9a269-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:16:56 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-80d9fe69-c579-4999-b449-861afd04362b tempest-TestServerVolumeAttachmentScenario-797186756 None] Acquiring lock "cinder-quobyte-fac22651-77ef-4699-a672-591630a9a269" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:16:56 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-80d9fe69-c579-4999-b449-861afd04362b tempest-TestServerVolumeAttachmentScenario-797186756 None] Lock "cinder-quobyte-fac22651-77ef-4699-a672-591630a9a269" acquired by "delete_volume" :: waited 0.023s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:16:56 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[dabd575d-f00f-4579-8e2d-76ffd6fb274b]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:16:56 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-80d9fe69-c579-4999-b449-861afd04362b tempest-TestServerVolumeAttachmentScenario-797186756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-fac22651-77ef-4699-a672-591630a9a269 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:56 devstack sudo[100468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-fac22651-77ef-4699-a672-591630a9a269 Nov 02 10:16:56 devstack sudo[100468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:57 devstack sudo[100468]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:57 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-80d9fe69-c579-4999-b449-861afd04362b tempest-TestServerVolumeAttachmentScenario-797186756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-fac22651-77ef-4699-a672-591630a9a269" returned: 0 in 0.433s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:57 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-80d9fe69-c579-4999-b449-861afd04362b tempest-TestServerVolumeAttachmentScenario-797186756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-fac22651-77ef-4699-a672-591630a9a269 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:57 devstack sudo[100473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-fac22651-77ef-4699-a672-591630a9a269 Nov 02 10:16:57 devstack sudo[100473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:57 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-fa554a90-a1db-4e65-a47e-7403f4fe578b tempest-VolumesSnapshotTestJSON-1952456970 None] Acquiring lock "cinder-f4a59227-e909-4326-b316-51ef27ce5f82-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:16:57 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-fa554a90-a1db-4e65-a47e-7403f4fe578b tempest-VolumesSnapshotTestJSON-1952456970 None] Lock "cinder-f4a59227-e909-4326-b316-51ef27ce5f82-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:16:57 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-fa554a90-a1db-4e65-a47e-7403f4fe578b tempest-VolumesSnapshotTestJSON-1952456970 None] Acquiring lock "cinder-quobyte-f4a59227-e909-4326-b316-51ef27ce5f82" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:16:57 devstack sudo[100473]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:57 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-80d9fe69-c579-4999-b449-861afd04362b tempest-TestServerVolumeAttachmentScenario-797186756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-fac22651-77ef-4699-a672-591630a9a269" returned: 0 in 0.448s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:57 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-fa554a90-a1db-4e65-a47e-7403f4fe578b tempest-VolumesSnapshotTestJSON-1952456970 None] Lock "cinder-quobyte-f4a59227-e909-4326-b316-51ef27ce5f82" acquired by "delete_volume" :: waited 0.035s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:16:57 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-80d9fe69-c579-4999-b449-861afd04362b tempest-TestServerVolumeAttachmentScenario-797186756 None] Lock "cinder-quobyte-fac22651-77ef-4699-a672-591630a9a269" released by "delete_volume" :: held 0.956s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:16:57 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7564ef9-aa3f-4702-9ef2-4c01f3aec704]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:16:57 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-fa554a90-a1db-4e65-a47e-7403f4fe578b tempest-VolumesSnapshotTestJSON-1952456970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-f4a59227-e909-4326-b316-51ef27ce5f82 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:57 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-80d9fe69-c579-4999-b449-861afd04362b tempest-TestServerVolumeAttachmentScenario-797186756 None] Created reservations ['3ee939be-9e2d-4310-afda-e3d332e38e9f', '8fb1f058-abd6-424a-b6b1-8353cc3cff86', '7107372c-80e8-4571-af14-c8078a297f5a', '9bbae291-1e1b-4b38-9258-cef48069126b'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:16:57 devstack sudo[100476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-f4a59227-e909-4326-b316-51ef27ce5f82 Nov 02 10:16:57 devstack sudo[100476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:57 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-80d9fe69-c579-4999-b449-861afd04362b tempest-TestServerVolumeAttachmentScenario-797186756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:16:57 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-80d9fe69-c579-4999-b449-861afd04362b tempest-TestServerVolumeAttachmentScenario-797186756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:16:57 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-80d9fe69-c579-4999-b449-861afd04362b tempest-TestServerVolumeAttachmentScenario-797186756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:16:57 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-80d9fe69-c579-4999-b449-861afd04362b tempest-TestServerVolumeAttachmentScenario-797186756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:16:57 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-80d9fe69-c579-4999-b449-861afd04362b tempest-TestServerVolumeAttachmentScenario-797186756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:16:57 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-80d9fe69-c579-4999-b449-861afd04362b tempest-TestServerVolumeAttachmentScenario-797186756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:58 devstack sudo[100478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:16:58 devstack sudo[100478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:58 devstack sudo[100476]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:58 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-fa554a90-a1db-4e65-a47e-7403f4fe578b tempest-VolumesSnapshotTestJSON-1952456970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-f4a59227-e909-4326-b316-51ef27ce5f82" returned: 0 in 0.430s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:58 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-fa554a90-a1db-4e65-a47e-7403f4fe578b tempest-VolumesSnapshotTestJSON-1952456970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-f4a59227-e909-4326-b316-51ef27ce5f82 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:58 devstack sudo[100483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-f4a59227-e909-4326-b316-51ef27ce5f82 Nov 02 10:16:58 devstack sudo[100483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:58 devstack sudo[100478]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:58 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-80d9fe69-c579-4999-b449-861afd04362b tempest-TestServerVolumeAttachmentScenario-797186756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.285s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:58 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-80d9fe69-c579-4999-b449-861afd04362b tempest-TestServerVolumeAttachmentScenario-797186756 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:16:58 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-80d9fe69-c579-4999-b449-861afd04362b tempest-TestServerVolumeAttachmentScenario-797186756 None] Deleted volume successfully. Nov 02 10:16:58 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-80d9fe69-c579-4999-b449-861afd04362b tempest-TestServerVolumeAttachmentScenario-797186756 None] Lock "cinder-fac22651-77ef-4699-a672-591630a9a269-delete_volume" released by "delete_volume" :: held 1.583s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:16:58 devstack sudo[100483]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:58 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-fa554a90-a1db-4e65-a47e-7403f4fe578b tempest-VolumesSnapshotTestJSON-1952456970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-f4a59227-e909-4326-b316-51ef27ce5f82" returned: 0 in 0.275s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:58 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-fa554a90-a1db-4e65-a47e-7403f4fe578b tempest-VolumesSnapshotTestJSON-1952456970 None] Lock "cinder-quobyte-f4a59227-e909-4326-b316-51ef27ce5f82" released by "delete_volume" :: held 0.765s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:16:58 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-fa554a90-a1db-4e65-a47e-7403f4fe578b tempest-VolumesSnapshotTestJSON-1952456970 None] Created reservations ['bb4fa511-ce04-4df7-85e3-fcc1d22c999c', 'f85d93c5-400a-47d8-8257-97aa9f2c168b', '9bef1312-f625-4317-b351-2371802aad12', 'b88242d3-bcbe-4d08-b974-9a661fc8e846'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:16:58 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-fa554a90-a1db-4e65-a47e-7403f4fe578b tempest-VolumesSnapshotTestJSON-1952456970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:16:58 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-fa554a90-a1db-4e65-a47e-7403f4fe578b tempest-VolumesSnapshotTestJSON-1952456970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:16:58 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-fa554a90-a1db-4e65-a47e-7403f4fe578b tempest-VolumesSnapshotTestJSON-1952456970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:16:58 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-fa554a90-a1db-4e65-a47e-7403f4fe578b tempest-VolumesSnapshotTestJSON-1952456970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:16:58 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-fa554a90-a1db-4e65-a47e-7403f4fe578b tempest-VolumesSnapshotTestJSON-1952456970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:16:58 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-fa554a90-a1db-4e65-a47e-7403f4fe578b tempest-VolumesSnapshotTestJSON-1952456970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:58 devstack sudo[100487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:16:58 devstack sudo[100487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:58 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-a411fd30-bed2-4c25-b6ce-272651bf3ccc tempest-VolumesSnapshotTestJSON-1952456970 None] Acquiring lock "cinder-67206265-0748-4b35-9c35-ad4db835d771-delete_snapshot" by "delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:16:58 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-a411fd30-bed2-4c25-b6ce-272651bf3ccc tempest-VolumesSnapshotTestJSON-1952456970 None] Lock "cinder-67206265-0748-4b35-9c35-ad4db835d771-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:16:58 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-a411fd30-bed2-4c25-b6ce-272651bf3ccc tempest-VolumesSnapshotTestJSON-1952456970 None] Acquiring lock "cinder-quobyte-feb717f7-9986-4bb6-bf9b-b614d399b259" by "delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:16:58 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-a411fd30-bed2-4c25-b6ce-272651bf3ccc tempest-VolumesSnapshotTestJSON-1952456970 None] Lock "cinder-quobyte-feb717f7-9986-4bb6-bf9b-b614d399b259" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:16:58 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-a411fd30-bed2-4c25-b6ce-272651bf3ccc tempest-VolumesSnapshotTestJSON-1952456970 None] Acquiring lock "cinder-quobyte-67206265-0748-4b35-9c35-ad4db835d771" by "_delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:16:58 devstack sudo[100487]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:58 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-a411fd30-bed2-4c25-b6ce-272651bf3ccc tempest-VolumesSnapshotTestJSON-1952456970 None] Lock "cinder-quobyte-67206265-0748-4b35-9c35-ad4db835d771" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:16:58 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-a411fd30-bed2-4c25-b6ce-272651bf3ccc tempest-VolumesSnapshotTestJSON-1952456970 None] Deleting offline snapshot 67206265-0748-4b35-9c35-ad4db835d771 of volume feb717f7-9986-4bb6-bf9b-b614d399b259 {{(pid=86890) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:16:58 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-a411fd30-bed2-4c25-b6ce-272651bf3ccc tempest-VolumesSnapshotTestJSON-1952456970 None] snapshot_file for this snap is: volume-feb717f7-9986-4bb6-bf9b-b614d399b259.67206265-0748-4b35-9c35-ad4db835d771 {{(pid=86890) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:16:58 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-fa554a90-a1db-4e65-a47e-7403f4fe578b tempest-VolumesSnapshotTestJSON-1952456970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.348s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:58 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-fa554a90-a1db-4e65-a47e-7403f4fe578b tempest-VolumesSnapshotTestJSON-1952456970 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:16:58 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-fa554a90-a1db-4e65-a47e-7403f4fe578b tempest-VolumesSnapshotTestJSON-1952456970 None] Deleted volume successfully. Nov 02 10:16:58 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[88e5a1f5-a97e-4815-9fbf-f907be42641a]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:16:58 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a411fd30-bed2-4c25-b6ce-272651bf3ccc tempest-VolumesSnapshotTestJSON-1952456970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-feb717f7-9986-4bb6-bf9b-b614d399b259.67206265-0748-4b35-9c35-ad4db835d771 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:59 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-fa554a90-a1db-4e65-a47e-7403f4fe578b tempest-VolumesSnapshotTestJSON-1952456970 None] Lock "cinder-f4a59227-e909-4326-b316-51ef27ce5f82-delete_volume" released by "delete_volume" :: held 1.385s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:16:59 devstack sudo[100490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-feb717f7-9986-4bb6-bf9b-b614d399b259.67206265-0748-4b35-9c35-ad4db835d771 Nov 02 10:16:59 devstack sudo[100490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:59 devstack sudo[100490]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:59 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a411fd30-bed2-4c25-b6ce-272651bf3ccc tempest-VolumesSnapshotTestJSON-1952456970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-feb717f7-9986-4bb6-bf9b-b614d399b259.67206265-0748-4b35-9c35-ad4db835d771" returned: 0 in 0.430s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:59 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-a411fd30-bed2-4c25-b6ce-272651bf3ccc tempest-VolumesSnapshotTestJSON-1952456970 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-feb717f7-9986-4bb6-bf9b-b614d399b259(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86890) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:16:59 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[2871be4f-d88e-47c2-ba01-98da0dd8d0f8]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:16:59 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a411fd30-bed2-4c25-b6ce-272651bf3ccc tempest-VolumesSnapshotTestJSON-1952456970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-feb717f7-9986-4bb6-bf9b-b614d399b259 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:59 devstack sudo[100496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-feb717f7-9986-4bb6-bf9b-b614d399b259 Nov 02 10:16:59 devstack sudo[100496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:00 devstack sudo[100496]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:00 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a411fd30-bed2-4c25-b6ce-272651bf3ccc tempest-VolumesSnapshotTestJSON-1952456970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-feb717f7-9986-4bb6-bf9b-b614d399b259" returned: 0 in 0.620s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:00 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a411fd30-bed2-4c25-b6ce-272651bf3ccc tempest-VolumesSnapshotTestJSON-1952456970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-feb717f7-9986-4bb6-bf9b-b614d399b259.67206265-0748-4b35-9c35-ad4db835d771 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:00 devstack sudo[100501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-feb717f7-9986-4bb6-bf9b-b614d399b259.67206265-0748-4b35-9c35-ad4db835d771 Nov 02 10:17:00 devstack sudo[100501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:00 devstack sudo[100501]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:00 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a411fd30-bed2-4c25-b6ce-272651bf3ccc tempest-VolumesSnapshotTestJSON-1952456970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-feb717f7-9986-4bb6-bf9b-b614d399b259.67206265-0748-4b35-9c35-ad4db835d771" returned: 0 in 0.489s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:00 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a411fd30-bed2-4c25-b6ce-272651bf3ccc tempest-VolumesSnapshotTestJSON-1952456970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-feb717f7-9986-4bb6-bf9b-b614d399b259.67206265-0748-4b35-9c35-ad4db835d771 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:00 devstack sudo[100507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-feb717f7-9986-4bb6-bf9b-b614d399b259.67206265-0748-4b35-9c35-ad4db835d771 Nov 02 10:17:00 devstack sudo[100507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:00 devstack sudo[100507]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:00 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a411fd30-bed2-4c25-b6ce-272651bf3ccc tempest-VolumesSnapshotTestJSON-1952456970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-feb717f7-9986-4bb6-bf9b-b614d399b259.67206265-0748-4b35-9c35-ad4db835d771" returned: 0 in 0.292s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:00 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-a411fd30-bed2-4c25-b6ce-272651bf3ccc tempest-VolumesSnapshotTestJSON-1952456970 None] Lock "cinder-quobyte-67206265-0748-4b35-9c35-ad4db835d771" released by "_delete_snapshot" :: held 2.017s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:17:00 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-a411fd30-bed2-4c25-b6ce-272651bf3ccc tempest-VolumesSnapshotTestJSON-1952456970 None] Lock "cinder-quobyte-feb717f7-9986-4bb6-bf9b-b614d399b259" released by "delete_snapshot" :: held 2.054s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:17:01 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-a411fd30-bed2-4c25-b6ce-272651bf3ccc tempest-VolumesSnapshotTestJSON-1952456970 None] Created reservations ['b9200144-45da-4ecc-93a6-360700b098f3', '453e784a-03b8-4fe0-9330-47237e35466f', 'd9048c45-447c-4eb7-b237-5e5486ed3b4a', '5133cf85-57ef-459f-8f6e-b5b88af7ab6e'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:17:01 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-a411fd30-bed2-4c25-b6ce-272651bf3ccc tempest-VolumesSnapshotTestJSON-1952456970 None] Delete snapshot completed successfully. Nov 02 10:17:01 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-a411fd30-bed2-4c25-b6ce-272651bf3ccc tempest-VolumesSnapshotTestJSON-1952456970 None] Lock "cinder-67206265-0748-4b35-9c35-ad4db835d771-delete_snapshot" released by "delete_snapshot" :: held 2.298s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:17:02 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-0ee240b6-8e75-4db4-9f24-0a225b6ee814 tempest-VolumesSnapshotTestJSON-1952456970 None] Acquiring lock "cinder-feb717f7-9986-4bb6-bf9b-b614d399b259-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:17:02 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-0ee240b6-8e75-4db4-9f24-0a225b6ee814 tempest-VolumesSnapshotTestJSON-1952456970 None] Lock "cinder-feb717f7-9986-4bb6-bf9b-b614d399b259-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:17:02 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-0ee240b6-8e75-4db4-9f24-0a225b6ee814 tempest-VolumesSnapshotTestJSON-1952456970 None] Acquiring lock "cinder-quobyte-feb717f7-9986-4bb6-bf9b-b614d399b259" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:17:02 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-0ee240b6-8e75-4db4-9f24-0a225b6ee814 tempest-VolumesSnapshotTestJSON-1952456970 None] Lock "cinder-quobyte-feb717f7-9986-4bb6-bf9b-b614d399b259" acquired by "delete_volume" :: waited 0.030s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:17:02 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[014b1629-ad8e-4202-b736-933f1ac7a21a]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:17:02 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-0ee240b6-8e75-4db4-9f24-0a225b6ee814 tempest-VolumesSnapshotTestJSON-1952456970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-feb717f7-9986-4bb6-bf9b-b614d399b259 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:02 devstack sudo[100514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-feb717f7-9986-4bb6-bf9b-b614d399b259 Nov 02 10:17:02 devstack sudo[100514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:02 devstack sudo[100514]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:02 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-0ee240b6-8e75-4db4-9f24-0a225b6ee814 tempest-VolumesSnapshotTestJSON-1952456970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-feb717f7-9986-4bb6-bf9b-b614d399b259" returned: 0 in 0.404s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:02 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-0ee240b6-8e75-4db4-9f24-0a225b6ee814 tempest-VolumesSnapshotTestJSON-1952456970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-feb717f7-9986-4bb6-bf9b-b614d399b259 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:02 devstack sudo[100520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-feb717f7-9986-4bb6-bf9b-b614d399b259 Nov 02 10:17:02 devstack sudo[100520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:03 devstack sudo[100520]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:03 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-0ee240b6-8e75-4db4-9f24-0a225b6ee814 tempest-VolumesSnapshotTestJSON-1952456970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-feb717f7-9986-4bb6-bf9b-b614d399b259" returned: 0 in 0.272s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:03 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-0ee240b6-8e75-4db4-9f24-0a225b6ee814 tempest-VolumesSnapshotTestJSON-1952456970 None] Lock "cinder-quobyte-feb717f7-9986-4bb6-bf9b-b614d399b259" released by "delete_volume" :: held 0.757s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:17:03 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-0ee240b6-8e75-4db4-9f24-0a225b6ee814 tempest-VolumesSnapshotTestJSON-1952456970 None] Created reservations ['bface36f-19e9-43f1-afa2-23ded0111d68', 'bbfe9cdf-1e41-4fd3-8939-4f88f3bf26e6', 'c8e9b7c6-dbce-47d0-b3cf-d7c8d5d87bb7', '29af7686-15be-4f0c-a551-28200d7a1bcb'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:17:03 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-0ee240b6-8e75-4db4-9f24-0a225b6ee814 tempest-VolumesSnapshotTestJSON-1952456970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:17:03 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-0ee240b6-8e75-4db4-9f24-0a225b6ee814 tempest-VolumesSnapshotTestJSON-1952456970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:17:03 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-0ee240b6-8e75-4db4-9f24-0a225b6ee814 tempest-VolumesSnapshotTestJSON-1952456970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:17:03 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-0ee240b6-8e75-4db4-9f24-0a225b6ee814 tempest-VolumesSnapshotTestJSON-1952456970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:17:03 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-0ee240b6-8e75-4db4-9f24-0a225b6ee814 tempest-VolumesSnapshotTestJSON-1952456970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:17:03 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-0ee240b6-8e75-4db4-9f24-0a225b6ee814 tempest-VolumesSnapshotTestJSON-1952456970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:03 devstack sudo[100523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:17:03 devstack sudo[100523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:03 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-3eb97628-c1bd-47e3-917e-f3c632b755aa tempest-VolumesSnapshotTestJSON-1952456970 None] Acquiring lock "cinder-301f95fb-4d6d-45a0-af53-1e46222ea8dd-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:17:03 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-3eb97628-c1bd-47e3-917e-f3c632b755aa tempest-VolumesSnapshotTestJSON-1952456970 None] Lock "cinder-301f95fb-4d6d-45a0-af53-1e46222ea8dd-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:17:03 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-3eb97628-c1bd-47e3-917e-f3c632b755aa tempest-VolumesSnapshotTestJSON-1952456970 None] Acquiring lock "cinder-quobyte-301f95fb-4d6d-45a0-af53-1e46222ea8dd" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:17:03 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-3eb97628-c1bd-47e3-917e-f3c632b755aa tempest-VolumesSnapshotTestJSON-1952456970 None] Lock "cinder-quobyte-301f95fb-4d6d-45a0-af53-1e46222ea8dd" acquired by "delete_volume" :: waited 0.023s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:17:03 devstack sudo[100523]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:03 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-0ee240b6-8e75-4db4-9f24-0a225b6ee814 tempest-VolumesSnapshotTestJSON-1952456970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.457s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:03 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-0ee240b6-8e75-4db4-9f24-0a225b6ee814 tempest-VolumesSnapshotTestJSON-1952456970 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:17:03 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-0ee240b6-8e75-4db4-9f24-0a225b6ee814 tempest-VolumesSnapshotTestJSON-1952456970 None] Deleted volume successfully. Nov 02 10:17:03 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[64aa1fe3-9df0-42b9-97c7-2d3badc53192]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:17:03 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-3eb97628-c1bd-47e3-917e-f3c632b755aa tempest-VolumesSnapshotTestJSON-1952456970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-301f95fb-4d6d-45a0-af53-1e46222ea8dd {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:03 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-0ee240b6-8e75-4db4-9f24-0a225b6ee814 tempest-VolumesSnapshotTestJSON-1952456970 None] Lock "cinder-feb717f7-9986-4bb6-bf9b-b614d399b259-delete_volume" released by "delete_volume" :: held 1.505s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:17:03 devstack sudo[100527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-301f95fb-4d6d-45a0-af53-1e46222ea8dd Nov 02 10:17:03 devstack sudo[100527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:04 devstack sudo[100527]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:04 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-3eb97628-c1bd-47e3-917e-f3c632b755aa tempest-VolumesSnapshotTestJSON-1952456970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-301f95fb-4d6d-45a0-af53-1e46222ea8dd" returned: 0 in 0.616s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:04 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-3eb97628-c1bd-47e3-917e-f3c632b755aa tempest-VolumesSnapshotTestJSON-1952456970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-301f95fb-4d6d-45a0-af53-1e46222ea8dd {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:04 devstack sudo[100532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-301f95fb-4d6d-45a0-af53-1e46222ea8dd Nov 02 10:17:04 devstack sudo[100532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:04 devstack sudo[100532]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:04 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-3eb97628-c1bd-47e3-917e-f3c632b755aa tempest-VolumesSnapshotTestJSON-1952456970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-301f95fb-4d6d-45a0-af53-1e46222ea8dd" returned: 0 in 0.286s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:04 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-3eb97628-c1bd-47e3-917e-f3c632b755aa tempest-VolumesSnapshotTestJSON-1952456970 None] Lock "cinder-quobyte-301f95fb-4d6d-45a0-af53-1e46222ea8dd" released by "delete_volume" :: held 1.023s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:17:04 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-3eb97628-c1bd-47e3-917e-f3c632b755aa tempest-VolumesSnapshotTestJSON-1952456970 None] Created reservations ['2b53fc59-22f1-4416-a0d8-8629c622ca9d', '9d656ba7-60be-4620-afd9-2239f908e85a', '0d1a329b-cf17-4c00-9a99-6272709bf001', '6082da2c-9f49-42e5-983f-d6f8e7b0d18b'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:17:04 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-3eb97628-c1bd-47e3-917e-f3c632b755aa tempest-VolumesSnapshotTestJSON-1952456970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:17:04 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-3eb97628-c1bd-47e3-917e-f3c632b755aa tempest-VolumesSnapshotTestJSON-1952456970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:17:04 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-3eb97628-c1bd-47e3-917e-f3c632b755aa tempest-VolumesSnapshotTestJSON-1952456970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:17:04 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-3eb97628-c1bd-47e3-917e-f3c632b755aa tempest-VolumesSnapshotTestJSON-1952456970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:17:04 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-3eb97628-c1bd-47e3-917e-f3c632b755aa tempest-VolumesSnapshotTestJSON-1952456970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:17:04 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-3eb97628-c1bd-47e3-917e-f3c632b755aa tempest-VolumesSnapshotTestJSON-1952456970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:04 devstack sudo[100535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:17:04 devstack sudo[100535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:05 devstack sudo[100535]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:05 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-3eb97628-c1bd-47e3-917e-f3c632b755aa tempest-VolumesSnapshotTestJSON-1952456970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.284s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:05 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-3eb97628-c1bd-47e3-917e-f3c632b755aa tempest-VolumesSnapshotTestJSON-1952456970 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:17:05 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-3eb97628-c1bd-47e3-917e-f3c632b755aa tempest-VolumesSnapshotTestJSON-1952456970 None] Deleted volume successfully. Nov 02 10:17:05 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-3eb97628-c1bd-47e3-917e-f3c632b755aa tempest-VolumesSnapshotTestJSON-1952456970 None] Lock "cinder-301f95fb-4d6d-45a0-af53-1e46222ea8dd-delete_volume" released by "delete_volume" :: held 1.610s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:17:14 devstack cinder-volume[86890]: DEBUG dbcounter [-] [86890] Writing DB stats cinder:INSERT=37,cinder:UPDATE=129,cinder:SELECT=123,cinder:DELETE=10 {{(pid=86890) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:17:15 devstack cinder-volume[86890]: DEBUG dbcounter [-] [86890] Writing DB stats cinder:UPDATE=80,cinder:SELECT=76,cinder:INSERT=21,cinder:DELETE=6 {{(pid=86890) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:17:20 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-93c27d71-09c1-42bc-950a-28193c59499b tempest-VolumeAndVolumeTypeFromImageTest-158823705 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:17:20 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-93c27d71-09c1-42bc-950a-28193c59499b tempest-VolumeAndVolumeTypeFromImageTest-158823705 None] Flow 'volume_create_manager' (3e5f2ab5-4ac1-4af4-905b-253b237ae393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:17:20 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-93c27d71-09c1-42bc-950a-28193c59499b tempest-VolumeAndVolumeTypeFromImageTest-158823705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97f8d05e-0436-40af-bf28-b01dd5efb47d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:21 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-93c27d71-09c1-42bc-950a-28193c59499b tempest-VolumeAndVolumeTypeFromImageTest-158823705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97f8d05e-0436-40af-bf28-b01dd5efb47d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:17:20Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7fcb236-9e9f-4854-8616-a4fea3ded0a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='383c8f5432784f7c8c6839f593729f03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:17:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:17:21Z,use_quota=True,user_id='62eafbf1740a4581903c848095c13d1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(805033c3-77e0-46ac-a3dd-17c9bbffa6f9),volume_type_id=805033c3-77e0-46ac-a3dd-17c9bbffa6f9)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:21 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-93c27d71-09c1-42bc-950a-28193c59499b tempest-VolumeAndVolumeTypeFromImageTest-158823705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1011d78a-45c6-47d9-99c3-1a744b8df3bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:21 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-93c27d71-09c1-42bc-950a-28193c59499b tempest-VolumeAndVolumeTypeFromImageTest-158823705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1011d78a-45c6-47d9-99c3-1a744b8df3bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:21 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-93c27d71-09c1-42bc-950a-28193c59499b tempest-VolumeAndVolumeTypeFromImageTest-158823705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66d76696-5ffe-4a2a-9b04-4d14fd527ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:21 devstack cinder-volume[86890]: DEBUG cinder.image.glance [None req-93c27d71-09c1-42bc-950a-28193c59499b tempest-VolumeAndVolumeTypeFromImageTest-158823705 None] Creating Keystone auth plugin from conf {{(pid=86890) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 10:17:21 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-e179eda7-bfa6-4709-a204-66febcb40079 tempest-TestMinimumBasicScenario-161405133 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:17:21 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-e179eda7-bfa6-4709-a204-66febcb40079 tempest-TestMinimumBasicScenario-161405133 None] Flow 'volume_create_manager' (ac99ce5e-4307-4c9a-9791-145457a5d9db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:17:21 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-e179eda7-bfa6-4709-a204-66febcb40079 tempest-TestMinimumBasicScenario-161405133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6404fc86-3c59-4980-abcb-4964cbf450f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:21 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-e179eda7-bfa6-4709-a204-66febcb40079 tempest-TestMinimumBasicScenario-161405133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6404fc86-3c59-4980-abcb-4964cbf450f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:17:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1529493003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01c21bfe-a179-41f9-97f6-5f8853d942a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc8975ab53e24450accca5cc2b01a77e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:17:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:17:21Z,use_quota=True,user_id='2b2021ccc6ae4e7abf213250c85fd100',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:21 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-e179eda7-bfa6-4709-a204-66febcb40079 tempest-TestMinimumBasicScenario-161405133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fae44a5f-30eb-4f44-9208-1c150fce8b49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:21 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-e179eda7-bfa6-4709-a204-66febcb40079 tempest-TestMinimumBasicScenario-161405133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fae44a5f-30eb-4f44-9208-1c150fce8b49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:21 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-e179eda7-bfa6-4709-a204-66febcb40079 tempest-TestMinimumBasicScenario-161405133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f987c194-668c-4b7b-924a-63b222c78dee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:21 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-e179eda7-bfa6-4709-a204-66febcb40079 tempest-TestMinimumBasicScenario-161405133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f987c194-668c-4b7b-924a-63b222c78dee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01c21bfe-a179-41f9-97f6-5f8853d942a7', 'volume_name': 'volume-01c21bfe-a179-41f9-97f6-5f8853d942a7', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:21 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-e179eda7-bfa6-4709-a204-66febcb40079 tempest-TestMinimumBasicScenario-161405133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1d6f633-40fb-4eb3-b619-bf97aa13f2cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:21 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-e179eda7-bfa6-4709-a204-66febcb40079 tempest-TestMinimumBasicScenario-161405133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1d6f633-40fb-4eb3-b619-bf97aa13f2cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:21 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-e179eda7-bfa6-4709-a204-66febcb40079 tempest-TestMinimumBasicScenario-161405133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a57708d5-eab8-4aff-b1a9-4b051ac1850b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:21 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-e179eda7-bfa6-4709-a204-66febcb40079 tempest-TestMinimumBasicScenario-161405133 None] Volume 01c21bfe-a179-41f9-97f6-5f8853d942a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01c21bfe-a179-41f9-97f6-5f8853d942a7', 'volume_size': 1} Nov 02 10:17:21 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-e179eda7-bfa6-4709-a204-66febcb40079 tempest-TestMinimumBasicScenario-161405133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:17:21 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-e179eda7-bfa6-4709-a204-66febcb40079 tempest-TestMinimumBasicScenario-161405133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:17:21 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-e179eda7-bfa6-4709-a204-66febcb40079 tempest-TestMinimumBasicScenario-161405133 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:17:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1529493003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01c21bfe-a179-41f9-97f6-5f8853d942a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc8975ab53e24450accca5cc2b01a77e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:17:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:17:21Z,use_quota=True,user_id='2b2021ccc6ae4e7abf213250c85fd100',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:17:21 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-e179eda7-bfa6-4709-a204-66febcb40079 tempest-TestMinimumBasicScenario-161405133 None] Creating volume 01c21bfe-a179-41f9-97f6-5f8853d942a7 {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:17:21 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-e179eda7-bfa6-4709-a204-66febcb40079 tempest-TestMinimumBasicScenario-161405133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:17:21 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-e179eda7-bfa6-4709-a204-66febcb40079 tempest-TestMinimumBasicScenario-161405133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:17:21 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-e179eda7-bfa6-4709-a204-66febcb40079 tempest-TestMinimumBasicScenario-161405133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:17:21 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-e179eda7-bfa6-4709-a204-66febcb40079 tempest-TestMinimumBasicScenario-161405133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:17:21 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-e179eda7-bfa6-4709-a204-66febcb40079 tempest-TestMinimumBasicScenario-161405133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:17:21 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-e179eda7-bfa6-4709-a204-66febcb40079 tempest-TestMinimumBasicScenario-161405133 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:17:21 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-e179eda7-bfa6-4709-a204-66febcb40079 tempest-TestMinimumBasicScenario-161405133 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:17:21 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-e179eda7-bfa6-4709-a204-66febcb40079 tempest-TestMinimumBasicScenario-161405133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-01c21bfe-a179-41f9-97f6-5f8853d942a7 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:21 devstack sudo[100692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-01c21bfe-a179-41f9-97f6-5f8853d942a7 1073741824 Nov 02 10:17:21 devstack sudo[100692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:21 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-93c27d71-09c1-42bc-950a-28193c59499b tempest-VolumeAndVolumeTypeFromImageTest-158823705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66d76696-5ffe-4a2a-9b04-4d14fd527ea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b7fcb236-9e9f-4854-8616-a4fea3ded0a5', 'volume_name': 'volume-b7fcb236-9e9f-4854-8616-a4fea3ded0a5', 'volume_size': 1, 'image_id': '74fd60c8-fff1-405b-804d-503fa5d44ef6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/74fd60c8-fff1-405b-804d-503fa5d44ef6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9fcc47392efa209726f1b6ed6229dd17', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '383c8f5432784f7c8c6839f593729f03', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd91e374652eecc01080aa8cb54c3890c873786a46f2b3ab687993c05e27158f77f6bf7ba8401a7ca70bd234a7f2bf49fea35efa99a0ba3410e16ad907ee40628', 'id': '74fd60c8-fff1-405b-804d-503fa5d44ef6', 'created_at': datetime.datetime(2026, 11, 2, 9, 17, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 17, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/74fd60c8-fff1-405b-804d-503fa5d44ef6/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:21 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-93c27d71-09c1-42bc-950a-28193c59499b tempest-VolumeAndVolumeTypeFromImageTest-158823705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae2b3e48-2eff-4310-8bde-21fa37ac8a2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:21 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-93c27d71-09c1-42bc-950a-28193c59499b tempest-VolumeAndVolumeTypeFromImageTest-158823705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae2b3e48-2eff-4310-8bde-21fa37ac8a2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:21 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-93c27d71-09c1-42bc-950a-28193c59499b tempest-VolumeAndVolumeTypeFromImageTest-158823705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12158b35-2be9-401d-a4fd-34c597febc33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:21 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-93c27d71-09c1-42bc-950a-28193c59499b tempest-VolumeAndVolumeTypeFromImageTest-158823705 None] Volume b7fcb236-9e9f-4854-8616-a4fea3ded0a5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b7fcb236-9e9f-4854-8616-a4fea3ded0a5', 'volume_size': 1, 'image_id': '74fd60c8-fff1-405b-804d-503fa5d44ef6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/74fd60c8-fff1-405b-804d-503fa5d44ef6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9fcc47392efa209726f1b6ed6229dd17', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '383c8f5432784f7c8c6839f593729f03', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd91e374652eecc01080aa8cb54c3890c873786a46f2b3ab687993c05e27158f77f6bf7ba8401a7ca70bd234a7f2bf49fea35efa99a0ba3410e16ad907ee40628', 'id': '74fd60c8-fff1-405b-804d-503fa5d44ef6', 'created_at': datetime.datetime(2026, 11, 2, 9, 17, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 17, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/74fd60c8-fff1-405b-804d-503fa5d44ef6/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Nov 02 10:17:21 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-93c27d71-09c1-42bc-950a-28193c59499b tempest-VolumeAndVolumeTypeFromImageTest-158823705 None] Trying to clone b7fcb236-9e9f-4854-8616-a4fea3ded0a5 from image 74fd60c8-fff1-405b-804d-503fa5d44ef6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/74fd60c8-fff1-405b-804d-503fa5d44ef6', 'metadata': {}}]). {{(pid=86890) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 02 10:17:21 devstack cinder-volume[86890]: DEBUG cinder.image.image_utils [None req-93c27d71-09c1-42bc-950a-28193c59499b tempest-VolumeAndVolumeTypeFromImageTest-158823705 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_74fd60c8-fff1-405b-804d-503fa5d44ef6_6dr4a_n6devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86890) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 02 10:17:21 devstack cinder-volume[86890]: INFO cinder.image.image_utils [None req-93c27d71-09c1-42bc-950a-28193c59499b tempest-VolumeAndVolumeTypeFromImageTest-158823705 None] Image download 0.00 MB at 0.00 MB/s Nov 02 10:17:21 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[60c84b0a-5602-4f2e-8c20-eaab14f18668]: (4, 'raw') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:17:21 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-93c27d71-09c1-42bc-950a-28193c59499b tempest-VolumeAndVolumeTypeFromImageTest-158823705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_74fd60c8-fff1-405b-804d-503fa5d44ef6_6dr4a_n6devstack@QuobyteHD {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:22 devstack sudo[100697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_74fd60c8-fff1-405b-804d-503fa5d44ef6_6dr4a_n6devstack@QuobyteHD Nov 02 10:17:22 devstack sudo[100697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:22 devstack sudo[100692]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:22 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-e179eda7-bfa6-4709-a204-66febcb40079 tempest-TestMinimumBasicScenario-161405133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-01c21bfe-a179-41f9-97f6-5f8853d942a7 1073741824" returned: 0 in 0.639s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:22 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-e179eda7-bfa6-4709-a204-66febcb40079 tempest-TestMinimumBasicScenario-161405133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-01c21bfe-a179-41f9-97f6-5f8853d942a7 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:22 devstack sudo[100699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-01c21bfe-a179-41f9-97f6-5f8853d942a7 Nov 02 10:17:22 devstack sudo[100699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:22 devstack sudo[100697]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:22 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-93c27d71-09c1-42bc-950a-28193c59499b tempest-VolumeAndVolumeTypeFromImageTest-158823705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_74fd60c8-fff1-405b-804d-503fa5d44ef6_6dr4a_n6devstack@QuobyteHD" returned: 0 in 0.438s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:22 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-93c27d71-09c1-42bc-950a-28193c59499b tempest-VolumeAndVolumeTypeFromImageTest-158823705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_74fd60c8-fff1-405b-804d-503fa5d44ef6_6dr4a_n6devstack@QuobyteHD {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:22 devstack sudo[100703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_74fd60c8-fff1-405b-804d-503fa5d44ef6_6dr4a_n6devstack@QuobyteHD Nov 02 10:17:22 devstack sudo[100703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:22 devstack sudo[100699]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:22 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-e179eda7-bfa6-4709-a204-66febcb40079 tempest-TestMinimumBasicScenario-161405133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-01c21bfe-a179-41f9-97f6-5f8853d942a7" returned: 0 in 0.278s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:22 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-e179eda7-bfa6-4709-a204-66febcb40079 tempest-TestMinimumBasicScenario-161405133 None] <== create_volume: return (977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:17:22 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-e179eda7-bfa6-4709-a204-66febcb40079 tempest-TestMinimumBasicScenario-161405133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:17:22 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-e179eda7-bfa6-4709-a204-66febcb40079 tempest-TestMinimumBasicScenario-161405133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a57708d5-eab8-4aff-b1a9-4b051ac1850b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01c21bfe-a179-41f9-97f6-5f8853d942a7', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:22 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-e179eda7-bfa6-4709-a204-66febcb40079 tempest-TestMinimumBasicScenario-161405133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8803c9be-1809-4976-8bf2-c7de30d3954f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:22 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-e179eda7-bfa6-4709-a204-66febcb40079 tempest-TestMinimumBasicScenario-161405133 None] Volume volume-01c21bfe-a179-41f9-97f6-5f8853d942a7 (01c21bfe-a179-41f9-97f6-5f8853d942a7): created successfully Nov 02 10:17:22 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-e179eda7-bfa6-4709-a204-66febcb40079 tempest-TestMinimumBasicScenario-161405133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8803c9be-1809-4976-8bf2-c7de30d3954f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:22 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-e179eda7-bfa6-4709-a204-66febcb40079 tempest-TestMinimumBasicScenario-161405133 None] Flow 'volume_create_manager' (ac99ce5e-4307-4c9a-9791-145457a5d9db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:17:22 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-e179eda7-bfa6-4709-a204-66febcb40079 tempest-TestMinimumBasicScenario-161405133 None] Created volume successfully. Nov 02 10:17:22 devstack sudo[100703]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:22 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-93c27d71-09c1-42bc-950a-28193c59499b tempest-VolumeAndVolumeTypeFromImageTest-158823705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_74fd60c8-fff1-405b-804d-503fa5d44ef6_6dr4a_n6devstack@QuobyteHD" returned: 1 in 0.357s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:22 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-93c27d71-09c1-42bc-950a-28193c59499b tempest-VolumeAndVolumeTypeFromImageTest-158823705 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_74fd60c8-fff1-405b-804d-503fa5d44ef6_6dr4a_n6devstack@QuobyteHD' failed. Not Retrying. {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 10:17:22 devstack cinder-volume[86890]: DEBUG cinder.image.image_utils [None req-93c27d71-09c1-42bc-950a-28193c59499b tempest-VolumeAndVolumeTypeFromImageTest-158823705 None] Temporary image 74fd60c8-fff1-405b-804d-503fa5d44ef6 is fetched for user 62eafbf1740a4581903c848095c13d1c. {{(pid=86890) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 02 10:17:22 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[7db346d7-66de-40ed-bc33-7735172830f1]: (4, 'raw') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:17:22 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-93c27d71-09c1-42bc-950a-28193c59499b tempest-VolumeAndVolumeTypeFromImageTest-158823705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_74fd60c8-fff1-405b-804d-503fa5d44ef6_6dr4a_n6devstack@QuobyteHD {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:23 devstack sudo[100709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_74fd60c8-fff1-405b-804d-503fa5d44ef6_6dr4a_n6devstack@QuobyteHD Nov 02 10:17:23 devstack sudo[100709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:23 devstack sudo[100709]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:23 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-93c27d71-09c1-42bc-950a-28193c59499b tempest-VolumeAndVolumeTypeFromImageTest-158823705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_74fd60c8-fff1-405b-804d-503fa5d44ef6_6dr4a_n6devstack@QuobyteHD" returned: 0 in 0.575s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:23 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-93c27d71-09c1-42bc-950a-28193c59499b tempest-VolumeAndVolumeTypeFromImageTest-158823705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_74fd60c8-fff1-405b-804d-503fa5d44ef6_6dr4a_n6devstack@QuobyteHD {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:23 devstack sudo[100713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_74fd60c8-fff1-405b-804d-503fa5d44ef6_6dr4a_n6devstack@QuobyteHD Nov 02 10:17:23 devstack sudo[100713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:23 devstack sudo[100713]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:23 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-93c27d71-09c1-42bc-950a-28193c59499b tempest-VolumeAndVolumeTypeFromImageTest-158823705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_74fd60c8-fff1-405b-804d-503fa5d44ef6_6dr4a_n6devstack@QuobyteHD" returned: 1 in 0.382s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:23 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-93c27d71-09c1-42bc-950a-28193c59499b tempest-VolumeAndVolumeTypeFromImageTest-158823705 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_74fd60c8-fff1-405b-804d-503fa5d44ef6_6dr4a_n6devstack@QuobyteHD' failed. Not Retrying. {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 10:17:23 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-93c27d71-09c1-42bc-950a-28193c59499b tempest-VolumeAndVolumeTypeFromImageTest-158823705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:17:23 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-93c27d71-09c1-42bc-950a-28193c59499b tempest-VolumeAndVolumeTypeFromImageTest-158823705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:17:23 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-93c27d71-09c1-42bc-950a-28193c59499b tempest-VolumeAndVolumeTypeFromImageTest-158823705 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:17:20Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7fcb236-9e9f-4854-8616-a4fea3ded0a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='383c8f5432784f7c8c6839f593729f03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:17:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:17:21Z,use_quota=True,user_id='62eafbf1740a4581903c848095c13d1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(805033c3-77e0-46ac-a3dd-17c9bbffa6f9),volume_type_id=805033c3-77e0-46ac-a3dd-17c9bbffa6f9)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:17:23 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-93c27d71-09c1-42bc-950a-28193c59499b tempest-VolumeAndVolumeTypeFromImageTest-158823705 None] Creating volume b7fcb236-9e9f-4854-8616-a4fea3ded0a5 {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:17:23 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-93c27d71-09c1-42bc-950a-28193c59499b tempest-VolumeAndVolumeTypeFromImageTest-158823705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:17:23 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-93c27d71-09c1-42bc-950a-28193c59499b tempest-VolumeAndVolumeTypeFromImageTest-158823705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:17:23 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-93c27d71-09c1-42bc-950a-28193c59499b tempest-VolumeAndVolumeTypeFromImageTest-158823705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:17:23 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-93c27d71-09c1-42bc-950a-28193c59499b tempest-VolumeAndVolumeTypeFromImageTest-158823705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:17:23 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-93c27d71-09c1-42bc-950a-28193c59499b tempest-VolumeAndVolumeTypeFromImageTest-158823705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:17:23 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-93c27d71-09c1-42bc-950a-28193c59499b tempest-VolumeAndVolumeTypeFromImageTest-158823705 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:17:23 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-93c27d71-09c1-42bc-950a-28193c59499b tempest-VolumeAndVolumeTypeFromImageTest-158823705 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:17:23 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-93c27d71-09c1-42bc-950a-28193c59499b tempest-VolumeAndVolumeTypeFromImageTest-158823705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b7fcb236-9e9f-4854-8616-a4fea3ded0a5 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:23 devstack sudo[100722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b7fcb236-9e9f-4854-8616-a4fea3ded0a5 1073741824 Nov 02 10:17:23 devstack sudo[100722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:24 devstack sudo[100722]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:24 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-93c27d71-09c1-42bc-950a-28193c59499b tempest-VolumeAndVolumeTypeFromImageTest-158823705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b7fcb236-9e9f-4854-8616-a4fea3ded0a5 1073741824" returned: 0 in 0.776s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:24 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-93c27d71-09c1-42bc-950a-28193c59499b tempest-VolumeAndVolumeTypeFromImageTest-158823705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b7fcb236-9e9f-4854-8616-a4fea3ded0a5 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:24 devstack sudo[100736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b7fcb236-9e9f-4854-8616-a4fea3ded0a5 Nov 02 10:17:24 devstack sudo[100736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:24 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [req-0ecc2730-193a-41c0-80ca-07b960857060 req-7eb05f48-ca4a-4728-b8af-0f0a9eddf15a tempest-TestMinimumBasicScenario-161405133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:17:24 devstack sudo[100736]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:24 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-93c27d71-09c1-42bc-950a-28193c59499b tempest-VolumeAndVolumeTypeFromImageTest-158823705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b7fcb236-9e9f-4854-8616-a4fea3ded0a5" returned: 0 in 0.299s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:24 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-93c27d71-09c1-42bc-950a-28193c59499b tempest-VolumeAndVolumeTypeFromImageTest-158823705 None] <== create_volume: return (1148ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:17:24 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-93c27d71-09c1-42bc-950a-28193c59499b tempest-VolumeAndVolumeTypeFromImageTest-158823705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.156s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:17:24 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [req-0ecc2730-193a-41c0-80ca-07b960857060 req-7eb05f48-ca4a-4728-b8af-0f0a9eddf15a tempest-TestMinimumBasicScenario-161405133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.219s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:17:24 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [req-0ecc2730-193a-41c0-80ca-07b960857060 req-7eb05f48-ca4a-4728-b8af-0f0a9eddf15a tempest-TestMinimumBasicScenario-161405133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:17:24 devstack cinder-volume[86890]: DEBUG cinder.volume.volume_utils [None req-93c27d71-09c1-42bc-950a-28193c59499b tempest-VolumeAndVolumeTypeFromImageTest-158823705 None] Attempting download of 74fd60c8-fff1-405b-804d-503fa5d44ef6 ((None, [{'url': 'file:///opt/stack/data/glance/images/74fd60c8-fff1-405b-804d-503fa5d44ef6', 'metadata': {}}])) to volume b7fcb236-9e9f-4854-8616-a4fea3ded0a5. {{(pid=86890) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 02 10:17:25 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [req-0ecc2730-193a-41c0-80ca-07b960857060 req-7eb05f48-ca4a-4728-b8af-0f0a9eddf15a tempest-TestMinimumBasicScenario-161405133 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67', 'name': 'volume-01c21bfe-a179-41f9-97f6-5f8853d942a7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '99ad175c-e6bd-4386-96d8-a19b597c1eff', 'enforce_multipath': True} {{(pid=86890) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:17:25 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdaec8bf-9c59-4246-b462-0f166e93b2cd]: (4, 'raw') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:17:25 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-93c27d71-09c1-42bc-950a-28193c59499b tempest-VolumeAndVolumeTypeFromImageTest-158823705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_74fd60c8-fff1-405b-804d-503fa5d44ef6_fgezxety {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:25 devstack cinder-volume[86890]: INFO cinder.volume.manager [req-0ecc2730-193a-41c0-80ca-07b960857060 req-7eb05f48-ca4a-4728-b8af-0f0a9eddf15a tempest-TestMinimumBasicScenario-161405133 None] attachment_update completed successfully. Nov 02 10:17:25 devstack sudo[100739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_74fd60c8-fff1-405b-804d-503fa5d44ef6_fgezxety Nov 02 10:17:25 devstack sudo[100739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:25 devstack sudo[100739]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:25 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-93c27d71-09c1-42bc-950a-28193c59499b tempest-VolumeAndVolumeTypeFromImageTest-158823705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_74fd60c8-fff1-405b-804d-503fa5d44ef6_fgezxety" returned: 0 in 0.564s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:25 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-93c27d71-09c1-42bc-950a-28193c59499b tempest-VolumeAndVolumeTypeFromImageTest-158823705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_74fd60c8-fff1-405b-804d-503fa5d44ef6_fgezxety {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:25 devstack sudo[101010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_74fd60c8-fff1-405b-804d-503fa5d44ef6_fgezxety Nov 02 10:17:25 devstack sudo[101010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:26 devstack sudo[101010]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:26 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-93c27d71-09c1-42bc-950a-28193c59499b tempest-VolumeAndVolumeTypeFromImageTest-158823705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_74fd60c8-fff1-405b-804d-503fa5d44ef6_fgezxety" returned: 1 in 0.461s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:26 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-93c27d71-09c1-42bc-950a-28193c59499b tempest-VolumeAndVolumeTypeFromImageTest-158823705 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_74fd60c8-fff1-405b-804d-503fa5d44ef6_fgezxety' failed. Not Retrying. {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 10:17:26 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[f376b831-2fd6-43f7-8a6a-ff8c9efdf554]: (4, 'raw') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:17:26 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-93c27d71-09c1-42bc-950a-28193c59499b tempest-VolumeAndVolumeTypeFromImageTest-158823705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_74fd60c8-fff1-405b-804d-503fa5d44ef6_6dr4a_n6devstack@QuobyteHD {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:26 devstack sudo[101163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_74fd60c8-fff1-405b-804d-503fa5d44ef6_6dr4a_n6devstack@QuobyteHD Nov 02 10:17:26 devstack sudo[101163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:26 devstack sudo[101163]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:26 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-93c27d71-09c1-42bc-950a-28193c59499b tempest-VolumeAndVolumeTypeFromImageTest-158823705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_74fd60c8-fff1-405b-804d-503fa5d44ef6_6dr4a_n6devstack@QuobyteHD" returned: 0 in 0.505s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:26 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-93c27d71-09c1-42bc-950a-28193c59499b tempest-VolumeAndVolumeTypeFromImageTest-158823705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_74fd60c8-fff1-405b-804d-503fa5d44ef6_6dr4a_n6devstack@QuobyteHD {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:26 devstack sudo[101167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_74fd60c8-fff1-405b-804d-503fa5d44ef6_6dr4a_n6devstack@QuobyteHD Nov 02 10:17:26 devstack sudo[101167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:27 devstack sudo[101167]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:27 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-93c27d71-09c1-42bc-950a-28193c59499b tempest-VolumeAndVolumeTypeFromImageTest-158823705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_74fd60c8-fff1-405b-804d-503fa5d44ef6_6dr4a_n6devstack@QuobyteHD" returned: 1 in 0.539s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:27 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-93c27d71-09c1-42bc-950a-28193c59499b tempest-VolumeAndVolumeTypeFromImageTest-158823705 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_74fd60c8-fff1-405b-804d-503fa5d44ef6_6dr4a_n6devstack@QuobyteHD' failed. Not Retrying. {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 10:17:27 devstack cinder-volume[86890]: DEBUG cinder.image.image_utils [None req-93c27d71-09c1-42bc-950a-28193c59499b tempest-VolumeAndVolumeTypeFromImageTest-158823705 None] 74fd60c8-fff1-405b-804d-503fa5d44ef6 was raw, converting to qcow2 {{(pid=86890) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 02 10:17:27 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-93c27d71-09c1-42bc-950a-28193c59499b tempest-VolumeAndVolumeTypeFromImageTest-158823705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_74fd60c8-fff1-405b-804d-503fa5d44ef6_6dr4a_n6devstack@QuobyteHD /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b7fcb236-9e9f-4854-8616-a4fea3ded0a5 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:27 devstack sudo[101172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_74fd60c8-fff1-405b-804d-503fa5d44ef6_6dr4a_n6devstack@QuobyteHD /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b7fcb236-9e9f-4854-8616-a4fea3ded0a5 Nov 02 10:17:27 devstack sudo[101172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:27 devstack sudo[101172]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:27 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-93c27d71-09c1-42bc-950a-28193c59499b tempest-VolumeAndVolumeTypeFromImageTest-158823705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_74fd60c8-fff1-405b-804d-503fa5d44ef6_6dr4a_n6devstack@QuobyteHD /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b7fcb236-9e9f-4854-8616-a4fea3ded0a5" returned: 0 in 0.731s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:27 devstack cinder-volume[86890]: DEBUG cinder.image.image_utils [None req-93c27d71-09c1-42bc-950a-28193c59499b tempest-VolumeAndVolumeTypeFromImageTest-158823705 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_74fd60c8-fff1-405b-804d-503fa5d44ef6_6dr4a_n6devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b7fcb236-9e9f-4854-8616-a4fea3ded0a5 {{(pid=86890) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 10:17:27 devstack cinder-volume[86890]: INFO cinder.image.image_utils [None req-93c27d71-09c1-42bc-950a-28193c59499b tempest-VolumeAndVolumeTypeFromImageTest-158823705 None] Converted 0.00 MB image at 0.00 MB/s Nov 02 10:17:27 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-93c27d71-09c1-42bc-950a-28193c59499b tempest-VolumeAndVolumeTypeFromImageTest-158823705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b7fcb236-9e9f-4854-8616-a4fea3ded0a5 1G {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:27 devstack sudo[101178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b7fcb236-9e9f-4854-8616-a4fea3ded0a5 1G Nov 02 10:17:27 devstack sudo[101178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:28 devstack sudo[101178]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:28 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-93c27d71-09c1-42bc-950a-28193c59499b tempest-VolumeAndVolumeTypeFromImageTest-158823705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b7fcb236-9e9f-4854-8616-a4fea3ded0a5 1G" returned: 0 in 0.517s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:28 devstack cinder-volume[86890]: DEBUG cinder.volume.volume_utils [None req-93c27d71-09c1-42bc-950a-28193c59499b tempest-VolumeAndVolumeTypeFromImageTest-158823705 None] Downloaded image 74fd60c8-fff1-405b-804d-503fa5d44ef6 ((None, [{'url': 'file:///opt/stack/data/glance/images/74fd60c8-fff1-405b-804d-503fa5d44ef6', 'metadata': {}}])) to volume b7fcb236-9e9f-4854-8616-a4fea3ded0a5 successfully. {{(pid=86890) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 02 10:17:28 devstack cinder-volume[86890]: DEBUG cinder.image.image_utils [None req-93c27d71-09c1-42bc-950a-28193c59499b tempest-VolumeAndVolumeTypeFromImageTest-158823705 None] Temporary image 74fd60c8-fff1-405b-804d-503fa5d44ef6 for user 62eafbf1740a4581903c848095c13d1c is deleted. {{(pid=86890) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 02 10:17:28 devstack cinder-volume[86890]: DEBUG cinder.volume.volume_utils [None req-93c27d71-09c1-42bc-950a-28193c59499b tempest-VolumeAndVolumeTypeFromImageTest-158823705 None] Marking volume b7fcb236-9e9f-4854-8616-a4fea3ded0a5 as bootable. {{(pid=86890) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 02 10:17:28 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-93c27d71-09c1-42bc-950a-28193c59499b tempest-VolumeAndVolumeTypeFromImageTest-158823705 None] Copying metadata from image 74fd60c8-fff1-405b-804d-503fa5d44ef6 to b7fcb236-9e9f-4854-8616-a4fea3ded0a5. {{(pid=86890) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 10:17:28 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-93c27d71-09c1-42bc-950a-28193c59499b tempest-VolumeAndVolumeTypeFromImageTest-158823705 None] Creating volume glance metadata for volume b7fcb236-9e9f-4854-8616-a4fea3ded0a5 backed by image 74fd60c8-fff1-405b-804d-503fa5d44ef6 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '74fd60c8-fff1-405b-804d-503fa5d44ef6', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '9fcc47392efa209726f1b6ed6229dd17', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86890) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 10:17:28 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-93c27d71-09c1-42bc-950a-28193c59499b tempest-VolumeAndVolumeTypeFromImageTest-158823705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12158b35-2be9-401d-a4fd-34c597febc33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7fcb236-9e9f-4854-8616-a4fea3ded0a5', 'volume_size': 1, 'image_id': '74fd60c8-fff1-405b-804d-503fa5d44ef6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/74fd60c8-fff1-405b-804d-503fa5d44ef6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9fcc47392efa209726f1b6ed6229dd17', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '383c8f5432784f7c8c6839f593729f03', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd91e374652eecc01080aa8cb54c3890c873786a46f2b3ab687993c05e27158f77f6bf7ba8401a7ca70bd234a7f2bf49fea35efa99a0ba3410e16ad907ee40628', 'id': '74fd60c8-fff1-405b-804d-503fa5d44ef6', 'created_at': datetime.datetime(2026, 11, 2, 9, 17, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 17, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/74fd60c8-fff1-405b-804d-503fa5d44ef6/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:28 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-93c27d71-09c1-42bc-950a-28193c59499b tempest-VolumeAndVolumeTypeFromImageTest-158823705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff8bae0a-f535-4340-a9d7-dcc50f2638e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:28 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-93c27d71-09c1-42bc-950a-28193c59499b tempest-VolumeAndVolumeTypeFromImageTest-158823705 None] Volume volume-b7fcb236-9e9f-4854-8616-a4fea3ded0a5 (b7fcb236-9e9f-4854-8616-a4fea3ded0a5): created successfully Nov 02 10:17:28 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-93c27d71-09c1-42bc-950a-28193c59499b tempest-VolumeAndVolumeTypeFromImageTest-158823705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff8bae0a-f535-4340-a9d7-dcc50f2638e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:28 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-93c27d71-09c1-42bc-950a-28193c59499b tempest-VolumeAndVolumeTypeFromImageTest-158823705 None] Flow 'volume_create_manager' (3e5f2ab5-4ac1-4af4-905b-253b237ae393) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:17:28 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-93c27d71-09c1-42bc-950a-28193c59499b tempest-VolumeAndVolumeTypeFromImageTest-158823705 None] Created volume successfully. Nov 02 10:17:29 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-11a4a140-4c40-4ce3-9f59-061adbad05ce tempest-VolumeAndVolumeTypeFromImageTest-158823705 None] Acquiring lock "cinder-b7fcb236-9e9f-4854-8616-a4fea3ded0a5-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:17:29 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-11a4a140-4c40-4ce3-9f59-061adbad05ce tempest-VolumeAndVolumeTypeFromImageTest-158823705 None] Lock "cinder-b7fcb236-9e9f-4854-8616-a4fea3ded0a5-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:17:29 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-11a4a140-4c40-4ce3-9f59-061adbad05ce tempest-VolumeAndVolumeTypeFromImageTest-158823705 None] Acquiring lock "cinder-quobyte-b7fcb236-9e9f-4854-8616-a4fea3ded0a5" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:17:30 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-11a4a140-4c40-4ce3-9f59-061adbad05ce tempest-VolumeAndVolumeTypeFromImageTest-158823705 None] Lock "cinder-quobyte-b7fcb236-9e9f-4854-8616-a4fea3ded0a5" acquired by "delete_volume" :: waited 0.037s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:17:30 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6070a6b-d731-4477-a6f7-d38973d534a1]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:17:30 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-11a4a140-4c40-4ce3-9f59-061adbad05ce tempest-VolumeAndVolumeTypeFromImageTest-158823705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b7fcb236-9e9f-4854-8616-a4fea3ded0a5 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:30 devstack sudo[101183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b7fcb236-9e9f-4854-8616-a4fea3ded0a5 Nov 02 10:17:30 devstack sudo[101183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:30 devstack sudo[101183]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:30 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-11a4a140-4c40-4ce3-9f59-061adbad05ce tempest-VolumeAndVolumeTypeFromImageTest-158823705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b7fcb236-9e9f-4854-8616-a4fea3ded0a5" returned: 0 in 0.551s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:30 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-11a4a140-4c40-4ce3-9f59-061adbad05ce tempest-VolumeAndVolumeTypeFromImageTest-158823705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b7fcb236-9e9f-4854-8616-a4fea3ded0a5 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:30 devstack sudo[101189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b7fcb236-9e9f-4854-8616-a4fea3ded0a5 Nov 02 10:17:30 devstack sudo[101189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:30 devstack sudo[101189]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:30 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-11a4a140-4c40-4ce3-9f59-061adbad05ce tempest-VolumeAndVolumeTypeFromImageTest-158823705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b7fcb236-9e9f-4854-8616-a4fea3ded0a5" returned: 0 in 0.334s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:30 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-11a4a140-4c40-4ce3-9f59-061adbad05ce tempest-VolumeAndVolumeTypeFromImageTest-158823705 None] Lock "cinder-quobyte-b7fcb236-9e9f-4854-8616-a4fea3ded0a5" released by "delete_volume" :: held 0.972s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:17:31 devstack cinder-volume[86890]: WARNING cinder.quota [None req-11a4a140-4c40-4ce3-9f59-061adbad05ce tempest-VolumeAndVolumeTypeFromImageTest-158823705 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:17:31 devstack cinder-volume[86890]: WARNING cinder.quota [None req-11a4a140-4c40-4ce3-9f59-061adbad05ce tempest-VolumeAndVolumeTypeFromImageTest-158823705 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:17:31 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-11a4a140-4c40-4ce3-9f59-061adbad05ce tempest-VolumeAndVolumeTypeFromImageTest-158823705 None] Created reservations ['507506a2-d688-4b19-8460-10d9ea8b593f', 'ca11f336-bdb6-4603-b4ad-216ff098bb9e', 'a4441266-6459-42fe-977c-cb7869cf67e6', '5050f692-9bca-4407-bd97-6504f2f0c701'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:17:31 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-11a4a140-4c40-4ce3-9f59-061adbad05ce tempest-VolumeAndVolumeTypeFromImageTest-158823705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:17:31 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-11a4a140-4c40-4ce3-9f59-061adbad05ce tempest-VolumeAndVolumeTypeFromImageTest-158823705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:17:31 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-11a4a140-4c40-4ce3-9f59-061adbad05ce tempest-VolumeAndVolumeTypeFromImageTest-158823705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:17:31 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-11a4a140-4c40-4ce3-9f59-061adbad05ce tempest-VolumeAndVolumeTypeFromImageTest-158823705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:17:31 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-11a4a140-4c40-4ce3-9f59-061adbad05ce tempest-VolumeAndVolumeTypeFromImageTest-158823705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:17:31 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-11a4a140-4c40-4ce3-9f59-061adbad05ce tempest-VolumeAndVolumeTypeFromImageTest-158823705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:31 devstack sudo[101193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:17:31 devstack sudo[101193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:31 devstack sudo[101193]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:31 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-11a4a140-4c40-4ce3-9f59-061adbad05ce tempest-VolumeAndVolumeTypeFromImageTest-158823705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.331s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:31 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-11a4a140-4c40-4ce3-9f59-061adbad05ce tempest-VolumeAndVolumeTypeFromImageTest-158823705 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:17:31 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-11a4a140-4c40-4ce3-9f59-061adbad05ce tempest-VolumeAndVolumeTypeFromImageTest-158823705 None] Deleted volume successfully. Nov 02 10:17:31 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-11a4a140-4c40-4ce3-9f59-061adbad05ce tempest-VolumeAndVolumeTypeFromImageTest-158823705 None] Lock "cinder-b7fcb236-9e9f-4854-8616-a4fea3ded0a5-delete_volume" released by "delete_volume" :: held 1.773s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:17:34 devstack cinder-volume[86890]: DEBUG oslo_service.periodic_task [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86890) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:17:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:17:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:17:34 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:17:34 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:17:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:17:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:34 devstack sudo[101222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:17:34 devstack sudo[101222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:35 devstack sudo[101222]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:35 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.328s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:35 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:17:35 devstack cinder-volume[86890]: DEBUG oslo_service.periodic_task [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Running periodic task VolumeManager._thread_info {{(pid=86890) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:17:35 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] thread count: 29 {{(pid=86890) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:17:35 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] thread info: [<_MainThread(MainThread, started 133913319395456)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86890) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:17:41 devstack cinder-volume[86890]: DEBUG dbcounter [-] [86890] Writing DB stats cinder:SELECT=21,cinder:UPDATE=20,cinder:INSERT=5 {{(pid=86890) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:17:41 devstack cinder-volume[86890]: DEBUG dbcounter [-] [86890] Writing DB stats cinder:UPDATE=14,cinder:SELECT=22,cinder:DELETE=3,cinder:INSERT=11 {{(pid=86890) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:17:50 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-18b7c770-b971-447d-9c8a-fefae2e3feb4 tempest-TestInstancesWithCinderVolumes-2022269773 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:17:50 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-18b7c770-b971-447d-9c8a-fefae2e3feb4 tempest-TestInstancesWithCinderVolumes-2022269773 None] Flow 'volume_create_manager' (8bf65af4-d99f-405c-8cb5-9140a434e5fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:17:50 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-18b7c770-b971-447d-9c8a-fefae2e3feb4 tempest-TestInstancesWithCinderVolumes-2022269773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d771b057-36cf-4bc3-901b-28aa6f3b891a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:50 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-18b7c770-b971-447d-9c8a-fefae2e3feb4 tempest-TestInstancesWithCinderVolumes-2022269773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d771b057-36cf-4bc3-901b-28aa6f3b891a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:17:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1401327984',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b5de093-9a6d-45da-a334-778047ed2172,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='777a994b2bfa4d90b2cdff93c30e2743',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:17:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:17:50Z,use_quota=True,user_id='99c9693ef3dd4b8eb21ea202e8cf4d5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57f29cce-9f42-4830-a54c-ef3def40617e),volume_type_id=57f29cce-9f42-4830-a54c-ef3def40617e)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:50 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-18b7c770-b971-447d-9c8a-fefae2e3feb4 tempest-TestInstancesWithCinderVolumes-2022269773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ae2a5f5-563b-4259-a29c-f5dd53503503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:50 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-18b7c770-b971-447d-9c8a-fefae2e3feb4 tempest-TestInstancesWithCinderVolumes-2022269773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ae2a5f5-563b-4259-a29c-f5dd53503503) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:50 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-18b7c770-b971-447d-9c8a-fefae2e3feb4 tempest-TestInstancesWithCinderVolumes-2022269773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1338fc7f-44ef-40d5-b978-e786939b293c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:50 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-18b7c770-b971-447d-9c8a-fefae2e3feb4 tempest-TestInstancesWithCinderVolumes-2022269773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1338fc7f-44ef-40d5-b978-e786939b293c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b5de093-9a6d-45da-a334-778047ed2172', 'volume_name': 'volume-0b5de093-9a6d-45da-a334-778047ed2172', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:50 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-18b7c770-b971-447d-9c8a-fefae2e3feb4 tempest-TestInstancesWithCinderVolumes-2022269773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa2fb058-266f-4049-a18c-ae61a993d079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:50 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-18b7c770-b971-447d-9c8a-fefae2e3feb4 tempest-TestInstancesWithCinderVolumes-2022269773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa2fb058-266f-4049-a18c-ae61a993d079) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:50 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-18b7c770-b971-447d-9c8a-fefae2e3feb4 tempest-TestInstancesWithCinderVolumes-2022269773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0d6d946-2cd1-49d6-8884-2ff41e5958b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:50 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-18b7c770-b971-447d-9c8a-fefae2e3feb4 tempest-TestInstancesWithCinderVolumes-2022269773 None] Volume 0b5de093-9a6d-45da-a334-778047ed2172: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b5de093-9a6d-45da-a334-778047ed2172', 'volume_size': 1} Nov 02 10:17:50 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-18b7c770-b971-447d-9c8a-fefae2e3feb4 tempest-TestInstancesWithCinderVolumes-2022269773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:17:50 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-18b7c770-b971-447d-9c8a-fefae2e3feb4 tempest-TestInstancesWithCinderVolumes-2022269773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:17:50 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-18b7c770-b971-447d-9c8a-fefae2e3feb4 tempest-TestInstancesWithCinderVolumes-2022269773 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:17:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1401327984',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b5de093-9a6d-45da-a334-778047ed2172,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='777a994b2bfa4d90b2cdff93c30e2743',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:17:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:17:50Z,use_quota=True,user_id='99c9693ef3dd4b8eb21ea202e8cf4d5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57f29cce-9f42-4830-a54c-ef3def40617e),volume_type_id=57f29cce-9f42-4830-a54c-ef3def40617e)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:17:50 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-18b7c770-b971-447d-9c8a-fefae2e3feb4 tempest-TestInstancesWithCinderVolumes-2022269773 None] Creating volume 0b5de093-9a6d-45da-a334-778047ed2172 {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:17:50 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-18b7c770-b971-447d-9c8a-fefae2e3feb4 tempest-TestInstancesWithCinderVolumes-2022269773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:17:50 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-18b7c770-b971-447d-9c8a-fefae2e3feb4 tempest-TestInstancesWithCinderVolumes-2022269773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:17:50 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-18b7c770-b971-447d-9c8a-fefae2e3feb4 tempest-TestInstancesWithCinderVolumes-2022269773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:17:50 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-18b7c770-b971-447d-9c8a-fefae2e3feb4 tempest-TestInstancesWithCinderVolumes-2022269773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:17:50 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-18b7c770-b971-447d-9c8a-fefae2e3feb4 tempest-TestInstancesWithCinderVolumes-2022269773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:17:50 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-18b7c770-b971-447d-9c8a-fefae2e3feb4 tempest-TestInstancesWithCinderVolumes-2022269773 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:17:50 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-18b7c770-b971-447d-9c8a-fefae2e3feb4 tempest-TestInstancesWithCinderVolumes-2022269773 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:17:50 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-18b7c770-b971-447d-9c8a-fefae2e3feb4 tempest-TestInstancesWithCinderVolumes-2022269773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-0b5de093-9a6d-45da-a334-778047ed2172 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:50 devstack sudo[101283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-0b5de093-9a6d-45da-a334-778047ed2172 1073741824 Nov 02 10:17:50 devstack sudo[101283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:50 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-6968f5e8-7e25-44ba-bfb5-117f28f89733 tempest-TestInstancesWithCinderVolumes-2022269773 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:17:50 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-6968f5e8-7e25-44ba-bfb5-117f28f89733 tempest-TestInstancesWithCinderVolumes-2022269773 None] Flow 'volume_create_manager' (8556aa7a-60c3-4b3b-b699-cdd47ce0daab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:17:50 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-6968f5e8-7e25-44ba-bfb5-117f28f89733 tempest-TestInstancesWithCinderVolumes-2022269773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2db03bfb-b0f1-41ae-8105-7855e927bb19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:50 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-6968f5e8-7e25-44ba-bfb5-117f28f89733 tempest-TestInstancesWithCinderVolumes-2022269773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2db03bfb-b0f1-41ae-8105-7855e927bb19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:17:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1149325653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05db1fad-12fa-4f16-bc7b-dac1b8c5d5fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='777a994b2bfa4d90b2cdff93c30e2743',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:17:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:17:51Z,use_quota=True,user_id='99c9693ef3dd4b8eb21ea202e8cf4d5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c5c8ee2-514a-43c8-a7e4-7aa0de45a0be),volume_type_id=5c5c8ee2-514a-43c8-a7e4-7aa0de45a0be)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:50 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-6968f5e8-7e25-44ba-bfb5-117f28f89733 tempest-TestInstancesWithCinderVolumes-2022269773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef87dbf3-b9cf-49f3-aa6e-f55c7a027196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:50 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-6968f5e8-7e25-44ba-bfb5-117f28f89733 tempest-TestInstancesWithCinderVolumes-2022269773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef87dbf3-b9cf-49f3-aa6e-f55c7a027196) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:51 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-6968f5e8-7e25-44ba-bfb5-117f28f89733 tempest-TestInstancesWithCinderVolumes-2022269773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (524c43e7-dc9c-4d2e-bef8-192d38eee2e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:51 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-6968f5e8-7e25-44ba-bfb5-117f28f89733 tempest-TestInstancesWithCinderVolumes-2022269773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (524c43e7-dc9c-4d2e-bef8-192d38eee2e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05db1fad-12fa-4f16-bc7b-dac1b8c5d5fe', 'volume_name': 'volume-05db1fad-12fa-4f16-bc7b-dac1b8c5d5fe', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:51 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-6968f5e8-7e25-44ba-bfb5-117f28f89733 tempest-TestInstancesWithCinderVolumes-2022269773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a18673a-e0d5-4e36-ace8-029b960c224b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:51 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-6968f5e8-7e25-44ba-bfb5-117f28f89733 tempest-TestInstancesWithCinderVolumes-2022269773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a18673a-e0d5-4e36-ace8-029b960c224b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:51 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-6968f5e8-7e25-44ba-bfb5-117f28f89733 tempest-TestInstancesWithCinderVolumes-2022269773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd2813a8-0ab8-4a99-8172-7489eb08c11e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:51 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-6968f5e8-7e25-44ba-bfb5-117f28f89733 tempest-TestInstancesWithCinderVolumes-2022269773 None] Volume 05db1fad-12fa-4f16-bc7b-dac1b8c5d5fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05db1fad-12fa-4f16-bc7b-dac1b8c5d5fe', 'volume_size': 1} Nov 02 10:17:51 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-6968f5e8-7e25-44ba-bfb5-117f28f89733 tempest-TestInstancesWithCinderVolumes-2022269773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:17:51 devstack sudo[101283]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:51 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-18b7c770-b971-447d-9c8a-fefae2e3feb4 tempest-TestInstancesWithCinderVolumes-2022269773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-0b5de093-9a6d-45da-a334-778047ed2172 1073741824" returned: 0 in 0.845s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:51 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-18b7c770-b971-447d-9c8a-fefae2e3feb4 tempest-TestInstancesWithCinderVolumes-2022269773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-0b5de093-9a6d-45da-a334-778047ed2172 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:51 devstack sudo[101289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-0b5de093-9a6d-45da-a334-778047ed2172 Nov 02 10:17:51 devstack sudo[101289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:51 devstack sudo[101289]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:51 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-18b7c770-b971-447d-9c8a-fefae2e3feb4 tempest-TestInstancesWithCinderVolumes-2022269773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-0b5de093-9a6d-45da-a334-778047ed2172" returned: 0 in 0.359s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:51 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-18b7c770-b971-447d-9c8a-fefae2e3feb4 tempest-TestInstancesWithCinderVolumes-2022269773 None] <== create_volume: return (1286ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:17:51 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-18b7c770-b971-447d-9c8a-fefae2e3feb4 tempest-TestInstancesWithCinderVolumes-2022269773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.290s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:17:51 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-6968f5e8-7e25-44ba-bfb5-117f28f89733 tempest-TestInstancesWithCinderVolumes-2022269773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.554s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:17:51 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-6968f5e8-7e25-44ba-bfb5-117f28f89733 tempest-TestInstancesWithCinderVolumes-2022269773 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:17:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1149325653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05db1fad-12fa-4f16-bc7b-dac1b8c5d5fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='777a994b2bfa4d90b2cdff93c30e2743',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:17:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:17:51Z,use_quota=True,user_id='99c9693ef3dd4b8eb21ea202e8cf4d5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c5c8ee2-514a-43c8-a7e4-7aa0de45a0be),volume_type_id=5c5c8ee2-514a-43c8-a7e4-7aa0de45a0be)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:17:51 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-6968f5e8-7e25-44ba-bfb5-117f28f89733 tempest-TestInstancesWithCinderVolumes-2022269773 None] Creating volume 05db1fad-12fa-4f16-bc7b-dac1b8c5d5fe {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:17:51 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-6968f5e8-7e25-44ba-bfb5-117f28f89733 tempest-TestInstancesWithCinderVolumes-2022269773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:17:51 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-6968f5e8-7e25-44ba-bfb5-117f28f89733 tempest-TestInstancesWithCinderVolumes-2022269773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:17:51 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-6968f5e8-7e25-44ba-bfb5-117f28f89733 tempest-TestInstancesWithCinderVolumes-2022269773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:17:51 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-6968f5e8-7e25-44ba-bfb5-117f28f89733 tempest-TestInstancesWithCinderVolumes-2022269773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:17:51 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-6968f5e8-7e25-44ba-bfb5-117f28f89733 tempest-TestInstancesWithCinderVolumes-2022269773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:17:51 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-6968f5e8-7e25-44ba-bfb5-117f28f89733 tempest-TestInstancesWithCinderVolumes-2022269773 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:17:51 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-6968f5e8-7e25-44ba-bfb5-117f28f89733 tempest-TestInstancesWithCinderVolumes-2022269773 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:17:51 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6968f5e8-7e25-44ba-bfb5-117f28f89733 tempest-TestInstancesWithCinderVolumes-2022269773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-05db1fad-12fa-4f16-bc7b-dac1b8c5d5fe 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:51 devstack sudo[101292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-05db1fad-12fa-4f16-bc7b-dac1b8c5d5fe 1073741824 Nov 02 10:17:51 devstack sudo[101292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:51 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-18b7c770-b971-447d-9c8a-fefae2e3feb4 tempest-TestInstancesWithCinderVolumes-2022269773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0d6d946-2cd1-49d6-8884-2ff41e5958b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b5de093-9a6d-45da-a334-778047ed2172', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:51 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-18b7c770-b971-447d-9c8a-fefae2e3feb4 tempest-TestInstancesWithCinderVolumes-2022269773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ad6d13f-ab53-4840-b6a7-ae1acb7519df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:51 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-18b7c770-b971-447d-9c8a-fefae2e3feb4 tempest-TestInstancesWithCinderVolumes-2022269773 None] Volume volume-0b5de093-9a6d-45da-a334-778047ed2172 (0b5de093-9a6d-45da-a334-778047ed2172): created successfully Nov 02 10:17:51 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-18b7c770-b971-447d-9c8a-fefae2e3feb4 tempest-TestInstancesWithCinderVolumes-2022269773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ad6d13f-ab53-4840-b6a7-ae1acb7519df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:51 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-18b7c770-b971-447d-9c8a-fefae2e3feb4 tempest-TestInstancesWithCinderVolumes-2022269773 None] Flow 'volume_create_manager' (8bf65af4-d99f-405c-8cb5-9140a434e5fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:17:51 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-18b7c770-b971-447d-9c8a-fefae2e3feb4 tempest-TestInstancesWithCinderVolumes-2022269773 None] Created volume successfully. Nov 02 10:17:51 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-228b409e-e65a-4683-b10a-e2ca4ab2ffda tempest-TestInstancesWithCinderVolumes-2022269773 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:17:51 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-228b409e-e65a-4683-b10a-e2ca4ab2ffda tempest-TestInstancesWithCinderVolumes-2022269773 None] Flow 'volume_create_manager' (4eeae442-d094-45d8-b6d9-8c365957be36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:17:51 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-228b409e-e65a-4683-b10a-e2ca4ab2ffda tempest-TestInstancesWithCinderVolumes-2022269773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5e7cbbf-8e8f-45f2-ac2c-d545cf137994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:51 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-228b409e-e65a-4683-b10a-e2ca4ab2ffda tempest-TestInstancesWithCinderVolumes-2022269773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5e7cbbf-8e8f-45f2-ac2c-d545cf137994) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:17:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1966107582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=780ccc66-bbb1-418e-bfc6-1b3a9ba18405,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='777a994b2bfa4d90b2cdff93c30e2743',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:17:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:17:52Z,use_quota=True,user_id='99c9693ef3dd4b8eb21ea202e8cf4d5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e2d75017-8319-48a8-bc26-61144d9e91be),volume_type_id=e2d75017-8319-48a8-bc26-61144d9e91be)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:51 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-228b409e-e65a-4683-b10a-e2ca4ab2ffda tempest-TestInstancesWithCinderVolumes-2022269773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a79a56e-8a7e-4373-ba3d-0e1d03e3dc0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:51 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-228b409e-e65a-4683-b10a-e2ca4ab2ffda tempest-TestInstancesWithCinderVolumes-2022269773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a79a56e-8a7e-4373-ba3d-0e1d03e3dc0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:51 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-228b409e-e65a-4683-b10a-e2ca4ab2ffda tempest-TestInstancesWithCinderVolumes-2022269773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adf5619e-7bef-4956-a5a8-9d8bdcf09f53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:51 devstack cinder-volume[86890]: DEBUG cinder.image.glance [None req-228b409e-e65a-4683-b10a-e2ca4ab2ffda tempest-TestInstancesWithCinderVolumes-2022269773 None] Creating Keystone auth plugin from conf {{(pid=86890) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 10:17:52 devstack sudo[101292]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:52 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6968f5e8-7e25-44ba-bfb5-117f28f89733 tempest-TestInstancesWithCinderVolumes-2022269773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-05db1fad-12fa-4f16-bc7b-dac1b8c5d5fe 1073741824" returned: 0 in 0.744s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:52 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6968f5e8-7e25-44ba-bfb5-117f28f89733 tempest-TestInstancesWithCinderVolumes-2022269773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-05db1fad-12fa-4f16-bc7b-dac1b8c5d5fe {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:52 devstack sudo[101298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-05db1fad-12fa-4f16-bc7b-dac1b8c5d5fe Nov 02 10:17:52 devstack sudo[101298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:52 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-228b409e-e65a-4683-b10a-e2ca4ab2ffda tempest-TestInstancesWithCinderVolumes-2022269773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adf5619e-7bef-4956-a5a8-9d8bdcf09f53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '780ccc66-bbb1-418e-bfc6-1b3a9ba18405', 'volume_name': 'volume-780ccc66-bbb1-418e-bfc6-1b3a9ba18405', 'volume_size': 1, 'image_id': '04d636b8-6591-4f88-a0fb-8355049ca7ad', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/04d636b8-6591-4f88-a0fb-8355049ca7ad', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--517032835', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '777a994b2bfa4d90b2cdff93c30e2743', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '04d636b8-6591-4f88-a0fb-8355049ca7ad', 'created_at': datetime.datetime(2026, 11, 2, 9, 17, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 17, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/04d636b8-6591-4f88-a0fb-8355049ca7ad/file', 'properties': {}}, 'image_service': }' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:52 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-228b409e-e65a-4683-b10a-e2ca4ab2ffda tempest-TestInstancesWithCinderVolumes-2022269773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45a4523d-72ef-4377-83a7-ef6a39b6781d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:52 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-228b409e-e65a-4683-b10a-e2ca4ab2ffda tempest-TestInstancesWithCinderVolumes-2022269773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45a4523d-72ef-4377-83a7-ef6a39b6781d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:52 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-228b409e-e65a-4683-b10a-e2ca4ab2ffda tempest-TestInstancesWithCinderVolumes-2022269773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4828b618-1fdf-4e97-9556-2da46a2d4ca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:52 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-228b409e-e65a-4683-b10a-e2ca4ab2ffda tempest-TestInstancesWithCinderVolumes-2022269773 None] Volume 780ccc66-bbb1-418e-bfc6-1b3a9ba18405: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-780ccc66-bbb1-418e-bfc6-1b3a9ba18405', 'volume_size': 1, 'image_id': '04d636b8-6591-4f88-a0fb-8355049ca7ad', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/04d636b8-6591-4f88-a0fb-8355049ca7ad', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--517032835', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '777a994b2bfa4d90b2cdff93c30e2743', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '04d636b8-6591-4f88-a0fb-8355049ca7ad', 'created_at': datetime.datetime(2026, 11, 2, 9, 17, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 17, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/04d636b8-6591-4f88-a0fb-8355049ca7ad/file', 'properties': {}}, 'image_service': } Nov 02 10:17:52 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-228b409e-e65a-4683-b10a-e2ca4ab2ffda tempest-TestInstancesWithCinderVolumes-2022269773 None] Trying to clone 780ccc66-bbb1-418e-bfc6-1b3a9ba18405 from image 04d636b8-6591-4f88-a0fb-8355049ca7ad at location (None, [{'url': 'file:///opt/stack/data/glance/images/04d636b8-6591-4f88-a0fb-8355049ca7ad', 'metadata': {}}]). {{(pid=86890) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 02 10:17:52 devstack sudo[101298]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:52 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6968f5e8-7e25-44ba-bfb5-117f28f89733 tempest-TestInstancesWithCinderVolumes-2022269773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-05db1fad-12fa-4f16-bc7b-dac1b8c5d5fe" returned: 0 in 0.364s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:52 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-6968f5e8-7e25-44ba-bfb5-117f28f89733 tempest-TestInstancesWithCinderVolumes-2022269773 None] <== create_volume: return (1186ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:17:52 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-6968f5e8-7e25-44ba-bfb5-117f28f89733 tempest-TestInstancesWithCinderVolumes-2022269773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.188s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:17:52 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-6968f5e8-7e25-44ba-bfb5-117f28f89733 tempest-TestInstancesWithCinderVolumes-2022269773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd2813a8-0ab8-4a99-8172-7489eb08c11e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05db1fad-12fa-4f16-bc7b-dac1b8c5d5fe', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:52 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-6968f5e8-7e25-44ba-bfb5-117f28f89733 tempest-TestInstancesWithCinderVolumes-2022269773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffd8dda9-cb12-4d25-becd-291d0e37c93c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:52 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-6968f5e8-7e25-44ba-bfb5-117f28f89733 tempest-TestInstancesWithCinderVolumes-2022269773 None] Volume volume-05db1fad-12fa-4f16-bc7b-dac1b8c5d5fe (05db1fad-12fa-4f16-bc7b-dac1b8c5d5fe): created successfully Nov 02 10:17:52 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-6968f5e8-7e25-44ba-bfb5-117f28f89733 tempest-TestInstancesWithCinderVolumes-2022269773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffd8dda9-cb12-4d25-becd-291d0e37c93c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:52 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-6968f5e8-7e25-44ba-bfb5-117f28f89733 tempest-TestInstancesWithCinderVolumes-2022269773 None] Flow 'volume_create_manager' (8556aa7a-60c3-4b3b-b699-cdd47ce0daab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:17:52 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-6968f5e8-7e25-44ba-bfb5-117f28f89733 tempest-TestInstancesWithCinderVolumes-2022269773 None] Created volume successfully. Nov 02 10:17:56 devstack cinder-volume[86890]: DEBUG cinder.image.image_utils [None req-228b409e-e65a-4683-b10a-e2ca4ab2ffda tempest-TestInstancesWithCinderVolumes-2022269773 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_04d636b8-6591-4f88-a0fb-8355049ca7ad_fss320sedevstack@QuobyteHD, size 20.69 MB, duration 4.02 sec {{(pid=86890) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 02 10:17:56 devstack cinder-volume[86890]: INFO cinder.image.image_utils [None req-228b409e-e65a-4683-b10a-e2ca4ab2ffda tempest-TestInstancesWithCinderVolumes-2022269773 None] Image download 20.69 MB at 5.15 MB/s Nov 02 10:17:56 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c06214f-1e6c-47cf-8c42-fa914fbd8a88]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:17:56 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-228b409e-e65a-4683-b10a-e2ca4ab2ffda tempest-TestInstancesWithCinderVolumes-2022269773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_04d636b8-6591-4f88-a0fb-8355049ca7ad_fss320sedevstack@QuobyteHD {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:56 devstack sudo[101302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_04d636b8-6591-4f88-a0fb-8355049ca7ad_fss320sedevstack@QuobyteHD Nov 02 10:17:56 devstack sudo[101302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:56 devstack sudo[101302]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:56 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-228b409e-e65a-4683-b10a-e2ca4ab2ffda tempest-TestInstancesWithCinderVolumes-2022269773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_04d636b8-6591-4f88-a0fb-8355049ca7ad_fss320sedevstack@QuobyteHD" returned: 0 in 0.366s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:56 devstack cinder-volume[86890]: DEBUG cinder.image.image_utils [None req-228b409e-e65a-4683-b10a-e2ca4ab2ffda tempest-TestInstancesWithCinderVolumes-2022269773 None] Temporary image 04d636b8-6591-4f88-a0fb-8355049ca7ad is fetched for user 99c9693ef3dd4b8eb21ea202e8cf4d5d. {{(pid=86890) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 02 10:17:57 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f726bab-ee90-4178-a414-8d7f75b74f1d]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:17:57 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-228b409e-e65a-4683-b10a-e2ca4ab2ffda tempest-TestInstancesWithCinderVolumes-2022269773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_04d636b8-6591-4f88-a0fb-8355049ca7ad_fss320sedevstack@QuobyteHD {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:57 devstack sudo[101307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_04d636b8-6591-4f88-a0fb-8355049ca7ad_fss320sedevstack@QuobyteHD Nov 02 10:17:57 devstack sudo[101307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:57 devstack sudo[101307]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:57 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-228b409e-e65a-4683-b10a-e2ca4ab2ffda tempest-TestInstancesWithCinderVolumes-2022269773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_04d636b8-6591-4f88-a0fb-8355049ca7ad_fss320sedevstack@QuobyteHD" returned: 0 in 0.353s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:57 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-228b409e-e65a-4683-b10a-e2ca4ab2ffda tempest-TestInstancesWithCinderVolumes-2022269773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:17:57 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-228b409e-e65a-4683-b10a-e2ca4ab2ffda tempest-TestInstancesWithCinderVolumes-2022269773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:17:57 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-228b409e-e65a-4683-b10a-e2ca4ab2ffda tempest-TestInstancesWithCinderVolumes-2022269773 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:17:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1966107582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=780ccc66-bbb1-418e-bfc6-1b3a9ba18405,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='777a994b2bfa4d90b2cdff93c30e2743',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:17:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:17:52Z,use_quota=True,user_id='99c9693ef3dd4b8eb21ea202e8cf4d5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e2d75017-8319-48a8-bc26-61144d9e91be),volume_type_id=e2d75017-8319-48a8-bc26-61144d9e91be)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:17:57 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-228b409e-e65a-4683-b10a-e2ca4ab2ffda tempest-TestInstancesWithCinderVolumes-2022269773 None] Creating volume 780ccc66-bbb1-418e-bfc6-1b3a9ba18405 {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:17:57 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-228b409e-e65a-4683-b10a-e2ca4ab2ffda tempest-TestInstancesWithCinderVolumes-2022269773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:17:57 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-228b409e-e65a-4683-b10a-e2ca4ab2ffda tempest-TestInstancesWithCinderVolumes-2022269773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:17:57 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-228b409e-e65a-4683-b10a-e2ca4ab2ffda tempest-TestInstancesWithCinderVolumes-2022269773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:17:57 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-228b409e-e65a-4683-b10a-e2ca4ab2ffda tempest-TestInstancesWithCinderVolumes-2022269773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:17:57 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-228b409e-e65a-4683-b10a-e2ca4ab2ffda tempest-TestInstancesWithCinderVolumes-2022269773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:17:57 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-228b409e-e65a-4683-b10a-e2ca4ab2ffda tempest-TestInstancesWithCinderVolumes-2022269773 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:17:57 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-228b409e-e65a-4683-b10a-e2ca4ab2ffda tempest-TestInstancesWithCinderVolumes-2022269773 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:17:57 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-228b409e-e65a-4683-b10a-e2ca4ab2ffda tempest-TestInstancesWithCinderVolumes-2022269773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-780ccc66-bbb1-418e-bfc6-1b3a9ba18405 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:57 devstack sudo[101313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-780ccc66-bbb1-418e-bfc6-1b3a9ba18405 1073741824 Nov 02 10:17:57 devstack sudo[101313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:57 devstack sudo[101313]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:57 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-228b409e-e65a-4683-b10a-e2ca4ab2ffda tempest-TestInstancesWithCinderVolumes-2022269773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-780ccc66-bbb1-418e-bfc6-1b3a9ba18405 1073741824" returned: 0 in 0.530s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:58 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-228b409e-e65a-4683-b10a-e2ca4ab2ffda tempest-TestInstancesWithCinderVolumes-2022269773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-780ccc66-bbb1-418e-bfc6-1b3a9ba18405 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:58 devstack sudo[101320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-780ccc66-bbb1-418e-bfc6-1b3a9ba18405 Nov 02 10:17:58 devstack sudo[101320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:58 devstack sudo[101320]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:58 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-228b409e-e65a-4683-b10a-e2ca4ab2ffda tempest-TestInstancesWithCinderVolumes-2022269773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-780ccc66-bbb1-418e-bfc6-1b3a9ba18405" returned: 0 in 0.374s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:58 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-228b409e-e65a-4683-b10a-e2ca4ab2ffda tempest-TestInstancesWithCinderVolumes-2022269773 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:17:58 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-228b409e-e65a-4683-b10a-e2ca4ab2ffda tempest-TestInstancesWithCinderVolumes-2022269773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.980s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:17:58 devstack cinder-volume[86890]: DEBUG cinder.volume.volume_utils [None req-228b409e-e65a-4683-b10a-e2ca4ab2ffda tempest-TestInstancesWithCinderVolumes-2022269773 None] Attempting download of 04d636b8-6591-4f88-a0fb-8355049ca7ad ((None, [{'url': 'file:///opt/stack/data/glance/images/04d636b8-6591-4f88-a0fb-8355049ca7ad', 'metadata': {}}])) to volume 780ccc66-bbb1-418e-bfc6-1b3a9ba18405. {{(pid=86890) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 02 10:17:58 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[961e3bbc-4cc1-4aaf-a489-5fd60a631a59]: (4, 'raw') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:17:58 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-228b409e-e65a-4683-b10a-e2ca4ab2ffda tempest-TestInstancesWithCinderVolumes-2022269773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_04d636b8-6591-4f88-a0fb-8355049ca7ad_fp7vqdyf {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:58 devstack sudo[101323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_04d636b8-6591-4f88-a0fb-8355049ca7ad_fp7vqdyf Nov 02 10:17:58 devstack sudo[101323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:58 devstack sudo[101323]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:58 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-228b409e-e65a-4683-b10a-e2ca4ab2ffda tempest-TestInstancesWithCinderVolumes-2022269773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_04d636b8-6591-4f88-a0fb-8355049ca7ad_fp7vqdyf" returned: 0 in 0.363s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:58 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-228b409e-e65a-4683-b10a-e2ca4ab2ffda tempest-TestInstancesWithCinderVolumes-2022269773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_04d636b8-6591-4f88-a0fb-8355049ca7ad_fp7vqdyf {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:58 devstack sudo[101327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_04d636b8-6591-4f88-a0fb-8355049ca7ad_fp7vqdyf Nov 02 10:17:58 devstack sudo[101327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:59 devstack sudo[101327]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:59 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-228b409e-e65a-4683-b10a-e2ca4ab2ffda tempest-TestInstancesWithCinderVolumes-2022269773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_04d636b8-6591-4f88-a0fb-8355049ca7ad_fp7vqdyf" returned: 1 in 0.571s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:59 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-228b409e-e65a-4683-b10a-e2ca4ab2ffda tempest-TestInstancesWithCinderVolumes-2022269773 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_04d636b8-6591-4f88-a0fb-8355049ca7ad_fp7vqdyf' failed. Not Retrying. {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 10:17:59 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[0239703a-294e-4e7b-be06-b79d904b0947]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:17:59 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-228b409e-e65a-4683-b10a-e2ca4ab2ffda tempest-TestInstancesWithCinderVolumes-2022269773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_04d636b8-6591-4f88-a0fb-8355049ca7ad_fss320sedevstack@QuobyteHD {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:59 devstack sudo[101331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_04d636b8-6591-4f88-a0fb-8355049ca7ad_fss320sedevstack@QuobyteHD Nov 02 10:17:59 devstack sudo[101331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:59 devstack sudo[101331]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:59 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-228b409e-e65a-4683-b10a-e2ca4ab2ffda tempest-TestInstancesWithCinderVolumes-2022269773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_04d636b8-6591-4f88-a0fb-8355049ca7ad_fss320sedevstack@QuobyteHD" returned: 0 in 0.439s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:59 devstack cinder-volume[86890]: DEBUG cinder.image.image_utils [None req-228b409e-e65a-4683-b10a-e2ca4ab2ffda tempest-TestInstancesWithCinderVolumes-2022269773 None] 04d636b8-6591-4f88-a0fb-8355049ca7ad was qcow2, converting to qcow2 {{(pid=86890) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 02 10:17:59 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-228b409e-e65a-4683-b10a-e2ca4ab2ffda tempest-TestInstancesWithCinderVolumes-2022269773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_04d636b8-6591-4f88-a0fb-8355049ca7ad_fss320sedevstack@QuobyteHD /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-780ccc66-bbb1-418e-bfc6-1b3a9ba18405 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:59 devstack sudo[101336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_04d636b8-6591-4f88-a0fb-8355049ca7ad_fss320sedevstack@QuobyteHD /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-780ccc66-bbb1-418e-bfc6-1b3a9ba18405 Nov 02 10:17:59 devstack sudo[101336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:02 devstack sudo[101336]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:02 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-228b409e-e65a-4683-b10a-e2ca4ab2ffda tempest-TestInstancesWithCinderVolumes-2022269773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_04d636b8-6591-4f88-a0fb-8355049ca7ad_fss320sedevstack@QuobyteHD /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-780ccc66-bbb1-418e-bfc6-1b3a9ba18405" returned: 0 in 2.499s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:02 devstack cinder-volume[86890]: DEBUG cinder.image.image_utils [None req-228b409e-e65a-4683-b10a-e2ca4ab2ffda tempest-TestInstancesWithCinderVolumes-2022269773 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_04d636b8-6591-4f88-a0fb-8355049ca7ad_fss320sedevstack@QuobyteHD, size 112.00 MB, duration 2.50 sec, destination /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-780ccc66-bbb1-418e-bfc6-1b3a9ba18405 {{(pid=86890) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 10:18:02 devstack cinder-volume[86890]: INFO cinder.image.image_utils [None req-228b409e-e65a-4683-b10a-e2ca4ab2ffda tempest-TestInstancesWithCinderVolumes-2022269773 None] Converted 112.00 MB image at 44.79 MB/s Nov 02 10:18:02 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-228b409e-e65a-4683-b10a-e2ca4ab2ffda tempest-TestInstancesWithCinderVolumes-2022269773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-780ccc66-bbb1-418e-bfc6-1b3a9ba18405 1G {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:02 devstack sudo[101348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-780ccc66-bbb1-418e-bfc6-1b3a9ba18405 1G Nov 02 10:18:02 devstack sudo[101348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:02 devstack sudo[101348]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:02 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-228b409e-e65a-4683-b10a-e2ca4ab2ffda tempest-TestInstancesWithCinderVolumes-2022269773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-780ccc66-bbb1-418e-bfc6-1b3a9ba18405 1G" returned: 0 in 0.438s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:02 devstack cinder-volume[86890]: DEBUG cinder.volume.volume_utils [None req-228b409e-e65a-4683-b10a-e2ca4ab2ffda tempest-TestInstancesWithCinderVolumes-2022269773 None] Downloaded image 04d636b8-6591-4f88-a0fb-8355049ca7ad ((None, [{'url': 'file:///opt/stack/data/glance/images/04d636b8-6591-4f88-a0fb-8355049ca7ad', 'metadata': {}}])) to volume 780ccc66-bbb1-418e-bfc6-1b3a9ba18405 successfully. {{(pid=86890) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 02 10:18:02 devstack cinder-volume[86890]: DEBUG cinder.image.image_utils [None req-228b409e-e65a-4683-b10a-e2ca4ab2ffda tempest-TestInstancesWithCinderVolumes-2022269773 None] Temporary image 04d636b8-6591-4f88-a0fb-8355049ca7ad for user 99c9693ef3dd4b8eb21ea202e8cf4d5d is deleted. {{(pid=86890) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 02 10:18:02 devstack cinder-volume[86890]: DEBUG cinder.volume.volume_utils [None req-228b409e-e65a-4683-b10a-e2ca4ab2ffda tempest-TestInstancesWithCinderVolumes-2022269773 None] Marking volume 780ccc66-bbb1-418e-bfc6-1b3a9ba18405 as bootable. {{(pid=86890) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 02 10:18:02 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-228b409e-e65a-4683-b10a-e2ca4ab2ffda tempest-TestInstancesWithCinderVolumes-2022269773 None] Copying metadata from image 04d636b8-6591-4f88-a0fb-8355049ca7ad to 780ccc66-bbb1-418e-bfc6-1b3a9ba18405. {{(pid=86890) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 10:18:02 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-228b409e-e65a-4683-b10a-e2ca4ab2ffda tempest-TestInstancesWithCinderVolumes-2022269773 None] Creating volume glance metadata for volume 780ccc66-bbb1-418e-bfc6-1b3a9ba18405 backed by image 04d636b8-6591-4f88-a0fb-8355049ca7ad with: {'image_id': '04d636b8-6591-4f88-a0fb-8355049ca7ad', 'image_name': 'tempest-scenario-img--517032835', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86890) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 10:18:02 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-228b409e-e65a-4683-b10a-e2ca4ab2ffda tempest-TestInstancesWithCinderVolumes-2022269773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4828b618-1fdf-4e97-9556-2da46a2d4ca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-780ccc66-bbb1-418e-bfc6-1b3a9ba18405', 'volume_size': 1, 'image_id': '04d636b8-6591-4f88-a0fb-8355049ca7ad', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/04d636b8-6591-4f88-a0fb-8355049ca7ad', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--517032835', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '777a994b2bfa4d90b2cdff93c30e2743', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '04d636b8-6591-4f88-a0fb-8355049ca7ad', 'created_at': datetime.datetime(2026, 11, 2, 9, 17, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 17, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/04d636b8-6591-4f88-a0fb-8355049ca7ad/file', 'properties': {}}, 'image_service': }' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:18:02 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-228b409e-e65a-4683-b10a-e2ca4ab2ffda tempest-TestInstancesWithCinderVolumes-2022269773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db5976c3-8a26-41f3-a8e5-a43e5b37b9bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:18:02 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-228b409e-e65a-4683-b10a-e2ca4ab2ffda tempest-TestInstancesWithCinderVolumes-2022269773 None] Volume volume-780ccc66-bbb1-418e-bfc6-1b3a9ba18405 (780ccc66-bbb1-418e-bfc6-1b3a9ba18405): created successfully Nov 02 10:18:02 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-228b409e-e65a-4683-b10a-e2ca4ab2ffda tempest-TestInstancesWithCinderVolumes-2022269773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db5976c3-8a26-41f3-a8e5-a43e5b37b9bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:18:02 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-228b409e-e65a-4683-b10a-e2ca4ab2ffda tempest-TestInstancesWithCinderVolumes-2022269773 None] Flow 'volume_create_manager' (4eeae442-d094-45d8-b6d9-8c365957be36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:18:03 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-228b409e-e65a-4683-b10a-e2ca4ab2ffda tempest-TestInstancesWithCinderVolumes-2022269773 None] Created volume successfully. Nov 02 10:18:07 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [req-1a272792-5e36-4757-9742-d2be071020a1 req-b5fc8923-ca0d-4f33-9818-4d7868034fd0 tempest-TestInstancesWithCinderVolumes-2022269773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:18:07 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [req-1a272792-5e36-4757-9742-d2be071020a1 req-b5fc8923-ca0d-4f33-9818-4d7868034fd0 tempest-TestInstancesWithCinderVolumes-2022269773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:18:07 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [req-1a272792-5e36-4757-9742-d2be071020a1 req-b5fc8923-ca0d-4f33-9818-4d7868034fd0 tempest-TestInstancesWithCinderVolumes-2022269773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.054s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:18:07 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [req-1a272792-5e36-4757-9742-d2be071020a1 req-b5fc8923-ca0d-4f33-9818-4d7868034fd0 tempest-TestInstancesWithCinderVolumes-2022269773 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67', 'name': 'volume-780ccc66-bbb1-418e-bfc6-1b3a9ba18405', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '76b4019c-1d40-4226-9775-58cea3c044bf', 'enforce_multipath': True} {{(pid=86890) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:18:07 devstack cinder-volume[86890]: INFO cinder.volume.manager [req-1a272792-5e36-4757-9742-d2be071020a1 req-b5fc8923-ca0d-4f33-9818-4d7868034fd0 tempest-TestInstancesWithCinderVolumes-2022269773 None] attachment_update completed successfully. Nov 02 10:18:17 devstack cinder-volume[86890]: DEBUG dbcounter [-] [86890] Writing DB stats cinder:SELECT=19,cinder:UPDATE=15,cinder:INSERT=4,cinder:DELETE=1 {{(pid=86890) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:18:17 devstack cinder-volume[86890]: DEBUG dbcounter [-] [86890] Writing DB stats cinder:SELECT=17,cinder:UPDATE=9,cinder:DELETE=2,cinder:INSERT=8 {{(pid=86890) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:18:18 devstack cinder-volume[86890]: INFO cinder.volume.manager [req-8ac74136-9f45-484e-bf2f-61648fa6197b req-59c41a0c-9521-445d-b495-d7d304a68a16 tempest-TestMinimumBasicScenario-161405133 None] Terminate volume connection completed successfully. Nov 02 10:18:18 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [req-8ac74136-9f45-484e-bf2f-61648fa6197b req-59c41a0c-9521-445d-b495-d7d304a68a16 tempest-TestMinimumBasicScenario-161405133 None] Deleting attachment 99ad175c-e6bd-4386-96d8-a19b597c1eff. {{(pid=86890) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:18:18 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1764374-2cdb-4e38-9d6a-d7ca626dbd07 tempest-SnapshotDependencyTests-2059383465 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:18:18 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-e1764374-2cdb-4e38-9d6a-d7ca626dbd07 tempest-SnapshotDependencyTests-2059383465 None] Flow 'volume_create_manager' (c455fdfe-2b28-4b6b-b300-fe4273459fd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:18:18 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-e1764374-2cdb-4e38-9d6a-d7ca626dbd07 tempest-SnapshotDependencyTests-2059383465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc7f312e-0bdf-48a9-9b8f-6f57b1e4a4a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:18:18 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-e1764374-2cdb-4e38-9d6a-d7ca626dbd07 tempest-SnapshotDependencyTests-2059383465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc7f312e-0bdf-48a9-9b8f-6f57b1e4a4a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:18:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-87481905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31135ac0-35fd-4037-85cc-e6561bc7fdfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9779f5eb39844b59be923ca461a2582',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:18:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:18:18Z,use_quota=True,user_id='31c46195f4f641a9997d3aada7dac07b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:18:18 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-e1764374-2cdb-4e38-9d6a-d7ca626dbd07 tempest-SnapshotDependencyTests-2059383465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07708e2a-81ab-4400-98ef-768547b6be86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:18:18 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-e1764374-2cdb-4e38-9d6a-d7ca626dbd07 tempest-SnapshotDependencyTests-2059383465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07708e2a-81ab-4400-98ef-768547b6be86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:18:18 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-e1764374-2cdb-4e38-9d6a-d7ca626dbd07 tempest-SnapshotDependencyTests-2059383465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b91d141f-08c6-44f5-aa6c-bb9ce34b1e18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:18:18 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-e1764374-2cdb-4e38-9d6a-d7ca626dbd07 tempest-SnapshotDependencyTests-2059383465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b91d141f-08c6-44f5-aa6c-bb9ce34b1e18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31135ac0-35fd-4037-85cc-e6561bc7fdfb', 'volume_name': 'volume-31135ac0-35fd-4037-85cc-e6561bc7fdfb', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:18:18 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-e1764374-2cdb-4e38-9d6a-d7ca626dbd07 tempest-SnapshotDependencyTests-2059383465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a62768e-230d-4dcf-80b6-d4547055fb8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:18:18 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-e1764374-2cdb-4e38-9d6a-d7ca626dbd07 tempest-SnapshotDependencyTests-2059383465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a62768e-230d-4dcf-80b6-d4547055fb8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:18:18 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-e1764374-2cdb-4e38-9d6a-d7ca626dbd07 tempest-SnapshotDependencyTests-2059383465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34763803-7d94-4ab4-8faf-997c9f7c1f5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:18:18 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-e1764374-2cdb-4e38-9d6a-d7ca626dbd07 tempest-SnapshotDependencyTests-2059383465 None] Volume 31135ac0-35fd-4037-85cc-e6561bc7fdfb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31135ac0-35fd-4037-85cc-e6561bc7fdfb', 'volume_size': 1} Nov 02 10:18:18 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-e1764374-2cdb-4e38-9d6a-d7ca626dbd07 tempest-SnapshotDependencyTests-2059383465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:18:18 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-e1764374-2cdb-4e38-9d6a-d7ca626dbd07 tempest-SnapshotDependencyTests-2059383465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:18:18 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-e1764374-2cdb-4e38-9d6a-d7ca626dbd07 tempest-SnapshotDependencyTests-2059383465 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:18:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-87481905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31135ac0-35fd-4037-85cc-e6561bc7fdfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9779f5eb39844b59be923ca461a2582',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:18:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:18:18Z,use_quota=True,user_id='31c46195f4f641a9997d3aada7dac07b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:18:18 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-e1764374-2cdb-4e38-9d6a-d7ca626dbd07 tempest-SnapshotDependencyTests-2059383465 None] Creating volume 31135ac0-35fd-4037-85cc-e6561bc7fdfb {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:18:18 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-e1764374-2cdb-4e38-9d6a-d7ca626dbd07 tempest-SnapshotDependencyTests-2059383465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:18:18 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-e1764374-2cdb-4e38-9d6a-d7ca626dbd07 tempest-SnapshotDependencyTests-2059383465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:18:18 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-e1764374-2cdb-4e38-9d6a-d7ca626dbd07 tempest-SnapshotDependencyTests-2059383465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:18:18 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-e1764374-2cdb-4e38-9d6a-d7ca626dbd07 tempest-SnapshotDependencyTests-2059383465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:18:18 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-e1764374-2cdb-4e38-9d6a-d7ca626dbd07 tempest-SnapshotDependencyTests-2059383465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:18:18 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-e1764374-2cdb-4e38-9d6a-d7ca626dbd07 tempest-SnapshotDependencyTests-2059383465 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:18:18 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-e1764374-2cdb-4e38-9d6a-d7ca626dbd07 tempest-SnapshotDependencyTests-2059383465 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:18:18 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-e1764374-2cdb-4e38-9d6a-d7ca626dbd07 tempest-SnapshotDependencyTests-2059383465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-31135ac0-35fd-4037-85cc-e6561bc7fdfb 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:18 devstack sudo[101499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-31135ac0-35fd-4037-85cc-e6561bc7fdfb 1073741824 Nov 02 10:18:18 devstack sudo[101499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:19 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-ebf8ab58-3782-441b-9d49-217f9161bc17 tempest-TestMinimumBasicScenario-161405133 None] Acquiring lock "cinder-01c21bfe-a179-41f9-97f6-5f8853d942a7-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:18:19 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-ebf8ab58-3782-441b-9d49-217f9161bc17 tempest-TestMinimumBasicScenario-161405133 None] Lock "cinder-01c21bfe-a179-41f9-97f6-5f8853d942a7-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:18:19 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-ebf8ab58-3782-441b-9d49-217f9161bc17 tempest-TestMinimumBasicScenario-161405133 None] Acquiring lock "cinder-quobyte-01c21bfe-a179-41f9-97f6-5f8853d942a7" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:18:19 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-ebf8ab58-3782-441b-9d49-217f9161bc17 tempest-TestMinimumBasicScenario-161405133 None] Lock "cinder-quobyte-01c21bfe-a179-41f9-97f6-5f8853d942a7" acquired by "delete_volume" :: waited 0.029s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:18:19 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[93bd800c-c1f6-4c7b-bc15-990c565bc8d0]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:18:19 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ebf8ab58-3782-441b-9d49-217f9161bc17 tempest-TestMinimumBasicScenario-161405133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-01c21bfe-a179-41f9-97f6-5f8853d942a7 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:19 devstack sudo[101499]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:19 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-e1764374-2cdb-4e38-9d6a-d7ca626dbd07 tempest-SnapshotDependencyTests-2059383465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-31135ac0-35fd-4037-85cc-e6561bc7fdfb 1073741824" returned: 0 in 0.813s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:19 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-e1764374-2cdb-4e38-9d6a-d7ca626dbd07 tempest-SnapshotDependencyTests-2059383465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-31135ac0-35fd-4037-85cc-e6561bc7fdfb {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:19 devstack sudo[101506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-31135ac0-35fd-4037-85cc-e6561bc7fdfb Nov 02 10:18:19 devstack sudo[101506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:19 devstack sudo[101505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-01c21bfe-a179-41f9-97f6-5f8853d942a7 Nov 02 10:18:19 devstack sudo[101505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:19 devstack sudo[101506]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:19 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-e1764374-2cdb-4e38-9d6a-d7ca626dbd07 tempest-SnapshotDependencyTests-2059383465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-31135ac0-35fd-4037-85cc-e6561bc7fdfb" returned: 0 in 0.352s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:19 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-e1764374-2cdb-4e38-9d6a-d7ca626dbd07 tempest-SnapshotDependencyTests-2059383465 None] <== create_volume: return (1256ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:18:19 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-e1764374-2cdb-4e38-9d6a-d7ca626dbd07 tempest-SnapshotDependencyTests-2059383465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.259s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:18:19 devstack sudo[101505]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:19 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ebf8ab58-3782-441b-9d49-217f9161bc17 tempest-TestMinimumBasicScenario-161405133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-01c21bfe-a179-41f9-97f6-5f8853d942a7" returned: 0 in 0.491s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:19 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ebf8ab58-3782-441b-9d49-217f9161bc17 tempest-TestMinimumBasicScenario-161405133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-01c21bfe-a179-41f9-97f6-5f8853d942a7 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:19 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-e1764374-2cdb-4e38-9d6a-d7ca626dbd07 tempest-SnapshotDependencyTests-2059383465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34763803-7d94-4ab4-8faf-997c9f7c1f5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31135ac0-35fd-4037-85cc-e6561bc7fdfb', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:18:19 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-e1764374-2cdb-4e38-9d6a-d7ca626dbd07 tempest-SnapshotDependencyTests-2059383465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (300d554f-d19e-42d5-8576-d737e290a95d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:18:19 devstack sudo[101514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-01c21bfe-a179-41f9-97f6-5f8853d942a7 Nov 02 10:18:19 devstack sudo[101514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:19 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-e1764374-2cdb-4e38-9d6a-d7ca626dbd07 tempest-SnapshotDependencyTests-2059383465 None] Volume volume-31135ac0-35fd-4037-85cc-e6561bc7fdfb (31135ac0-35fd-4037-85cc-e6561bc7fdfb): created successfully Nov 02 10:18:19 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-e1764374-2cdb-4e38-9d6a-d7ca626dbd07 tempest-SnapshotDependencyTests-2059383465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (300d554f-d19e-42d5-8576-d737e290a95d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:18:19 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-e1764374-2cdb-4e38-9d6a-d7ca626dbd07 tempest-SnapshotDependencyTests-2059383465 None] Flow 'volume_create_manager' (c455fdfe-2b28-4b6b-b300-fe4273459fd8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:18:19 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-e1764374-2cdb-4e38-9d6a-d7ca626dbd07 tempest-SnapshotDependencyTests-2059383465 None] Created volume successfully. Nov 02 10:18:20 devstack sudo[101514]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:20 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ebf8ab58-3782-441b-9d49-217f9161bc17 tempest-TestMinimumBasicScenario-161405133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-01c21bfe-a179-41f9-97f6-5f8853d942a7" returned: 0 in 0.336s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:20 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-ebf8ab58-3782-441b-9d49-217f9161bc17 tempest-TestMinimumBasicScenario-161405133 None] Lock "cinder-quobyte-01c21bfe-a179-41f9-97f6-5f8853d942a7" released by "delete_volume" :: held 0.887s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:18:20 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-ebf8ab58-3782-441b-9d49-217f9161bc17 tempest-TestMinimumBasicScenario-161405133 None] Created reservations ['d89a3210-e0b6-4199-a8d0-e79d93e5d3f8', '589a6539-ff52-418a-b7c6-c9f8ecc64688', '3d0eccf8-2365-4f32-98a9-78e0e0b01613', '103c81b5-76e1-4223-a7df-1e4d8825e252'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:18:20 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-ebf8ab58-3782-441b-9d49-217f9161bc17 tempest-TestMinimumBasicScenario-161405133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:18:20 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-ebf8ab58-3782-441b-9d49-217f9161bc17 tempest-TestMinimumBasicScenario-161405133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:18:20 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-ebf8ab58-3782-441b-9d49-217f9161bc17 tempest-TestMinimumBasicScenario-161405133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:18:20 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-ebf8ab58-3782-441b-9d49-217f9161bc17 tempest-TestMinimumBasicScenario-161405133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:18:20 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-ebf8ab58-3782-441b-9d49-217f9161bc17 tempest-TestMinimumBasicScenario-161405133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:18:20 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ebf8ab58-3782-441b-9d49-217f9161bc17 tempest-TestMinimumBasicScenario-161405133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:20 devstack sudo[101517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:18:20 devstack sudo[101517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:20 devstack sudo[101517]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:20 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ebf8ab58-3782-441b-9d49-217f9161bc17 tempest-TestMinimumBasicScenario-161405133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.706s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:20 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-ebf8ab58-3782-441b-9d49-217f9161bc17 tempest-TestMinimumBasicScenario-161405133 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:18:20 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-ebf8ab58-3782-441b-9d49-217f9161bc17 tempest-TestMinimumBasicScenario-161405133 None] Deleted volume successfully. Nov 02 10:18:20 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-24e41014-bd40-46df-865a-ddeff35f68b3 tempest-SnapshotDependencyTests-2059383465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:18:20 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-24e41014-bd40-46df-865a-ddeff35f68b3 tempest-SnapshotDependencyTests-2059383465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:18:20 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-24e41014-bd40-46df-865a-ddeff35f68b3 tempest-SnapshotDependencyTests-2059383465 None] Creating offline snapshot c9ab12c5-3753-4c4a-b9cb-401f39e28718 of volume 31135ac0-35fd-4037-85cc-e6561bc7fdfb {{(pid=86890) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:18:21 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-ebf8ab58-3782-441b-9d49-217f9161bc17 tempest-TestMinimumBasicScenario-161405133 None] Lock "cinder-01c21bfe-a179-41f9-97f6-5f8853d942a7-delete_volume" released by "delete_volume" :: held 1.981s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:18:21 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ba80727-420e-4cf6-b65c-0784895118ff]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:18:21 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-24e41014-bd40-46df-865a-ddeff35f68b3 tempest-SnapshotDependencyTests-2059383465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-31135ac0-35fd-4037-85cc-e6561bc7fdfb {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:21 devstack sudo[101532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-31135ac0-35fd-4037-85cc-e6561bc7fdfb Nov 02 10:18:21 devstack sudo[101532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:21 devstack sudo[101532]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:21 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-24e41014-bd40-46df-865a-ddeff35f68b3 tempest-SnapshotDependencyTests-2059383465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-31135ac0-35fd-4037-85cc-e6561bc7fdfb" returned: 0 in 0.741s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:21 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-24e41014-bd40-46df-865a-ddeff35f68b3 tempest-SnapshotDependencyTests-2059383465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-31135ac0-35fd-4037-85cc-e6561bc7fdfb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-31135ac0-35fd-4037-85cc-e6561bc7fdfb.c9ab12c5-3753-4c4a-b9cb-401f39e28718 1G {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:21 devstack sudo[101548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-31135ac0-35fd-4037-85cc-e6561bc7fdfb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-31135ac0-35fd-4037-85cc-e6561bc7fdfb.c9ab12c5-3753-4c4a-b9cb-401f39e28718 1G Nov 02 10:18:21 devstack sudo[101548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:22 devstack sudo[101548]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:22 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-24e41014-bd40-46df-865a-ddeff35f68b3 tempest-SnapshotDependencyTests-2059383465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-31135ac0-35fd-4037-85cc-e6561bc7fdfb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-31135ac0-35fd-4037-85cc-e6561bc7fdfb.c9ab12c5-3753-4c4a-b9cb-401f39e28718 1G" returned: 0 in 0.665s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:22 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-24e41014-bd40-46df-865a-ddeff35f68b3 tempest-SnapshotDependencyTests-2059383465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31135ac0-35fd-4037-85cc-e6561bc7fdfb -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-31135ac0-35fd-4037-85cc-e6561bc7fdfb.c9ab12c5-3753-4c4a-b9cb-401f39e28718 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:22 devstack sudo[101555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31135ac0-35fd-4037-85cc-e6561bc7fdfb -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-31135ac0-35fd-4037-85cc-e6561bc7fdfb.c9ab12c5-3753-4c4a-b9cb-401f39e28718 Nov 02 10:18:22 devstack sudo[101555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:22 devstack sudo[101555]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:22 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-24e41014-bd40-46df-865a-ddeff35f68b3 tempest-SnapshotDependencyTests-2059383465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31135ac0-35fd-4037-85cc-e6561bc7fdfb -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-31135ac0-35fd-4037-85cc-e6561bc7fdfb.c9ab12c5-3753-4c4a-b9cb-401f39e28718" returned: 0 in 0.373s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:22 devstack cinder-volume[86890]: WARNING cinder.volume.drivers.remotefs [None req-24e41014-bd40-46df-865a-ddeff35f68b3 tempest-SnapshotDependencyTests-2059383465 None] /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-31135ac0-35fd-4037-85cc-e6561bc7fdfb.c9ab12c5-3753-4c4a-b9cb-401f39e28718 is being set with open permissions: ugo+rw Nov 02 10:18:22 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-24e41014-bd40-46df-865a-ddeff35f68b3 tempest-SnapshotDependencyTests-2059383465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-31135ac0-35fd-4037-85cc-e6561bc7fdfb.c9ab12c5-3753-4c4a-b9cb-401f39e28718 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:22 devstack sudo[101561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-31135ac0-35fd-4037-85cc-e6561bc7fdfb.c9ab12c5-3753-4c4a-b9cb-401f39e28718 Nov 02 10:18:22 devstack sudo[101561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:23 devstack sudo[101561]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:23 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-24e41014-bd40-46df-865a-ddeff35f68b3 tempest-SnapshotDependencyTests-2059383465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-31135ac0-35fd-4037-85cc-e6561bc7fdfb.c9ab12c5-3753-4c4a-b9cb-401f39e28718" returned: 0 in 0.291s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:23 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-24e41014-bd40-46df-865a-ddeff35f68b3 tempest-SnapshotDependencyTests-2059383465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-31135ac0-35fd-4037-85cc-e6561bc7fdfb.info {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:23 devstack sudo[101564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-31135ac0-35fd-4037-85cc-e6561bc7fdfb.info Nov 02 10:18:23 devstack sudo[101564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:23 devstack sudo[101564]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:23 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-24e41014-bd40-46df-865a-ddeff35f68b3 tempest-SnapshotDependencyTests-2059383465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-31135ac0-35fd-4037-85cc-e6561bc7fdfb.info" returned: 0 in 0.515s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:23 devstack cinder-volume[86890]: WARNING cinder.volume.drivers.remotefs [None req-24e41014-bd40-46df-865a-ddeff35f68b3 tempest-SnapshotDependencyTests-2059383465 None] /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-31135ac0-35fd-4037-85cc-e6561bc7fdfb.info is being set with open permissions: ugo+rw Nov 02 10:18:23 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-24e41014-bd40-46df-865a-ddeff35f68b3 tempest-SnapshotDependencyTests-2059383465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-31135ac0-35fd-4037-85cc-e6561bc7fdfb.info {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:23 devstack sudo[101569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-31135ac0-35fd-4037-85cc-e6561bc7fdfb.info Nov 02 10:18:23 devstack sudo[101569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:24 devstack sudo[101569]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:24 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-24e41014-bd40-46df-865a-ddeff35f68b3 tempest-SnapshotDependencyTests-2059383465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-31135ac0-35fd-4037-85cc-e6561bc7fdfb.info" returned: 0 in 0.505s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:24 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-24e41014-bd40-46df-865a-ddeff35f68b3 tempest-SnapshotDependencyTests-2059383465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.299s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:18:24 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-24e41014-bd40-46df-865a-ddeff35f68b3 tempest-SnapshotDependencyTests-2059383465 None] Create snapshot completed successfully Nov 02 10:18:26 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-8680810b-1cd4-418e-9c39-172f7d0f1e1f tempest-SnapshotDependencyTests-2059383465 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:18:26 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-8680810b-1cd4-418e-9c39-172f7d0f1e1f tempest-SnapshotDependencyTests-2059383465 None] Flow 'volume_create_manager' (5f3db85d-a3ae-4f30-888d-f1f3a4c75e9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:18:26 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-8680810b-1cd4-418e-9c39-172f7d0f1e1f tempest-SnapshotDependencyTests-2059383465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2859d167-9ba0-4929-8376-1ea91ea4f1b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:18:26 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-8680810b-1cd4-418e-9c39-172f7d0f1e1f tempest-SnapshotDependencyTests-2059383465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2859d167-9ba0-4929-8376-1ea91ea4f1b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:18:26Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2acf997a-c109-4792-9cb6-46e501024290,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9779f5eb39844b59be923ca461a2582',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:18:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c9ab12c5-3753-4c4a-b9cb-401f39e28718,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:18:26Z,use_quota=True,user_id='31c46195f4f641a9997d3aada7dac07b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:18:26 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-8680810b-1cd4-418e-9c39-172f7d0f1e1f tempest-SnapshotDependencyTests-2059383465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65f49b24-6958-4eed-9888-8eedb89eeb79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:18:26 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-8680810b-1cd4-418e-9c39-172f7d0f1e1f tempest-SnapshotDependencyTests-2059383465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65f49b24-6958-4eed-9888-8eedb89eeb79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:18:26 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-8680810b-1cd4-418e-9c39-172f7d0f1e1f tempest-SnapshotDependencyTests-2059383465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8ace0c2-1f97-40a1-a565-95eb576a64a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:18:26 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-8680810b-1cd4-418e-9c39-172f7d0f1e1f tempest-SnapshotDependencyTests-2059383465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8ace0c2-1f97-40a1-a565-95eb576a64a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2acf997a-c109-4792-9cb6-46e501024290', 'volume_name': 'volume-2acf997a-c109-4792-9cb6-46e501024290', 'volume_size': 1, 'snapshot_id': 'c9ab12c5-3753-4c4a-b9cb-401f39e28718'}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:18:26 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-8680810b-1cd4-418e-9c39-172f7d0f1e1f tempest-SnapshotDependencyTests-2059383465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3417f29-ccdc-48e1-90f8-35253b78f73b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:18:26 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-8680810b-1cd4-418e-9c39-172f7d0f1e1f tempest-SnapshotDependencyTests-2059383465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3417f29-ccdc-48e1-90f8-35253b78f73b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:18:26 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-8680810b-1cd4-418e-9c39-172f7d0f1e1f tempest-SnapshotDependencyTests-2059383465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d82f6c9-2885-4ff7-b113-7749c76e1fbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:18:26 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-8680810b-1cd4-418e-9c39-172f7d0f1e1f tempest-SnapshotDependencyTests-2059383465 None] Volume 2acf997a-c109-4792-9cb6-46e501024290: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2acf997a-c109-4792-9cb6-46e501024290', 'volume_size': 1, 'snapshot_id': 'c9ab12c5-3753-4c4a-b9cb-401f39e28718'} Nov 02 10:18:26 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-8680810b-1cd4-418e-9c39-172f7d0f1e1f tempest-SnapshotDependencyTests-2059383465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:18:26 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-8680810b-1cd4-418e-9c39-172f7d0f1e1f tempest-SnapshotDependencyTests-2059383465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:18:26 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-8680810b-1cd4-418e-9c39-172f7d0f1e1f tempest-SnapshotDependencyTests-2059383465 None] Acquiring lock "cinder-quobyte-c9ab12c5-3753-4c4a-b9cb-401f39e28718-2acf997a-c109-4792-9cb6-46e501024290" by "_create_volume_from_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:18:26 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-8680810b-1cd4-418e-9c39-172f7d0f1e1f tempest-SnapshotDependencyTests-2059383465 None] Lock "cinder-quobyte-c9ab12c5-3753-4c4a-b9cb-401f39e28718-2acf997a-c109-4792-9cb6-46e501024290" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:18:26 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-8680810b-1cd4-418e-9c39-172f7d0f1e1f tempest-SnapshotDependencyTests-2059383465 None] Creating volume 2acf997a-c109-4792-9cb6-46e501024290 from snapshot c9ab12c5-3753-4c4a-b9cb-401f39e28718 {{(pid=86890) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 02 10:18:26 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-8680810b-1cd4-418e-9c39-172f7d0f1e1f tempest-SnapshotDependencyTests-2059383465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:18:26 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-8680810b-1cd4-418e-9c39-172f7d0f1e1f tempest-SnapshotDependencyTests-2059383465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:18:26 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-8680810b-1cd4-418e-9c39-172f7d0f1e1f tempest-SnapshotDependencyTests-2059383465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:18:26 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-8680810b-1cd4-418e-9c39-172f7d0f1e1f tempest-SnapshotDependencyTests-2059383465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:18:26 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-8680810b-1cd4-418e-9c39-172f7d0f1e1f tempest-SnapshotDependencyTests-2059383465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:18:26 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-8680810b-1cd4-418e-9c39-172f7d0f1e1f tempest-SnapshotDependencyTests-2059383465 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:18:26 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-8680810b-1cd4-418e-9c39-172f7d0f1e1f tempest-SnapshotDependencyTests-2059383465 None] Acquiring lock "cinder-quobyte-2acf997a-c109-4792-9cb6-46e501024290" by "_copy_volume_from_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:18:26 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-8680810b-1cd4-418e-9c39-172f7d0f1e1f tempest-SnapshotDependencyTests-2059383465 None] Lock "cinder-quobyte-2acf997a-c109-4792-9cb6-46e501024290" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:18:26 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-8680810b-1cd4-418e-9c39-172f7d0f1e1f tempest-SnapshotDependencyTests-2059383465 None] snapshot: c9ab12c5-3753-4c4a-b9cb-401f39e28718, volume: 2acf997a-c109-4792-9cb6-46e501024290, {{(pid=86890) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 10:18:26 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-8680810b-1cd4-418e-9c39-172f7d0f1e1f tempest-SnapshotDependencyTests-2059383465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:18:26 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-8680810b-1cd4-418e-9c39-172f7d0f1e1f tempest-SnapshotDependencyTests-2059383465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:18:26 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-8680810b-1cd4-418e-9c39-172f7d0f1e1f tempest-SnapshotDependencyTests-2059383465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:18:26 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-8680810b-1cd4-418e-9c39-172f7d0f1e1f tempest-SnapshotDependencyTests-2059383465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:18:26 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-8680810b-1cd4-418e-9c39-172f7d0f1e1f tempest-SnapshotDependencyTests-2059383465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:18:26 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[dffc7173-33df-49ab-bc82-b8bdd334c326]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:18:26 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8680810b-1cd4-418e-9c39-172f7d0f1e1f tempest-SnapshotDependencyTests-2059383465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-31135ac0-35fd-4037-85cc-e6561bc7fdfb.c9ab12c5-3753-4c4a-b9cb-401f39e28718 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:26 devstack sudo[101572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-31135ac0-35fd-4037-85cc-e6561bc7fdfb.c9ab12c5-3753-4c4a-b9cb-401f39e28718 Nov 02 10:18:26 devstack sudo[101572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:27 devstack sudo[101572]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:27 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8680810b-1cd4-418e-9c39-172f7d0f1e1f tempest-SnapshotDependencyTests-2059383465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-31135ac0-35fd-4037-85cc-e6561bc7fdfb.c9ab12c5-3753-4c4a-b9cb-401f39e28718" returned: 0 in 0.702s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:27 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-8680810b-1cd4-418e-9c39-172f7d0f1e1f tempest-SnapshotDependencyTests-2059383465 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-31135ac0-35fd-4037-85cc-e6561bc7fdfb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86890) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:18:27 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[e63efe65-9322-44de-99f3-6f9c4b47e904]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:18:27 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8680810b-1cd4-418e-9c39-172f7d0f1e1f tempest-SnapshotDependencyTests-2059383465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-31135ac0-35fd-4037-85cc-e6561bc7fdfb {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:27 devstack sudo[101578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-31135ac0-35fd-4037-85cc-e6561bc7fdfb Nov 02 10:18:27 devstack sudo[101578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:27 devstack sudo[101578]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:27 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8680810b-1cd4-418e-9c39-172f7d0f1e1f tempest-SnapshotDependencyTests-2059383465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-31135ac0-35fd-4037-85cc-e6561bc7fdfb" returned: 0 in 0.520s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:27 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-8680810b-1cd4-418e-9c39-172f7d0f1e1f tempest-SnapshotDependencyTests-2059383465 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-31135ac0-35fd-4037-85cc-e6561bc7fdfb {{(pid=86890) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 10:18:27 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-8680810b-1cd4-418e-9c39-172f7d0f1e1f tempest-SnapshotDependencyTests-2059383465 None] Creating direct copy from snapshot {{(pid=86890) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 10:18:27 devstack cinder-volume[86890]: DEBUG cinder.utils [None req-8680810b-1cd4-418e-9c39-172f7d0f1e1f tempest-SnapshotDependencyTests-2059383465 None] Path /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-2acf997a-c109-4792-9cb6-46e501024290 not found in is_blk_device check {{(pid=86890) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 10:18:27 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8680810b-1cd4-418e-9c39-172f7d0f1e1f tempest-SnapshotDependencyTests-2059383465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-31135ac0-35fd-4037-85cc-e6561bc7fdfb /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-2acf997a-c109-4792-9cb6-46e501024290 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:27 devstack sudo[101584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-31135ac0-35fd-4037-85cc-e6561bc7fdfb /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-2acf997a-c109-4792-9cb6-46e501024290 Nov 02 10:18:27 devstack sudo[101584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:34 devstack cinder-volume[86890]: DEBUG oslo_service.periodic_task [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86890) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:18:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:18:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:18:34 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:18:34 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:18:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:18:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:34 devstack sudo[101603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:18:34 devstack sudo[101603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:35 devstack sudo[101603]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:35 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.548s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:35 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:18:35 devstack cinder-volume[86890]: DEBUG oslo_service.periodic_task [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Running periodic task VolumeManager._thread_info {{(pid=86890) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:18:35 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] thread count: 29 {{(pid=86890) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:18:35 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] thread info: [<_MainThread(MainThread, started 133913319395456)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86890) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:18:35 devstack sudo[101584]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:35 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8680810b-1cd4-418e-9c39-172f7d0f1e1f tempest-SnapshotDependencyTests-2059383465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-31135ac0-35fd-4037-85cc-e6561bc7fdfb /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-2acf997a-c109-4792-9cb6-46e501024290" returned: 0 in 8.127s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:35 devstack cinder-volume[86890]: DEBUG cinder.image.image_utils [None req-8680810b-1cd4-418e-9c39-172f7d0f1e1f tempest-SnapshotDependencyTests-2059383465 None] Image conversion details: src /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-31135ac0-35fd-4037-85cc-e6561bc7fdfb, size 1024.00 MB, duration 8.13 sec, destination /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-2acf997a-c109-4792-9cb6-46e501024290 {{(pid=86890) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 10:18:35 devstack cinder-volume[86890]: INFO cinder.image.image_utils [None req-8680810b-1cd4-418e-9c39-172f7d0f1e1f tempest-SnapshotDependencyTests-2059383465 None] Converted 1024.00 MB image at 125.99 MB/s Nov 02 10:18:35 devstack cinder-volume[86890]: WARNING cinder.volume.drivers.remotefs [None req-8680810b-1cd4-418e-9c39-172f7d0f1e1f tempest-SnapshotDependencyTests-2059383465 None] /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-2acf997a-c109-4792-9cb6-46e501024290 is being set with open permissions: ugo+rw Nov 02 10:18:35 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8680810b-1cd4-418e-9c39-172f7d0f1e1f tempest-SnapshotDependencyTests-2059383465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-2acf997a-c109-4792-9cb6-46e501024290 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:35 devstack sudo[101608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-2acf997a-c109-4792-9cb6-46e501024290 Nov 02 10:18:35 devstack sudo[101608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:36 devstack sudo[101608]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:36 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8680810b-1cd4-418e-9c39-172f7d0f1e1f tempest-SnapshotDependencyTests-2059383465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-2acf997a-c109-4792-9cb6-46e501024290" returned: 0 in 0.245s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:36 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-8680810b-1cd4-418e-9c39-172f7d0f1e1f tempest-SnapshotDependencyTests-2059383465 None] Lock "cinder-quobyte-2acf997a-c109-4792-9cb6-46e501024290" released by "_copy_volume_from_snapshot" :: held 9.706s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:18:36 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-8680810b-1cd4-418e-9c39-172f7d0f1e1f tempest-SnapshotDependencyTests-2059383465 None] Lock "cinder-quobyte-c9ab12c5-3753-4c4a-b9cb-401f39e28718-2acf997a-c109-4792-9cb6-46e501024290" released by "_create_volume_from_snapshot" :: held 9.779s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:18:36 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-8680810b-1cd4-418e-9c39-172f7d0f1e1f tempest-SnapshotDependencyTests-2059383465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.802s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:18:36 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-8680810b-1cd4-418e-9c39-172f7d0f1e1f tempest-SnapshotDependencyTests-2059383465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d82f6c9-2885-4ff7-b113-7749c76e1fbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2acf997a-c109-4792-9cb6-46e501024290', 'volume_size': 1, 'snapshot_id': 'c9ab12c5-3753-4c4a-b9cb-401f39e28718'}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:18:36 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-8680810b-1cd4-418e-9c39-172f7d0f1e1f tempest-SnapshotDependencyTests-2059383465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7896a7c2-2390-4b58-969e-5baf41e84ac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:18:36 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-8680810b-1cd4-418e-9c39-172f7d0f1e1f tempest-SnapshotDependencyTests-2059383465 None] Volume volume-2acf997a-c109-4792-9cb6-46e501024290 (2acf997a-c109-4792-9cb6-46e501024290): created successfully Nov 02 10:18:36 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-8680810b-1cd4-418e-9c39-172f7d0f1e1f tempest-SnapshotDependencyTests-2059383465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7896a7c2-2390-4b58-969e-5baf41e84ac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:18:36 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-8680810b-1cd4-418e-9c39-172f7d0f1e1f tempest-SnapshotDependencyTests-2059383465 None] Flow 'volume_create_manager' (5f3db85d-a3ae-4f30-888d-f1f3a4c75e9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:18:36 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-8680810b-1cd4-418e-9c39-172f7d0f1e1f tempest-SnapshotDependencyTests-2059383465 None] Created volume successfully. Nov 02 10:18:37 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-aac2cd3a-36cd-4167-a72e-1cb7bbc88075 tempest-SnapshotDependencyTests-2059383465 None] Acquiring lock "cinder-c9ab12c5-3753-4c4a-b9cb-401f39e28718-delete_snapshot" by "delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:18:37 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-aac2cd3a-36cd-4167-a72e-1cb7bbc88075 tempest-SnapshotDependencyTests-2059383465 None] Lock "cinder-c9ab12c5-3753-4c4a-b9cb-401f39e28718-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:18:37 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-aac2cd3a-36cd-4167-a72e-1cb7bbc88075 tempest-SnapshotDependencyTests-2059383465 None] Acquiring lock "cinder-quobyte-31135ac0-35fd-4037-85cc-e6561bc7fdfb" by "delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:18:37 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-aac2cd3a-36cd-4167-a72e-1cb7bbc88075 tempest-SnapshotDependencyTests-2059383465 None] Lock "cinder-quobyte-31135ac0-35fd-4037-85cc-e6561bc7fdfb" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:18:37 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-aac2cd3a-36cd-4167-a72e-1cb7bbc88075 tempest-SnapshotDependencyTests-2059383465 None] Acquiring lock "cinder-quobyte-c9ab12c5-3753-4c4a-b9cb-401f39e28718" by "_delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:18:37 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-aac2cd3a-36cd-4167-a72e-1cb7bbc88075 tempest-SnapshotDependencyTests-2059383465 None] Lock "cinder-quobyte-c9ab12c5-3753-4c4a-b9cb-401f39e28718" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:18:37 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-aac2cd3a-36cd-4167-a72e-1cb7bbc88075 tempest-SnapshotDependencyTests-2059383465 None] Deleting offline snapshot c9ab12c5-3753-4c4a-b9cb-401f39e28718 of volume 31135ac0-35fd-4037-85cc-e6561bc7fdfb {{(pid=86890) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:18:37 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-aac2cd3a-36cd-4167-a72e-1cb7bbc88075 tempest-SnapshotDependencyTests-2059383465 None] snapshot_file for this snap is: volume-31135ac0-35fd-4037-85cc-e6561bc7fdfb.c9ab12c5-3753-4c4a-b9cb-401f39e28718 {{(pid=86890) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:18:37 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9b741be-dfe6-4499-ad99-a0ffa96f00ee]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:18:37 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-aac2cd3a-36cd-4167-a72e-1cb7bbc88075 tempest-SnapshotDependencyTests-2059383465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-31135ac0-35fd-4037-85cc-e6561bc7fdfb.c9ab12c5-3753-4c4a-b9cb-401f39e28718 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:37 devstack sudo[101611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-31135ac0-35fd-4037-85cc-e6561bc7fdfb.c9ab12c5-3753-4c4a-b9cb-401f39e28718 Nov 02 10:18:37 devstack sudo[101611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:37 devstack sudo[101611]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:37 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-aac2cd3a-36cd-4167-a72e-1cb7bbc88075 tempest-SnapshotDependencyTests-2059383465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-31135ac0-35fd-4037-85cc-e6561bc7fdfb.c9ab12c5-3753-4c4a-b9cb-401f39e28718" returned: 0 in 0.371s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:37 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-aac2cd3a-36cd-4167-a72e-1cb7bbc88075 tempest-SnapshotDependencyTests-2059383465 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-31135ac0-35fd-4037-85cc-e6561bc7fdfb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86890) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:18:37 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[13ca296e-01b8-4e5e-bc34-da9954330a9e]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:18:37 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-aac2cd3a-36cd-4167-a72e-1cb7bbc88075 tempest-SnapshotDependencyTests-2059383465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-31135ac0-35fd-4037-85cc-e6561bc7fdfb {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:38 devstack sudo[101617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-31135ac0-35fd-4037-85cc-e6561bc7fdfb Nov 02 10:18:38 devstack sudo[101617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:38 devstack sudo[101617]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:38 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-aac2cd3a-36cd-4167-a72e-1cb7bbc88075 tempest-SnapshotDependencyTests-2059383465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-31135ac0-35fd-4037-85cc-e6561bc7fdfb" returned: 0 in 0.552s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:38 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-aac2cd3a-36cd-4167-a72e-1cb7bbc88075 tempest-SnapshotDependencyTests-2059383465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-31135ac0-35fd-4037-85cc-e6561bc7fdfb.c9ab12c5-3753-4c4a-b9cb-401f39e28718 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:38 devstack sudo[101623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-31135ac0-35fd-4037-85cc-e6561bc7fdfb.c9ab12c5-3753-4c4a-b9cb-401f39e28718 Nov 02 10:18:38 devstack sudo[101623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:38 devstack sudo[101623]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:38 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-aac2cd3a-36cd-4167-a72e-1cb7bbc88075 tempest-SnapshotDependencyTests-2059383465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-31135ac0-35fd-4037-85cc-e6561bc7fdfb.c9ab12c5-3753-4c4a-b9cb-401f39e28718" returned: 0 in 0.367s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:38 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-aac2cd3a-36cd-4167-a72e-1cb7bbc88075 tempest-SnapshotDependencyTests-2059383465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-31135ac0-35fd-4037-85cc-e6561bc7fdfb.c9ab12c5-3753-4c4a-b9cb-401f39e28718 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:38 devstack sudo[101628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-31135ac0-35fd-4037-85cc-e6561bc7fdfb.c9ab12c5-3753-4c4a-b9cb-401f39e28718 Nov 02 10:18:38 devstack sudo[101628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:39 devstack sudo[101628]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:39 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-aac2cd3a-36cd-4167-a72e-1cb7bbc88075 tempest-SnapshotDependencyTests-2059383465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-31135ac0-35fd-4037-85cc-e6561bc7fdfb.c9ab12c5-3753-4c4a-b9cb-401f39e28718" returned: 0 in 0.267s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:39 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-aac2cd3a-36cd-4167-a72e-1cb7bbc88075 tempest-SnapshotDependencyTests-2059383465 None] Lock "cinder-quobyte-c9ab12c5-3753-4c4a-b9cb-401f39e28718" released by "_delete_snapshot" :: held 1.713s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:18:39 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-aac2cd3a-36cd-4167-a72e-1cb7bbc88075 tempest-SnapshotDependencyTests-2059383465 None] Lock "cinder-quobyte-31135ac0-35fd-4037-85cc-e6561bc7fdfb" released by "delete_snapshot" :: held 1.741s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:18:39 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-aac2cd3a-36cd-4167-a72e-1cb7bbc88075 tempest-SnapshotDependencyTests-2059383465 None] Created reservations ['0b1fc7e9-1b2f-4d47-bf63-226493b91491', '0db89cf1-5703-473c-a256-5e29e0e9de01', '6912e075-410a-4c39-a2d9-5e7ebfe4c32b', '0c277195-9ea7-426b-b904-fe5792e95f9e'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:18:39 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-aac2cd3a-36cd-4167-a72e-1cb7bbc88075 tempest-SnapshotDependencyTests-2059383465 None] Delete snapshot completed successfully. Nov 02 10:18:39 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-aac2cd3a-36cd-4167-a72e-1cb7bbc88075 tempest-SnapshotDependencyTests-2059383465 None] Lock "cinder-c9ab12c5-3753-4c4a-b9cb-401f39e28718-delete_snapshot" released by "delete_snapshot" :: held 1.921s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:18:39 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-ce5d1645-2a6a-4453-b9a7-492bca1ad8ef tempest-SnapshotDependencyTests-2059383465 None] Acquiring lock "cinder-31135ac0-35fd-4037-85cc-e6561bc7fdfb-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:18:39 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-ce5d1645-2a6a-4453-b9a7-492bca1ad8ef tempest-SnapshotDependencyTests-2059383465 None] Lock "cinder-31135ac0-35fd-4037-85cc-e6561bc7fdfb-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:18:39 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-ce5d1645-2a6a-4453-b9a7-492bca1ad8ef tempest-SnapshotDependencyTests-2059383465 None] Acquiring lock "cinder-quobyte-31135ac0-35fd-4037-85cc-e6561bc7fdfb" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:18:39 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-ce5d1645-2a6a-4453-b9a7-492bca1ad8ef tempest-SnapshotDependencyTests-2059383465 None] Lock "cinder-quobyte-31135ac0-35fd-4037-85cc-e6561bc7fdfb" acquired by "delete_volume" :: waited 0.019s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:18:39 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[b90776be-7654-4525-97d3-00b152f2f480]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:18:39 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ce5d1645-2a6a-4453-b9a7-492bca1ad8ef tempest-SnapshotDependencyTests-2059383465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-31135ac0-35fd-4037-85cc-e6561bc7fdfb {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:39 devstack sudo[101631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-31135ac0-35fd-4037-85cc-e6561bc7fdfb Nov 02 10:18:39 devstack sudo[101631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:40 devstack sudo[101631]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:40 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ce5d1645-2a6a-4453-b9a7-492bca1ad8ef tempest-SnapshotDependencyTests-2059383465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-31135ac0-35fd-4037-85cc-e6561bc7fdfb" returned: 0 in 0.428s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:40 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ce5d1645-2a6a-4453-b9a7-492bca1ad8ef tempest-SnapshotDependencyTests-2059383465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-31135ac0-35fd-4037-85cc-e6561bc7fdfb {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:40 devstack sudo[101636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-31135ac0-35fd-4037-85cc-e6561bc7fdfb Nov 02 10:18:40 devstack sudo[101636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:40 devstack sudo[101636]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:40 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ce5d1645-2a6a-4453-b9a7-492bca1ad8ef tempest-SnapshotDependencyTests-2059383465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-31135ac0-35fd-4037-85cc-e6561bc7fdfb" returned: 0 in 0.254s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:40 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-ce5d1645-2a6a-4453-b9a7-492bca1ad8ef tempest-SnapshotDependencyTests-2059383465 None] Lock "cinder-quobyte-31135ac0-35fd-4037-85cc-e6561bc7fdfb" released by "delete_volume" :: held 0.760s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:18:40 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-ce5d1645-2a6a-4453-b9a7-492bca1ad8ef tempest-SnapshotDependencyTests-2059383465 None] Created reservations ['0a2cf9b6-d746-4de9-9e9d-b887d3d7b5a0', '07089e48-eb8f-4035-a3fd-091b02153efa', '961ecba8-d517-4e56-a33f-7f04bac40440', 'f8fd0b1a-bbdd-4b14-91df-c7da724c1cfa'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:18:40 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-ce5d1645-2a6a-4453-b9a7-492bca1ad8ef tempest-SnapshotDependencyTests-2059383465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:18:40 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-ce5d1645-2a6a-4453-b9a7-492bca1ad8ef tempest-SnapshotDependencyTests-2059383465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:18:40 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-ce5d1645-2a6a-4453-b9a7-492bca1ad8ef tempest-SnapshotDependencyTests-2059383465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:18:40 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-ce5d1645-2a6a-4453-b9a7-492bca1ad8ef tempest-SnapshotDependencyTests-2059383465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:18:40 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-ce5d1645-2a6a-4453-b9a7-492bca1ad8ef tempest-SnapshotDependencyTests-2059383465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:18:40 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ce5d1645-2a6a-4453-b9a7-492bca1ad8ef tempest-SnapshotDependencyTests-2059383465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:40 devstack sudo[101639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:18:40 devstack sudo[101639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:40 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-99b1d701-0300-4ca7-961f-10bcba8f965c tempest-SnapshotDependencyTests-2059383465 None] Acquiring lock "cinder-2acf997a-c109-4792-9cb6-46e501024290-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:18:40 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-99b1d701-0300-4ca7-961f-10bcba8f965c tempest-SnapshotDependencyTests-2059383465 None] Lock "cinder-2acf997a-c109-4792-9cb6-46e501024290-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:18:40 devstack sudo[101639]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:40 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ce5d1645-2a6a-4453-b9a7-492bca1ad8ef tempest-SnapshotDependencyTests-2059383465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.306s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:40 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-ce5d1645-2a6a-4453-b9a7-492bca1ad8ef tempest-SnapshotDependencyTests-2059383465 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:18:40 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-ce5d1645-2a6a-4453-b9a7-492bca1ad8ef tempest-SnapshotDependencyTests-2059383465 None] Deleted volume successfully. Nov 02 10:18:40 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-99b1d701-0300-4ca7-961f-10bcba8f965c tempest-SnapshotDependencyTests-2059383465 None] Acquiring lock "cinder-quobyte-2acf997a-c109-4792-9cb6-46e501024290" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:18:40 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-ce5d1645-2a6a-4453-b9a7-492bca1ad8ef tempest-SnapshotDependencyTests-2059383465 None] Lock "cinder-31135ac0-35fd-4037-85cc-e6561bc7fdfb-delete_volume" released by "delete_volume" :: held 1.325s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:18:40 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-99b1d701-0300-4ca7-961f-10bcba8f965c tempest-SnapshotDependencyTests-2059383465 None] Lock "cinder-quobyte-2acf997a-c109-4792-9cb6-46e501024290" acquired by "delete_volume" :: waited 0.032s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:18:41 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[1de89a86-bebe-460c-9255-1e2350aa9e77]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:18:41 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-99b1d701-0300-4ca7-961f-10bcba8f965c tempest-SnapshotDependencyTests-2059383465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-2acf997a-c109-4792-9cb6-46e501024290 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:41 devstack sudo[101642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-2acf997a-c109-4792-9cb6-46e501024290 Nov 02 10:18:41 devstack sudo[101642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:41 devstack sudo[101642]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:41 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-99b1d701-0300-4ca7-961f-10bcba8f965c tempest-SnapshotDependencyTests-2059383465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-2acf997a-c109-4792-9cb6-46e501024290" returned: 0 in 0.444s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:41 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-99b1d701-0300-4ca7-961f-10bcba8f965c tempest-SnapshotDependencyTests-2059383465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-2acf997a-c109-4792-9cb6-46e501024290 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:41 devstack sudo[101647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-2acf997a-c109-4792-9cb6-46e501024290 Nov 02 10:18:41 devstack sudo[101647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:41 devstack sudo[101647]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:41 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-99b1d701-0300-4ca7-961f-10bcba8f965c tempest-SnapshotDependencyTests-2059383465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-2acf997a-c109-4792-9cb6-46e501024290" returned: 0 in 0.272s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:41 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-99b1d701-0300-4ca7-961f-10bcba8f965c tempest-SnapshotDependencyTests-2059383465 None] Lock "cinder-quobyte-2acf997a-c109-4792-9cb6-46e501024290" released by "delete_volume" :: held 0.773s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:18:41 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-99b1d701-0300-4ca7-961f-10bcba8f965c tempest-SnapshotDependencyTests-2059383465 None] Created reservations ['75db9f7c-5f66-487a-a294-10602d440568', '592fc40f-ee82-42f0-803b-71b2918c1f80', '8cd53c7e-71df-4ffb-bcde-af5961355483', 'b6be0b08-4260-4a1d-8560-646f04e4e9a5'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:18:41 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-99b1d701-0300-4ca7-961f-10bcba8f965c tempest-SnapshotDependencyTests-2059383465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:18:41 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-99b1d701-0300-4ca7-961f-10bcba8f965c tempest-SnapshotDependencyTests-2059383465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:18:41 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-99b1d701-0300-4ca7-961f-10bcba8f965c tempest-SnapshotDependencyTests-2059383465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:18:41 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-99b1d701-0300-4ca7-961f-10bcba8f965c tempest-SnapshotDependencyTests-2059383465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:18:41 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-99b1d701-0300-4ca7-961f-10bcba8f965c tempest-SnapshotDependencyTests-2059383465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:18:41 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-99b1d701-0300-4ca7-961f-10bcba8f965c tempest-SnapshotDependencyTests-2059383465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:41 devstack sudo[101650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:18:41 devstack sudo[101650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:42 devstack sudo[101650]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:42 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-99b1d701-0300-4ca7-961f-10bcba8f965c tempest-SnapshotDependencyTests-2059383465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.318s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:42 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-99b1d701-0300-4ca7-961f-10bcba8f965c tempest-SnapshotDependencyTests-2059383465 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:18:42 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-99b1d701-0300-4ca7-961f-10bcba8f965c tempest-SnapshotDependencyTests-2059383465 None] Deleted volume successfully. Nov 02 10:18:42 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-99b1d701-0300-4ca7-961f-10bcba8f965c tempest-SnapshotDependencyTests-2059383465 None] Lock "cinder-2acf997a-c109-4792-9cb6-46e501024290-delete_volume" released by "delete_volume" :: held 1.368s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:18:48 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [req-af9c98a4-8025-403a-af84-9baaad92213e req-8e67f21e-46fc-4452-8403-e844a43a842a tempest-TestInstancesWithCinderVolumes-2022269773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:18:48 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [req-af9c98a4-8025-403a-af84-9baaad92213e req-8e67f21e-46fc-4452-8403-e844a43a842a tempest-TestInstancesWithCinderVolumes-2022269773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:18:48 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [req-af9c98a4-8025-403a-af84-9baaad92213e req-8e67f21e-46fc-4452-8403-e844a43a842a tempest-TestInstancesWithCinderVolumes-2022269773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:18:48 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [req-af9c98a4-8025-403a-af84-9baaad92213e req-8e67f21e-46fc-4452-8403-e844a43a842a tempest-TestInstancesWithCinderVolumes-2022269773 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67', 'name': 'volume-0b5de093-9a6d-45da-a334-778047ed2172', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '18f3af65-5415-4584-a12d-4a48ca915dab', 'enforce_multipath': True} {{(pid=86890) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:18:48 devstack cinder-volume[86890]: INFO cinder.volume.manager [req-af9c98a4-8025-403a-af84-9baaad92213e req-8e67f21e-46fc-4452-8403-e844a43a842a tempest-TestInstancesWithCinderVolumes-2022269773 None] attachment_update completed successfully. Nov 02 10:18:50 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [req-d8fcc790-e04d-40d2-ad38-0b211966b757 req-bdf7c79a-42a4-4a00-b604-978141faa8dd tempest-TestInstancesWithCinderVolumes-2022269773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:18:50 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [req-d8fcc790-e04d-40d2-ad38-0b211966b757 req-bdf7c79a-42a4-4a00-b604-978141faa8dd tempest-TestInstancesWithCinderVolumes-2022269773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:18:50 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [req-d8fcc790-e04d-40d2-ad38-0b211966b757 req-bdf7c79a-42a4-4a00-b604-978141faa8dd tempest-TestInstancesWithCinderVolumes-2022269773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:18:50 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [req-d8fcc790-e04d-40d2-ad38-0b211966b757 req-bdf7c79a-42a4-4a00-b604-978141faa8dd tempest-TestInstancesWithCinderVolumes-2022269773 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67', 'name': 'volume-05db1fad-12fa-4f16-bc7b-dac1b8c5d5fe', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ace17652-f78f-4a14-9950-5972b1cebd3b', 'enforce_multipath': True} {{(pid=86890) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:18:50 devstack cinder-volume[86890]: INFO cinder.volume.manager [req-d8fcc790-e04d-40d2-ad38-0b211966b757 req-bdf7c79a-42a4-4a00-b604-978141faa8dd tempest-TestInstancesWithCinderVolumes-2022269773 None] attachment_update completed successfully. Nov 02 10:18:57 devstack cinder-volume[86890]: INFO cinder.volume.manager [req-2a9b79b3-8983-4425-bb08-85a4089abe93 req-96cbe575-55ad-43dc-aa14-5bd4c9ae19f3 tempest-TestInstancesWithCinderVolumes-2022269773 None] Terminate volume connection completed successfully. Nov 02 10:18:57 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [req-2a9b79b3-8983-4425-bb08-85a4089abe93 req-96cbe575-55ad-43dc-aa14-5bd4c9ae19f3 tempest-TestInstancesWithCinderVolumes-2022269773 None] Deleting attachment 18f3af65-5415-4584-a12d-4a48ca915dab. {{(pid=86890) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:18:57 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-d30f8ce4-00d6-4bc8-8e0b-87d9d29ffc35 tempest-TestInstancesWithCinderVolumes-2022269773 None] Acquiring lock "cinder-0b5de093-9a6d-45da-a334-778047ed2172-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:18:58 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-d30f8ce4-00d6-4bc8-8e0b-87d9d29ffc35 tempest-TestInstancesWithCinderVolumes-2022269773 None] Lock "cinder-0b5de093-9a6d-45da-a334-778047ed2172-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:18:58 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-d30f8ce4-00d6-4bc8-8e0b-87d9d29ffc35 tempest-TestInstancesWithCinderVolumes-2022269773 None] Acquiring lock "cinder-quobyte-0b5de093-9a6d-45da-a334-778047ed2172" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:18:58 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-d30f8ce4-00d6-4bc8-8e0b-87d9d29ffc35 tempest-TestInstancesWithCinderVolumes-2022269773 None] Lock "cinder-quobyte-0b5de093-9a6d-45da-a334-778047ed2172" acquired by "delete_volume" :: waited 0.015s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:18:58 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[09af5bb9-6c5d-40da-aca8-dba2ff9be5ea]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:18:58 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-d30f8ce4-00d6-4bc8-8e0b-87d9d29ffc35 tempest-TestInstancesWithCinderVolumes-2022269773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-0b5de093-9a6d-45da-a334-778047ed2172 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:58 devstack sudo[101744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-0b5de093-9a6d-45da-a334-778047ed2172 Nov 02 10:18:58 devstack sudo[101744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:58 devstack sudo[101744]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:58 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-d30f8ce4-00d6-4bc8-8e0b-87d9d29ffc35 tempest-TestInstancesWithCinderVolumes-2022269773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-0b5de093-9a6d-45da-a334-778047ed2172" returned: 0 in 0.381s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:58 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-d30f8ce4-00d6-4bc8-8e0b-87d9d29ffc35 tempest-TestInstancesWithCinderVolumes-2022269773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-0b5de093-9a6d-45da-a334-778047ed2172 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:58 devstack sudo[101749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-0b5de093-9a6d-45da-a334-778047ed2172 Nov 02 10:18:58 devstack sudo[101749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:58 devstack sudo[101749]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:58 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-d30f8ce4-00d6-4bc8-8e0b-87d9d29ffc35 tempest-TestInstancesWithCinderVolumes-2022269773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-0b5de093-9a6d-45da-a334-778047ed2172" returned: 0 in 0.275s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:58 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-d30f8ce4-00d6-4bc8-8e0b-87d9d29ffc35 tempest-TestInstancesWithCinderVolumes-2022269773 None] Lock "cinder-quobyte-0b5de093-9a6d-45da-a334-778047ed2172" released by "delete_volume" :: held 0.710s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:18:58 devstack cinder-volume[86890]: WARNING cinder.quota [None req-d30f8ce4-00d6-4bc8-8e0b-87d9d29ffc35 tempest-TestInstancesWithCinderVolumes-2022269773 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-338555651-902737877 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-338555651-902737877, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:18:58 devstack cinder-volume[86890]: WARNING cinder.quota [None req-d30f8ce4-00d6-4bc8-8e0b-87d9d29ffc35 tempest-TestInstancesWithCinderVolumes-2022269773 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-338555651-902737877 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-338555651-902737877, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:18:58 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-d30f8ce4-00d6-4bc8-8e0b-87d9d29ffc35 tempest-TestInstancesWithCinderVolumes-2022269773 None] Created reservations ['6cf79250-3f7a-4070-8d72-85928953a96a', '51a5672b-3c06-4fca-9b99-18cbd175c5ad', '4a9db451-a0bd-4d9a-a6ba-accd2d01e8ff', 'dcc01350-2c8f-48e8-a1b8-9d265c195682'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:18:58 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-d30f8ce4-00d6-4bc8-8e0b-87d9d29ffc35 tempest-TestInstancesWithCinderVolumes-2022269773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:18:58 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-d30f8ce4-00d6-4bc8-8e0b-87d9d29ffc35 tempest-TestInstancesWithCinderVolumes-2022269773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:18:58 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-d30f8ce4-00d6-4bc8-8e0b-87d9d29ffc35 tempest-TestInstancesWithCinderVolumes-2022269773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:18:58 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-d30f8ce4-00d6-4bc8-8e0b-87d9d29ffc35 tempest-TestInstancesWithCinderVolumes-2022269773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:18:58 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-d30f8ce4-00d6-4bc8-8e0b-87d9d29ffc35 tempest-TestInstancesWithCinderVolumes-2022269773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:18:58 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-d30f8ce4-00d6-4bc8-8e0b-87d9d29ffc35 tempest-TestInstancesWithCinderVolumes-2022269773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:58 devstack sudo[101752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:18:58 devstack sudo[101752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:59 devstack sudo[101752]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:59 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-d30f8ce4-00d6-4bc8-8e0b-87d9d29ffc35 tempest-TestInstancesWithCinderVolumes-2022269773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.350s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:59 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-d30f8ce4-00d6-4bc8-8e0b-87d9d29ffc35 tempest-TestInstancesWithCinderVolumes-2022269773 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:18:59 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-d30f8ce4-00d6-4bc8-8e0b-87d9d29ffc35 tempest-TestInstancesWithCinderVolumes-2022269773 None] Deleted volume successfully. Nov 02 10:18:59 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-d30f8ce4-00d6-4bc8-8e0b-87d9d29ffc35 tempest-TestInstancesWithCinderVolumes-2022269773 None] Lock "cinder-0b5de093-9a6d-45da-a334-778047ed2172-delete_volume" released by "delete_volume" :: held 1.280s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:19:01 devstack cinder-volume[86890]: INFO cinder.volume.manager [req-6331d61d-47aa-44e0-bf40-8064e0e24a50 req-0dffdb75-b2e7-48ae-af0b-4280581279c0 tempest-TestInstancesWithCinderVolumes-2022269773 None] Terminate volume connection completed successfully. Nov 02 10:19:01 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [req-6331d61d-47aa-44e0-bf40-8064e0e24a50 req-0dffdb75-b2e7-48ae-af0b-4280581279c0 tempest-TestInstancesWithCinderVolumes-2022269773 None] Deleting attachment ace17652-f78f-4a14-9950-5972b1cebd3b. {{(pid=86890) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:19:02 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-51c9bf63-d994-4b0f-92b1-acdfa1df6fd4 tempest-TestInstancesWithCinderVolumes-2022269773 None] Acquiring lock "cinder-05db1fad-12fa-4f16-bc7b-dac1b8c5d5fe-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:19:02 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-51c9bf63-d994-4b0f-92b1-acdfa1df6fd4 tempest-TestInstancesWithCinderVolumes-2022269773 None] Lock "cinder-05db1fad-12fa-4f16-bc7b-dac1b8c5d5fe-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:19:02 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-51c9bf63-d994-4b0f-92b1-acdfa1df6fd4 tempest-TestInstancesWithCinderVolumes-2022269773 None] Acquiring lock "cinder-quobyte-05db1fad-12fa-4f16-bc7b-dac1b8c5d5fe" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:19:02 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-51c9bf63-d994-4b0f-92b1-acdfa1df6fd4 tempest-TestInstancesWithCinderVolumes-2022269773 None] Lock "cinder-quobyte-05db1fad-12fa-4f16-bc7b-dac1b8c5d5fe" acquired by "delete_volume" :: waited 0.030s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:19:02 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[09942653-ce89-41cc-b36d-3e4f280f180e]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:19:02 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-51c9bf63-d994-4b0f-92b1-acdfa1df6fd4 tempest-TestInstancesWithCinderVolumes-2022269773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-05db1fad-12fa-4f16-bc7b-dac1b8c5d5fe {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:02 devstack sudo[101778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-05db1fad-12fa-4f16-bc7b-dac1b8c5d5fe Nov 02 10:19:02 devstack sudo[101778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:03 devstack sudo[101778]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:03 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-51c9bf63-d994-4b0f-92b1-acdfa1df6fd4 tempest-TestInstancesWithCinderVolumes-2022269773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-05db1fad-12fa-4f16-bc7b-dac1b8c5d5fe" returned: 0 in 0.453s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:03 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-51c9bf63-d994-4b0f-92b1-acdfa1df6fd4 tempest-TestInstancesWithCinderVolumes-2022269773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-05db1fad-12fa-4f16-bc7b-dac1b8c5d5fe {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:03 devstack sudo[101783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-05db1fad-12fa-4f16-bc7b-dac1b8c5d5fe Nov 02 10:19:03 devstack sudo[101783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:03 devstack sudo[101783]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:03 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-51c9bf63-d994-4b0f-92b1-acdfa1df6fd4 tempest-TestInstancesWithCinderVolumes-2022269773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-05db1fad-12fa-4f16-bc7b-dac1b8c5d5fe" returned: 0 in 0.391s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:03 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-51c9bf63-d994-4b0f-92b1-acdfa1df6fd4 tempest-TestInstancesWithCinderVolumes-2022269773 None] Lock "cinder-quobyte-05db1fad-12fa-4f16-bc7b-dac1b8c5d5fe" released by "delete_volume" :: held 0.918s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:19:03 devstack cinder-volume[86890]: WARNING cinder.quota [None req-51c9bf63-d994-4b0f-92b1-acdfa1df6fd4 tempest-TestInstancesWithCinderVolumes-2022269773 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1121726758-1003131869 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1121726758-1003131869, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:19:03 devstack cinder-volume[86890]: WARNING cinder.quota [None req-51c9bf63-d994-4b0f-92b1-acdfa1df6fd4 tempest-TestInstancesWithCinderVolumes-2022269773 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1121726758-1003131869 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1121726758-1003131869, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:19:03 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-51c9bf63-d994-4b0f-92b1-acdfa1df6fd4 tempest-TestInstancesWithCinderVolumes-2022269773 None] Created reservations ['1392d251-c7eb-48fd-bce3-2925ac581ac4', '51d07a27-36cd-4401-9021-1e1f269f5795', '29c380cc-c745-4995-8ce1-66e4b51ba083', '82f9a6e6-911e-49e9-8f5e-c74fa42808dd'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:19:03 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-51c9bf63-d994-4b0f-92b1-acdfa1df6fd4 tempest-TestInstancesWithCinderVolumes-2022269773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:19:03 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-51c9bf63-d994-4b0f-92b1-acdfa1df6fd4 tempest-TestInstancesWithCinderVolumes-2022269773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:19:03 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-51c9bf63-d994-4b0f-92b1-acdfa1df6fd4 tempest-TestInstancesWithCinderVolumes-2022269773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:19:03 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-51c9bf63-d994-4b0f-92b1-acdfa1df6fd4 tempest-TestInstancesWithCinderVolumes-2022269773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:19:03 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-51c9bf63-d994-4b0f-92b1-acdfa1df6fd4 tempest-TestInstancesWithCinderVolumes-2022269773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:19:03 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-51c9bf63-d994-4b0f-92b1-acdfa1df6fd4 tempest-TestInstancesWithCinderVolumes-2022269773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:03 devstack sudo[101787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:19:03 devstack sudo[101787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:04 devstack sudo[101787]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:04 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-51c9bf63-d994-4b0f-92b1-acdfa1df6fd4 tempest-TestInstancesWithCinderVolumes-2022269773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.342s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:04 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-51c9bf63-d994-4b0f-92b1-acdfa1df6fd4 tempest-TestInstancesWithCinderVolumes-2022269773 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:19:04 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-51c9bf63-d994-4b0f-92b1-acdfa1df6fd4 tempest-TestInstancesWithCinderVolumes-2022269773 None] Deleted volume successfully. Nov 02 10:19:04 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-51c9bf63-d994-4b0f-92b1-acdfa1df6fd4 tempest-TestInstancesWithCinderVolumes-2022269773 None] Lock "cinder-05db1fad-12fa-4f16-bc7b-dac1b8c5d5fe-delete_volume" released by "delete_volume" :: held 1.588s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:19:07 devstack cinder-volume[86890]: INFO cinder.volume.manager [req-ed4ce827-09ec-433b-8ff2-89e3e2e9d3ba req-6f9f4ea7-3f47-4fc5-a5ce-9b6d8ccc1953 tempest-TestInstancesWithCinderVolumes-2022269773 None] Terminate volume connection completed successfully. Nov 02 10:19:07 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [req-ed4ce827-09ec-433b-8ff2-89e3e2e9d3ba req-6f9f4ea7-3f47-4fc5-a5ce-9b6d8ccc1953 tempest-TestInstancesWithCinderVolumes-2022269773 None] Deleting attachment 76b4019c-1d40-4226-9775-58cea3c044bf. {{(pid=86890) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:19:08 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-ce30bc4e-a2f0-4fe3-91e2-3803c7fb8508 tempest-TestInstancesWithCinderVolumes-2022269773 None] Acquiring lock "cinder-780ccc66-bbb1-418e-bfc6-1b3a9ba18405-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:19:08 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-ce30bc4e-a2f0-4fe3-91e2-3803c7fb8508 tempest-TestInstancesWithCinderVolumes-2022269773 None] Lock "cinder-780ccc66-bbb1-418e-bfc6-1b3a9ba18405-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:19:08 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-ce30bc4e-a2f0-4fe3-91e2-3803c7fb8508 tempest-TestInstancesWithCinderVolumes-2022269773 None] Acquiring lock "cinder-quobyte-780ccc66-bbb1-418e-bfc6-1b3a9ba18405" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:19:08 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-ce30bc4e-a2f0-4fe3-91e2-3803c7fb8508 tempest-TestInstancesWithCinderVolumes-2022269773 None] Lock "cinder-quobyte-780ccc66-bbb1-418e-bfc6-1b3a9ba18405" acquired by "delete_volume" :: waited 0.019s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:19:08 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3529168-21dd-4abd-a5d6-2c20d7286049]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:19:08 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ce30bc4e-a2f0-4fe3-91e2-3803c7fb8508 tempest-TestInstancesWithCinderVolumes-2022269773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-780ccc66-bbb1-418e-bfc6-1b3a9ba18405 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:09 devstack sudo[101817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-780ccc66-bbb1-418e-bfc6-1b3a9ba18405 Nov 02 10:19:09 devstack sudo[101817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:09 devstack sudo[101817]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:09 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ce30bc4e-a2f0-4fe3-91e2-3803c7fb8508 tempest-TestInstancesWithCinderVolumes-2022269773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-780ccc66-bbb1-418e-bfc6-1b3a9ba18405" returned: 0 in 0.430s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:09 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ce30bc4e-a2f0-4fe3-91e2-3803c7fb8508 tempest-TestInstancesWithCinderVolumes-2022269773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-780ccc66-bbb1-418e-bfc6-1b3a9ba18405 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:09 devstack sudo[101822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-780ccc66-bbb1-418e-bfc6-1b3a9ba18405 Nov 02 10:19:09 devstack sudo[101822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:09 devstack sudo[101822]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:09 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ce30bc4e-a2f0-4fe3-91e2-3803c7fb8508 tempest-TestInstancesWithCinderVolumes-2022269773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-780ccc66-bbb1-418e-bfc6-1b3a9ba18405" returned: 0 in 0.253s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:09 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-ce30bc4e-a2f0-4fe3-91e2-3803c7fb8508 tempest-TestInstancesWithCinderVolumes-2022269773 None] Lock "cinder-quobyte-780ccc66-bbb1-418e-bfc6-1b3a9ba18405" released by "delete_volume" :: held 0.733s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:19:09 devstack cinder-volume[86890]: WARNING cinder.quota [None req-ce30bc4e-a2f0-4fe3-91e2-3803c7fb8508 tempest-TestInstancesWithCinderVolumes-2022269773 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-277855021-2077745348 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-277855021-2077745348, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:19:09 devstack cinder-volume[86890]: WARNING cinder.quota [None req-ce30bc4e-a2f0-4fe3-91e2-3803c7fb8508 tempest-TestInstancesWithCinderVolumes-2022269773 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-277855021-2077745348 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-277855021-2077745348, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:19:09 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-ce30bc4e-a2f0-4fe3-91e2-3803c7fb8508 tempest-TestInstancesWithCinderVolumes-2022269773 None] Created reservations ['516ad08d-627b-4782-a43f-0045185f10bf', 'dfb0ad06-2b2d-48c9-891b-a518eb035be4', 'f0ae6355-9c6a-4dc3-854f-b2c257c092fa', 'd410ddd9-fb1b-44e1-b91b-885d243045ac'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:19:09 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-ce30bc4e-a2f0-4fe3-91e2-3803c7fb8508 tempest-TestInstancesWithCinderVolumes-2022269773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:19:09 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-ce30bc4e-a2f0-4fe3-91e2-3803c7fb8508 tempest-TestInstancesWithCinderVolumes-2022269773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:19:09 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-ce30bc4e-a2f0-4fe3-91e2-3803c7fb8508 tempest-TestInstancesWithCinderVolumes-2022269773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:19:09 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-ce30bc4e-a2f0-4fe3-91e2-3803c7fb8508 tempest-TestInstancesWithCinderVolumes-2022269773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:19:09 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-ce30bc4e-a2f0-4fe3-91e2-3803c7fb8508 tempest-TestInstancesWithCinderVolumes-2022269773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:19:09 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ce30bc4e-a2f0-4fe3-91e2-3803c7fb8508 tempest-TestInstancesWithCinderVolumes-2022269773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:09 devstack sudo[101825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:19:09 devstack sudo[101825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:10 devstack sudo[101825]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:10 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ce30bc4e-a2f0-4fe3-91e2-3803c7fb8508 tempest-TestInstancesWithCinderVolumes-2022269773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.293s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:10 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-ce30bc4e-a2f0-4fe3-91e2-3803c7fb8508 tempest-TestInstancesWithCinderVolumes-2022269773 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:19:10 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-ce30bc4e-a2f0-4fe3-91e2-3803c7fb8508 tempest-TestInstancesWithCinderVolumes-2022269773 None] Deleted volume successfully. Nov 02 10:19:10 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-ce30bc4e-a2f0-4fe3-91e2-3803c7fb8508 tempest-TestInstancesWithCinderVolumes-2022269773 None] Lock "cinder-780ccc66-bbb1-418e-bfc6-1b3a9ba18405-delete_volume" released by "delete_volume" :: held 1.308s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:19:19 devstack cinder-volume[86890]: DEBUG dbcounter [-] [86890] Writing DB stats cinder:SELECT=62,cinder:UPDATE=51,cinder:DELETE=7,cinder:INSERT=19 {{(pid=86890) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:19:20 devstack cinder-volume[86890]: DEBUG dbcounter [-] [86890] Writing DB stats cinder:SELECT=62,cinder:UPDATE=78,cinder:INSERT=12,cinder:DELETE=2 {{(pid=86890) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:19:25 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-3fe19845-51e8-4262-8d77-fd6fbfbc3409 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:19:25 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-3fe19845-51e8-4262-8d77-fd6fbfbc3409 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Flow 'volume_create_manager' (06762843-2337-4344-897d-579c64e2ab36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:19:25 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-3fe19845-51e8-4262-8d77-fd6fbfbc3409 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51ecdeeb-7819-462f-afd0-0b35579fc67f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:25 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-3fe19845-51e8-4262-8d77-fd6fbfbc3409 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51ecdeeb-7819-462f-afd0-0b35579fc67f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:19:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-740690591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c47588ab-bed4-415e-b859-7b56651e9f09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='515a789d750d465596378d39bee7bfe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:19:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:19:26Z,use_quota=True,user_id='045f91ceecea4051b662733a742a970f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:25 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-3fe19845-51e8-4262-8d77-fd6fbfbc3409 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26afb67d-8028-4761-a801-53caf99b5e95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:25 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-3fe19845-51e8-4262-8d77-fd6fbfbc3409 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26afb67d-8028-4761-a801-53caf99b5e95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:25 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-3fe19845-51e8-4262-8d77-fd6fbfbc3409 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (414194a1-8d9e-49bd-bbc5-72f64c9a8b55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:25 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-3fe19845-51e8-4262-8d77-fd6fbfbc3409 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (414194a1-8d9e-49bd-bbc5-72f64c9a8b55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c47588ab-bed4-415e-b859-7b56651e9f09', 'volume_name': 'volume-c47588ab-bed4-415e-b859-7b56651e9f09', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:25 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-3fe19845-51e8-4262-8d77-fd6fbfbc3409 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (724ac27a-ed81-46bf-bb73-7077ed42d8d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:25 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-3fe19845-51e8-4262-8d77-fd6fbfbc3409 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (724ac27a-ed81-46bf-bb73-7077ed42d8d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:25 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-3fe19845-51e8-4262-8d77-fd6fbfbc3409 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (589006b5-80f8-4dcd-a46a-b848e8f0864a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:25 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-3fe19845-51e8-4262-8d77-fd6fbfbc3409 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Volume c47588ab-bed4-415e-b859-7b56651e9f09: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c47588ab-bed4-415e-b859-7b56651e9f09', 'volume_size': 1} Nov 02 10:19:25 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-3fe19845-51e8-4262-8d77-fd6fbfbc3409 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:19:25 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-3fe19845-51e8-4262-8d77-fd6fbfbc3409 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:19:25 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-3fe19845-51e8-4262-8d77-fd6fbfbc3409 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:19:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-740690591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c47588ab-bed4-415e-b859-7b56651e9f09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='515a789d750d465596378d39bee7bfe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:19:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:19:26Z,use_quota=True,user_id='045f91ceecea4051b662733a742a970f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:19:25 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-3fe19845-51e8-4262-8d77-fd6fbfbc3409 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Creating volume c47588ab-bed4-415e-b859-7b56651e9f09 {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:19:25 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-3fe19845-51e8-4262-8d77-fd6fbfbc3409 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:19:25 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-3fe19845-51e8-4262-8d77-fd6fbfbc3409 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:19:25 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-3fe19845-51e8-4262-8d77-fd6fbfbc3409 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:19:25 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-3fe19845-51e8-4262-8d77-fd6fbfbc3409 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:19:25 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-3fe19845-51e8-4262-8d77-fd6fbfbc3409 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:19:25 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-3fe19845-51e8-4262-8d77-fd6fbfbc3409 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:19:25 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-3fe19845-51e8-4262-8d77-fd6fbfbc3409 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:19:25 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-3fe19845-51e8-4262-8d77-fd6fbfbc3409 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-c47588ab-bed4-415e-b859-7b56651e9f09 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:25 devstack sudo[101973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-c47588ab-bed4-415e-b859-7b56651e9f09 1073741824 Nov 02 10:19:25 devstack sudo[101973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:26 devstack sudo[101973]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:26 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-3fe19845-51e8-4262-8d77-fd6fbfbc3409 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-c47588ab-bed4-415e-b859-7b56651e9f09 1073741824" returned: 0 in 0.486s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:26 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-3fe19845-51e8-4262-8d77-fd6fbfbc3409 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-c47588ab-bed4-415e-b859-7b56651e9f09 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:26 devstack sudo[101978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-c47588ab-bed4-415e-b859-7b56651e9f09 Nov 02 10:19:26 devstack sudo[101978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:26 devstack sudo[101978]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:26 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-3fe19845-51e8-4262-8d77-fd6fbfbc3409 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-c47588ab-bed4-415e-b859-7b56651e9f09" returned: 0 in 0.285s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:26 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-3fe19845-51e8-4262-8d77-fd6fbfbc3409 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] <== create_volume: return (816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:19:26 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-3fe19845-51e8-4262-8d77-fd6fbfbc3409 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.823s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:19:26 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-3fe19845-51e8-4262-8d77-fd6fbfbc3409 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (589006b5-80f8-4dcd-a46a-b848e8f0864a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c47588ab-bed4-415e-b859-7b56651e9f09', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:26 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-3fe19845-51e8-4262-8d77-fd6fbfbc3409 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8520e05d-c5bd-4fff-9682-eaaace8172b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:26 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-3fe19845-51e8-4262-8d77-fd6fbfbc3409 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Volume volume-c47588ab-bed4-415e-b859-7b56651e9f09 (c47588ab-bed4-415e-b859-7b56651e9f09): created successfully Nov 02 10:19:26 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-3fe19845-51e8-4262-8d77-fd6fbfbc3409 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8520e05d-c5bd-4fff-9682-eaaace8172b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:26 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-3fe19845-51e8-4262-8d77-fd6fbfbc3409 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Flow 'volume_create_manager' (06762843-2337-4344-897d-579c64e2ab36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:19:26 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-3fe19845-51e8-4262-8d77-fd6fbfbc3409 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Created volume successfully. Nov 02 10:19:28 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-134567c1-de02-46c0-835d-4180e2aa0f42 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:19:28 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-134567c1-de02-46c0-835d-4180e2aa0f42 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Flow 'volume_create_manager' (7a9fe8b1-855c-4015-b7be-a3e2ffe09283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:19:28 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-134567c1-de02-46c0-835d-4180e2aa0f42 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03695152-bcd7-4bbd-b259-926803d39a19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:28 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-134567c1-de02-46c0-835d-4180e2aa0f42 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03695152-bcd7-4bbd-b259-926803d39a19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:19:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-778701639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=130dab52-f195-40cb-93ce-dece2aa280c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='515a789d750d465596378d39bee7bfe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:19:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:19:28Z,use_quota=True,user_id='045f91ceecea4051b662733a742a970f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:28 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-134567c1-de02-46c0-835d-4180e2aa0f42 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca02c1f1-11c3-4aa5-8ca6-fba4b13ca01d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:28 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-134567c1-de02-46c0-835d-4180e2aa0f42 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca02c1f1-11c3-4aa5-8ca6-fba4b13ca01d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:28 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-134567c1-de02-46c0-835d-4180e2aa0f42 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (700a2e21-fb66-49cc-b8b6-e576ec4ad895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:28 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-134567c1-de02-46c0-835d-4180e2aa0f42 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (700a2e21-fb66-49cc-b8b6-e576ec4ad895) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '130dab52-f195-40cb-93ce-dece2aa280c3', 'volume_name': 'volume-130dab52-f195-40cb-93ce-dece2aa280c3', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:28 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-134567c1-de02-46c0-835d-4180e2aa0f42 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3f67c5e-aba8-49c4-aea7-31387c66b6cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:28 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-134567c1-de02-46c0-835d-4180e2aa0f42 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3f67c5e-aba8-49c4-aea7-31387c66b6cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:28 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-134567c1-de02-46c0-835d-4180e2aa0f42 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64f54bd3-7b80-43ac-8d6d-72340d45bdf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:28 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-134567c1-de02-46c0-835d-4180e2aa0f42 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Volume 130dab52-f195-40cb-93ce-dece2aa280c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-130dab52-f195-40cb-93ce-dece2aa280c3', 'volume_size': 1} Nov 02 10:19:28 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-134567c1-de02-46c0-835d-4180e2aa0f42 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:19:28 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-134567c1-de02-46c0-835d-4180e2aa0f42 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:19:28 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-134567c1-de02-46c0-835d-4180e2aa0f42 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:19:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-778701639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=130dab52-f195-40cb-93ce-dece2aa280c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='515a789d750d465596378d39bee7bfe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:19:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:19:28Z,use_quota=True,user_id='045f91ceecea4051b662733a742a970f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:19:28 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-134567c1-de02-46c0-835d-4180e2aa0f42 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Creating volume 130dab52-f195-40cb-93ce-dece2aa280c3 {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:19:28 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-134567c1-de02-46c0-835d-4180e2aa0f42 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:19:28 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-134567c1-de02-46c0-835d-4180e2aa0f42 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:19:28 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-134567c1-de02-46c0-835d-4180e2aa0f42 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:19:28 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-134567c1-de02-46c0-835d-4180e2aa0f42 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:19:28 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-134567c1-de02-46c0-835d-4180e2aa0f42 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:19:28 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-134567c1-de02-46c0-835d-4180e2aa0f42 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:19:28 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-134567c1-de02-46c0-835d-4180e2aa0f42 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:19:28 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-134567c1-de02-46c0-835d-4180e2aa0f42 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-130dab52-f195-40cb-93ce-dece2aa280c3 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:28 devstack sudo[101982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-130dab52-f195-40cb-93ce-dece2aa280c3 1073741824 Nov 02 10:19:28 devstack sudo[101982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:28 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f007a96-9596-45c4-b9c9-3e12b6938d89 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:19:28 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-8f007a96-9596-45c4-b9c9-3e12b6938d89 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Flow 'volume_create_manager' (e16c0253-85d2-4b2f-b6a0-444866e63d63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:19:28 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-8f007a96-9596-45c4-b9c9-3e12b6938d89 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80512b4c-6c0a-40df-8484-f3982b2b2bac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:28 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-8f007a96-9596-45c4-b9c9-3e12b6938d89 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80512b4c-6c0a-40df-8484-f3982b2b2bac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:19:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-545281357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01f7d8e8-b0cd-409c-82cd-c3b2944360ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='515a789d750d465596378d39bee7bfe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:19:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:19:29Z,use_quota=True,user_id='045f91ceecea4051b662733a742a970f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:28 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-8f007a96-9596-45c4-b9c9-3e12b6938d89 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33a4beb1-0ace-4ddc-ab9e-95d3eb5d4c49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:28 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-8f007a96-9596-45c4-b9c9-3e12b6938d89 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33a4beb1-0ace-4ddc-ab9e-95d3eb5d4c49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:28 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-8f007a96-9596-45c4-b9c9-3e12b6938d89 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed33cfe9-6f1e-4656-8ac5-e27d76a49d2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:28 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-8f007a96-9596-45c4-b9c9-3e12b6938d89 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed33cfe9-6f1e-4656-8ac5-e27d76a49d2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01f7d8e8-b0cd-409c-82cd-c3b2944360ea', 'volume_name': 'volume-01f7d8e8-b0cd-409c-82cd-c3b2944360ea', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:28 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-8f007a96-9596-45c4-b9c9-3e12b6938d89 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9fa51f7-19ed-41b4-927e-d0888b7ae085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:28 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-8f007a96-9596-45c4-b9c9-3e12b6938d89 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9fa51f7-19ed-41b4-927e-d0888b7ae085) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:28 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-8f007a96-9596-45c4-b9c9-3e12b6938d89 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1512861-2db5-49e4-bb00-5ebe2a87d47e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:28 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-8f007a96-9596-45c4-b9c9-3e12b6938d89 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Volume 01f7d8e8-b0cd-409c-82cd-c3b2944360ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01f7d8e8-b0cd-409c-82cd-c3b2944360ea', 'volume_size': 1} Nov 02 10:19:28 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-8f007a96-9596-45c4-b9c9-3e12b6938d89 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:19:29 devstack sudo[101982]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:29 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-134567c1-de02-46c0-835d-4180e2aa0f42 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-130dab52-f195-40cb-93ce-dece2aa280c3 1073741824" returned: 0 in 0.585s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:29 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-134567c1-de02-46c0-835d-4180e2aa0f42 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-130dab52-f195-40cb-93ce-dece2aa280c3 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:29 devstack sudo[101988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-130dab52-f195-40cb-93ce-dece2aa280c3 Nov 02 10:19:29 devstack sudo[101988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:29 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bcf4460-fca2-4c0a-9d71-16d5520cc10b tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:19:29 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-3bcf4460-fca2-4c0a-9d71-16d5520cc10b tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Flow 'volume_create_manager' (796f93d6-bf87-4f6f-998a-d9ff7b9246c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:19:29 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-3bcf4460-fca2-4c0a-9d71-16d5520cc10b tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0455ce5-1706-4653-9d23-06ca6356124c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:29 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-3bcf4460-fca2-4c0a-9d71-16d5520cc10b tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0455ce5-1706-4653-9d23-06ca6356124c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:19:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1442270748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87ecb3af-6c50-475f-99ba-41677ae48f0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='515a789d750d465596378d39bee7bfe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:19:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:19:29Z,use_quota=True,user_id='045f91ceecea4051b662733a742a970f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:29 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-3bcf4460-fca2-4c0a-9d71-16d5520cc10b tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdeb3b0f-fcfd-4e55-9884-9f1003bb4d98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:29 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-3bcf4460-fca2-4c0a-9d71-16d5520cc10b tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdeb3b0f-fcfd-4e55-9884-9f1003bb4d98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:29 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-3bcf4460-fca2-4c0a-9d71-16d5520cc10b tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3382ec9-ce3d-444c-9ffc-c5d3cfeaa0b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:29 devstack sudo[101988]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:29 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-3bcf4460-fca2-4c0a-9d71-16d5520cc10b tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3382ec9-ce3d-444c-9ffc-c5d3cfeaa0b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87ecb3af-6c50-475f-99ba-41677ae48f0f', 'volume_name': 'volume-87ecb3af-6c50-475f-99ba-41677ae48f0f', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:29 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-3bcf4460-fca2-4c0a-9d71-16d5520cc10b tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f9eeb9d-852e-40f2-ab31-61fa729e8fd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:29 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-3bcf4460-fca2-4c0a-9d71-16d5520cc10b tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f9eeb9d-852e-40f2-ab31-61fa729e8fd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:29 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-3bcf4460-fca2-4c0a-9d71-16d5520cc10b tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22615453-5853-47c5-b753-ef72fb43c854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:29 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-3bcf4460-fca2-4c0a-9d71-16d5520cc10b tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Volume 87ecb3af-6c50-475f-99ba-41677ae48f0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87ecb3af-6c50-475f-99ba-41677ae48f0f', 'volume_size': 1} Nov 02 10:19:29 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-3bcf4460-fca2-4c0a-9d71-16d5520cc10b tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:19:29 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-134567c1-de02-46c0-835d-4180e2aa0f42 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-130dab52-f195-40cb-93ce-dece2aa280c3" returned: 0 in 0.435s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:29 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-134567c1-de02-46c0-835d-4180e2aa0f42 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] <== create_volume: return (1075ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:19:29 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-134567c1-de02-46c0-835d-4180e2aa0f42 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.078s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:19:29 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-8f007a96-9596-45c4-b9c9-3e12b6938d89 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.546s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:19:29 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-8f007a96-9596-45c4-b9c9-3e12b6938d89 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:19:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-545281357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01f7d8e8-b0cd-409c-82cd-c3b2944360ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='515a789d750d465596378d39bee7bfe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:19:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:19:29Z,use_quota=True,user_id='045f91ceecea4051b662733a742a970f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:19:29 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-8f007a96-9596-45c4-b9c9-3e12b6938d89 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Creating volume 01f7d8e8-b0cd-409c-82cd-c3b2944360ea {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:19:29 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-8f007a96-9596-45c4-b9c9-3e12b6938d89 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:19:29 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-8f007a96-9596-45c4-b9c9-3e12b6938d89 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:19:29 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-8f007a96-9596-45c4-b9c9-3e12b6938d89 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:19:29 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-8f007a96-9596-45c4-b9c9-3e12b6938d89 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:19:29 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-8f007a96-9596-45c4-b9c9-3e12b6938d89 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:19:29 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-8f007a96-9596-45c4-b9c9-3e12b6938d89 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:19:29 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-8f007a96-9596-45c4-b9c9-3e12b6938d89 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:19:29 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8f007a96-9596-45c4-b9c9-3e12b6938d89 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-01f7d8e8-b0cd-409c-82cd-c3b2944360ea 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:29 devstack sudo[102009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-01f7d8e8-b0cd-409c-82cd-c3b2944360ea 1073741824 Nov 02 10:19:29 devstack sudo[102009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:29 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-134567c1-de02-46c0-835d-4180e2aa0f42 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64f54bd3-7b80-43ac-8d6d-72340d45bdf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-130dab52-f195-40cb-93ce-dece2aa280c3', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:29 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-134567c1-de02-46c0-835d-4180e2aa0f42 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f269f78-d29c-445e-9070-843ba4f560b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:29 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-134567c1-de02-46c0-835d-4180e2aa0f42 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Volume volume-130dab52-f195-40cb-93ce-dece2aa280c3 (130dab52-f195-40cb-93ce-dece2aa280c3): created successfully Nov 02 10:19:29 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-134567c1-de02-46c0-835d-4180e2aa0f42 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f269f78-d29c-445e-9070-843ba4f560b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:29 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-134567c1-de02-46c0-835d-4180e2aa0f42 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Flow 'volume_create_manager' (7a9fe8b1-855c-4015-b7be-a3e2ffe09283) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:19:29 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-134567c1-de02-46c0-835d-4180e2aa0f42 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Created volume successfully. Nov 02 10:19:29 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-97638723-9a93-4f5a-b646-ef8d4347984e tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:19:29 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-97638723-9a93-4f5a-b646-ef8d4347984e tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Flow 'volume_create_manager' (a98eadc9-fd7a-437f-8c3f-adbea2c89fe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:19:29 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-97638723-9a93-4f5a-b646-ef8d4347984e tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54fb262c-4c47-418d-8df7-9a14d6107efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:29 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-97638723-9a93-4f5a-b646-ef8d4347984e tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54fb262c-4c47-418d-8df7-9a14d6107efc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:19:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1506350693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ec5b92f-02dd-429b-8e7a-851c90c99dd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='515a789d750d465596378d39bee7bfe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:19:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:19:30Z,use_quota=True,user_id='045f91ceecea4051b662733a742a970f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:29 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-97638723-9a93-4f5a-b646-ef8d4347984e tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17e33b65-f013-4ca9-8e2e-91e9b427b737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:29 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-97638723-9a93-4f5a-b646-ef8d4347984e tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17e33b65-f013-4ca9-8e2e-91e9b427b737) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:29 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-97638723-9a93-4f5a-b646-ef8d4347984e tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (354076f9-432e-4b18-b118-487463c6c165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:29 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-97638723-9a93-4f5a-b646-ef8d4347984e tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (354076f9-432e-4b18-b118-487463c6c165) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ec5b92f-02dd-429b-8e7a-851c90c99dd6', 'volume_name': 'volume-4ec5b92f-02dd-429b-8e7a-851c90c99dd6', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:29 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-97638723-9a93-4f5a-b646-ef8d4347984e tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28c9f5b8-59cf-4ea7-ade1-3485668cca74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:29 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-97638723-9a93-4f5a-b646-ef8d4347984e tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28c9f5b8-59cf-4ea7-ade1-3485668cca74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:29 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-97638723-9a93-4f5a-b646-ef8d4347984e tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00c34b11-9190-4ae2-b2a9-41eb317c2773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:29 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-97638723-9a93-4f5a-b646-ef8d4347984e tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Volume 4ec5b92f-02dd-429b-8e7a-851c90c99dd6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ec5b92f-02dd-429b-8e7a-851c90c99dd6', 'volume_size': 1} Nov 02 10:19:29 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-97638723-9a93-4f5a-b646-ef8d4347984e tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:19:30 devstack sudo[102009]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:30 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8f007a96-9596-45c4-b9c9-3e12b6938d89 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-01f7d8e8-b0cd-409c-82cd-c3b2944360ea 1073741824" returned: 0 in 0.577s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:30 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8f007a96-9596-45c4-b9c9-3e12b6938d89 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-01f7d8e8-b0cd-409c-82cd-c3b2944360ea {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:30 devstack sudo[102015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-01f7d8e8-b0cd-409c-82cd-c3b2944360ea Nov 02 10:19:30 devstack sudo[102015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:30 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fb0580e-7bbe-4493-b441-1398b140b06b tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:19:30 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-5fb0580e-7bbe-4493-b441-1398b140b06b tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Flow 'volume_create_manager' (6a81e1e5-baa7-4994-87fe-6de5db06a4f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:19:30 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-5fb0580e-7bbe-4493-b441-1398b140b06b tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b88accd8-d709-4262-8ff9-8e148eb35a4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:30 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-5fb0580e-7bbe-4493-b441-1398b140b06b tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b88accd8-d709-4262-8ff9-8e148eb35a4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:19:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2039740621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=987e1b6f-8093-4997-966a-677606551677,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='515a789d750d465596378d39bee7bfe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:19:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:19:30Z,use_quota=True,user_id='045f91ceecea4051b662733a742a970f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:30 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-5fb0580e-7bbe-4493-b441-1398b140b06b tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a25f6e55-1c93-46b0-89e7-66d174200af6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:30 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-5fb0580e-7bbe-4493-b441-1398b140b06b tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a25f6e55-1c93-46b0-89e7-66d174200af6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:30 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-5fb0580e-7bbe-4493-b441-1398b140b06b tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca2fff3e-6707-401d-ba63-924872de2b90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:30 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-5fb0580e-7bbe-4493-b441-1398b140b06b tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca2fff3e-6707-401d-ba63-924872de2b90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '987e1b6f-8093-4997-966a-677606551677', 'volume_name': 'volume-987e1b6f-8093-4997-966a-677606551677', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:30 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-5fb0580e-7bbe-4493-b441-1398b140b06b tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ae9a718-79da-4c73-aea4-129b7a233cfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:30 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-5fb0580e-7bbe-4493-b441-1398b140b06b tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ae9a718-79da-4c73-aea4-129b7a233cfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:30 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-5fb0580e-7bbe-4493-b441-1398b140b06b tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (300e5871-9f77-44a4-a1c3-c2176d5ee4a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:30 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-5fb0580e-7bbe-4493-b441-1398b140b06b tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Volume 987e1b6f-8093-4997-966a-677606551677: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-987e1b6f-8093-4997-966a-677606551677', 'volume_size': 1} Nov 02 10:19:30 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-5fb0580e-7bbe-4493-b441-1398b140b06b tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:19:30 devstack sudo[102015]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:30 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8f007a96-9596-45c4-b9c9-3e12b6938d89 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-01f7d8e8-b0cd-409c-82cd-c3b2944360ea" returned: 0 in 0.277s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:30 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-8f007a96-9596-45c4-b9c9-3e12b6938d89 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:19:30 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-8f007a96-9596-45c4-b9c9-3e12b6938d89 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:19:30 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-3bcf4460-fca2-4c0a-9d71-16d5520cc10b tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.926s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:19:30 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-3bcf4460-fca2-4c0a-9d71-16d5520cc10b tempest-CreateVolumesFromSourceVolumeTest-428070546 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:19:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1442270748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87ecb3af-6c50-475f-99ba-41677ae48f0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='515a789d750d465596378d39bee7bfe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:19:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:19:29Z,use_quota=True,user_id='045f91ceecea4051b662733a742a970f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:19:30 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-3bcf4460-fca2-4c0a-9d71-16d5520cc10b tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Creating volume 87ecb3af-6c50-475f-99ba-41677ae48f0f {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:19:30 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-3bcf4460-fca2-4c0a-9d71-16d5520cc10b tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:19:30 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-3bcf4460-fca2-4c0a-9d71-16d5520cc10b tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:19:30 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-3bcf4460-fca2-4c0a-9d71-16d5520cc10b tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:19:30 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-3bcf4460-fca2-4c0a-9d71-16d5520cc10b tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:19:30 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-3bcf4460-fca2-4c0a-9d71-16d5520cc10b tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:19:30 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-3bcf4460-fca2-4c0a-9d71-16d5520cc10b tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:19:30 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-3bcf4460-fca2-4c0a-9d71-16d5520cc10b tempest-CreateVolumesFromSourceVolumeTest-428070546 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:19:30 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-3bcf4460-fca2-4c0a-9d71-16d5520cc10b tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-87ecb3af-6c50-475f-99ba-41677ae48f0f 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:30 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-8f007a96-9596-45c4-b9c9-3e12b6938d89 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1512861-2db5-49e4-bb00-5ebe2a87d47e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01f7d8e8-b0cd-409c-82cd-c3b2944360ea', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:30 devstack sudo[102018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-87ecb3af-6c50-475f-99ba-41677ae48f0f 1073741824 Nov 02 10:19:30 devstack sudo[102018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:30 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-8f007a96-9596-45c4-b9c9-3e12b6938d89 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1233285-adc1-4277-a4c3-92cd70ea6faa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:30 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-8f007a96-9596-45c4-b9c9-3e12b6938d89 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Volume volume-01f7d8e8-b0cd-409c-82cd-c3b2944360ea (01f7d8e8-b0cd-409c-82cd-c3b2944360ea): created successfully Nov 02 10:19:30 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-8f007a96-9596-45c4-b9c9-3e12b6938d89 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1233285-adc1-4277-a4c3-92cd70ea6faa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:30 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-8f007a96-9596-45c4-b9c9-3e12b6938d89 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Flow 'volume_create_manager' (e16c0253-85d2-4b2f-b6a0-444866e63d63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:19:30 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-8f007a96-9596-45c4-b9c9-3e12b6938d89 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Created volume successfully. Nov 02 10:19:30 devstack sudo[102018]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:30 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-3bcf4460-fca2-4c0a-9d71-16d5520cc10b tempest-CreateVolumesFromSourceVolumeTest-428070546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-87ecb3af-6c50-475f-99ba-41677ae48f0f 1073741824" returned: 0 in 0.423s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:30 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-3bcf4460-fca2-4c0a-9d71-16d5520cc10b tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-87ecb3af-6c50-475f-99ba-41677ae48f0f {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:30 devstack sudo[102023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-87ecb3af-6c50-475f-99ba-41677ae48f0f Nov 02 10:19:30 devstack sudo[102023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:31 devstack sudo[102023]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:31 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-3bcf4460-fca2-4c0a-9d71-16d5520cc10b tempest-CreateVolumesFromSourceVolumeTest-428070546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-87ecb3af-6c50-475f-99ba-41677ae48f0f" returned: 0 in 0.258s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:31 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-3bcf4460-fca2-4c0a-9d71-16d5520cc10b tempest-CreateVolumesFromSourceVolumeTest-428070546 None] <== create_volume: return (718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:19:31 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-3bcf4460-fca2-4c0a-9d71-16d5520cc10b tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.721s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:19:31 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-97638723-9a93-4f5a-b646-ef8d4347984e tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.285s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:19:31 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-97638723-9a93-4f5a-b646-ef8d4347984e tempest-CreateVolumesFromSourceVolumeTest-428070546 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:19:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1506350693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ec5b92f-02dd-429b-8e7a-851c90c99dd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='515a789d750d465596378d39bee7bfe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:19:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:19:30Z,use_quota=True,user_id='045f91ceecea4051b662733a742a970f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:19:31 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-97638723-9a93-4f5a-b646-ef8d4347984e tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Creating volume 4ec5b92f-02dd-429b-8e7a-851c90c99dd6 {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:19:31 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-97638723-9a93-4f5a-b646-ef8d4347984e tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:19:31 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-97638723-9a93-4f5a-b646-ef8d4347984e tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:19:31 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-97638723-9a93-4f5a-b646-ef8d4347984e tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:19:31 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-97638723-9a93-4f5a-b646-ef8d4347984e tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:19:31 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-97638723-9a93-4f5a-b646-ef8d4347984e tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:19:31 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-97638723-9a93-4f5a-b646-ef8d4347984e tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:19:31 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-97638723-9a93-4f5a-b646-ef8d4347984e tempest-CreateVolumesFromSourceVolumeTest-428070546 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:19:31 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-97638723-9a93-4f5a-b646-ef8d4347984e tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-4ec5b92f-02dd-429b-8e7a-851c90c99dd6 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:31 devstack sudo[102026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-4ec5b92f-02dd-429b-8e7a-851c90c99dd6 1073741824 Nov 02 10:19:31 devstack sudo[102026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:31 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-3bcf4460-fca2-4c0a-9d71-16d5520cc10b tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22615453-5853-47c5-b753-ef72fb43c854) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87ecb3af-6c50-475f-99ba-41677ae48f0f', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:31 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-3bcf4460-fca2-4c0a-9d71-16d5520cc10b tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88c67d4b-fadd-4de9-a4a5-4c2f2e34df39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:31 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-3bcf4460-fca2-4c0a-9d71-16d5520cc10b tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Volume volume-87ecb3af-6c50-475f-99ba-41677ae48f0f (87ecb3af-6c50-475f-99ba-41677ae48f0f): created successfully Nov 02 10:19:31 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-3bcf4460-fca2-4c0a-9d71-16d5520cc10b tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88c67d4b-fadd-4de9-a4a5-4c2f2e34df39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:31 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-3bcf4460-fca2-4c0a-9d71-16d5520cc10b tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Flow 'volume_create_manager' (796f93d6-bf87-4f6f-998a-d9ff7b9246c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:19:31 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-3bcf4460-fca2-4c0a-9d71-16d5520cc10b tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Created volume successfully. Nov 02 10:19:31 devstack sudo[102026]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:31 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-97638723-9a93-4f5a-b646-ef8d4347984e tempest-CreateVolumesFromSourceVolumeTest-428070546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-4ec5b92f-02dd-429b-8e7a-851c90c99dd6 1073741824" returned: 0 in 0.517s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:31 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-97638723-9a93-4f5a-b646-ef8d4347984e tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-4ec5b92f-02dd-429b-8e7a-851c90c99dd6 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:31 devstack sudo[102032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-4ec5b92f-02dd-429b-8e7a-851c90c99dd6 Nov 02 10:19:31 devstack sudo[102032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:31 devstack sudo[102032]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:31 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-97638723-9a93-4f5a-b646-ef8d4347984e tempest-CreateVolumesFromSourceVolumeTest-428070546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-4ec5b92f-02dd-429b-8e7a-851c90c99dd6" returned: 0 in 0.241s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:31 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-97638723-9a93-4f5a-b646-ef8d4347984e tempest-CreateVolumesFromSourceVolumeTest-428070546 None] <== create_volume: return (802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:19:31 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-97638723-9a93-4f5a-b646-ef8d4347984e tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.805s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:19:31 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-5fb0580e-7bbe-4493-b441-1398b140b06b tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.565s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:19:31 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-5fb0580e-7bbe-4493-b441-1398b140b06b tempest-CreateVolumesFromSourceVolumeTest-428070546 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:19:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2039740621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=987e1b6f-8093-4997-966a-677606551677,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='515a789d750d465596378d39bee7bfe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:19:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:19:30Z,use_quota=True,user_id='045f91ceecea4051b662733a742a970f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:19:31 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-5fb0580e-7bbe-4493-b441-1398b140b06b tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Creating volume 987e1b6f-8093-4997-966a-677606551677 {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:19:31 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-5fb0580e-7bbe-4493-b441-1398b140b06b tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:19:31 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-5fb0580e-7bbe-4493-b441-1398b140b06b tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:19:31 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-5fb0580e-7bbe-4493-b441-1398b140b06b tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:19:31 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-5fb0580e-7bbe-4493-b441-1398b140b06b tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:19:31 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-5fb0580e-7bbe-4493-b441-1398b140b06b tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:19:31 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-5fb0580e-7bbe-4493-b441-1398b140b06b tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:19:31 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-5fb0580e-7bbe-4493-b441-1398b140b06b tempest-CreateVolumesFromSourceVolumeTest-428070546 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:19:31 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-5fb0580e-7bbe-4493-b441-1398b140b06b tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-987e1b6f-8093-4997-966a-677606551677 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:31 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-97638723-9a93-4f5a-b646-ef8d4347984e tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00c34b11-9190-4ae2-b2a9-41eb317c2773) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ec5b92f-02dd-429b-8e7a-851c90c99dd6', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:31 devstack sudo[102035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-987e1b6f-8093-4997-966a-677606551677 1073741824 Nov 02 10:19:31 devstack sudo[102035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:31 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-97638723-9a93-4f5a-b646-ef8d4347984e tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ee450b8-8491-4b52-8c5c-2a3b3545f582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:31 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-97638723-9a93-4f5a-b646-ef8d4347984e tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Volume volume-4ec5b92f-02dd-429b-8e7a-851c90c99dd6 (4ec5b92f-02dd-429b-8e7a-851c90c99dd6): created successfully Nov 02 10:19:32 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-97638723-9a93-4f5a-b646-ef8d4347984e tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ee450b8-8491-4b52-8c5c-2a3b3545f582) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:32 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-97638723-9a93-4f5a-b646-ef8d4347984e tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Flow 'volume_create_manager' (a98eadc9-fd7a-437f-8c3f-adbea2c89fe8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:19:32 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-97638723-9a93-4f5a-b646-ef8d4347984e tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Created volume successfully. Nov 02 10:19:32 devstack sudo[102035]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:32 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-5fb0580e-7bbe-4493-b441-1398b140b06b tempest-CreateVolumesFromSourceVolumeTest-428070546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-987e1b6f-8093-4997-966a-677606551677 1073741824" returned: 0 in 0.425s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:32 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-5fb0580e-7bbe-4493-b441-1398b140b06b tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-987e1b6f-8093-4997-966a-677606551677 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:32 devstack sudo[102040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-987e1b6f-8093-4997-966a-677606551677 Nov 02 10:19:32 devstack sudo[102040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:32 devstack sudo[102040]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:32 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-5fb0580e-7bbe-4493-b441-1398b140b06b tempest-CreateVolumesFromSourceVolumeTest-428070546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-987e1b6f-8093-4997-966a-677606551677" returned: 0 in 0.266s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:32 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-5fb0580e-7bbe-4493-b441-1398b140b06b tempest-CreateVolumesFromSourceVolumeTest-428070546 None] <== create_volume: return (726ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:19:32 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-5fb0580e-7bbe-4493-b441-1398b140b06b tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.729s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:19:32 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-5fb0580e-7bbe-4493-b441-1398b140b06b tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (300e5871-9f77-44a4-a1c3-c2176d5ee4a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-987e1b6f-8093-4997-966a-677606551677', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:32 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-5fb0580e-7bbe-4493-b441-1398b140b06b tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37f44cf4-94bf-4551-a49e-7bc1eab9f9e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:32 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-5fb0580e-7bbe-4493-b441-1398b140b06b tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Volume volume-987e1b6f-8093-4997-966a-677606551677 (987e1b6f-8093-4997-966a-677606551677): created successfully Nov 02 10:19:32 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-5fb0580e-7bbe-4493-b441-1398b140b06b tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37f44cf4-94bf-4551-a49e-7bc1eab9f9e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:32 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-5fb0580e-7bbe-4493-b441-1398b140b06b tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Flow 'volume_create_manager' (6a81e1e5-baa7-4994-87fe-6de5db06a4f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:19:32 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-5fb0580e-7bbe-4493-b441-1398b140b06b tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Created volume successfully. Nov 02 10:19:33 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-e5494cc3-d839-4f64-887a-d2c1b55ba368 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Acquiring lock "cinder-987e1b6f-8093-4997-966a-677606551677-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:19:33 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-e5494cc3-d839-4f64-887a-d2c1b55ba368 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Lock "cinder-987e1b6f-8093-4997-966a-677606551677-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:19:33 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-e5494cc3-d839-4f64-887a-d2c1b55ba368 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Acquiring lock "cinder-quobyte-987e1b6f-8093-4997-966a-677606551677" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:19:33 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-e5494cc3-d839-4f64-887a-d2c1b55ba368 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Lock "cinder-quobyte-987e1b6f-8093-4997-966a-677606551677" acquired by "delete_volume" :: waited 0.017s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:19:33 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[6405fd1b-deff-4b84-a40f-ee812de6029e]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:19:33 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-e5494cc3-d839-4f64-887a-d2c1b55ba368 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-987e1b6f-8093-4997-966a-677606551677 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:33 devstack sudo[102044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-987e1b6f-8093-4997-966a-677606551677 Nov 02 10:19:33 devstack sudo[102044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:34 devstack sudo[102044]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-e5494cc3-d839-4f64-887a-d2c1b55ba368 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-987e1b6f-8093-4997-966a-677606551677" returned: 0 in 0.392s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-e5494cc3-d839-4f64-887a-d2c1b55ba368 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-987e1b6f-8093-4997-966a-677606551677 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:34 devstack sudo[102049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-987e1b6f-8093-4997-966a-677606551677 Nov 02 10:19:34 devstack sudo[102049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:34 devstack sudo[102049]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-e5494cc3-d839-4f64-887a-d2c1b55ba368 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-987e1b6f-8093-4997-966a-677606551677" returned: 0 in 0.246s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:34 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-e5494cc3-d839-4f64-887a-d2c1b55ba368 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Lock "cinder-quobyte-987e1b6f-8093-4997-966a-677606551677" released by "delete_volume" :: held 0.682s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:19:34 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-e5494cc3-d839-4f64-887a-d2c1b55ba368 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Created reservations ['3a2eb384-09bf-4c3c-81c4-fe50db1dd414', '158e4a46-54ec-4e6b-b3a1-5f1d1ca69785', '839ebe9a-d8e4-4483-82c2-9b9252efcd8e', 'ff090244-d288-42d1-80f7-43562368c5d9'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:19:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-e5494cc3-d839-4f64-887a-d2c1b55ba368 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:19:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-e5494cc3-d839-4f64-887a-d2c1b55ba368 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:19:34 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-e5494cc3-d839-4f64-887a-d2c1b55ba368 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:19:34 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-e5494cc3-d839-4f64-887a-d2c1b55ba368 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:19:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-e5494cc3-d839-4f64-887a-d2c1b55ba368 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:19:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-e5494cc3-d839-4f64-887a-d2c1b55ba368 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:34 devstack sudo[102052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:19:34 devstack sudo[102052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:34 devstack sudo[102052]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-e5494cc3-d839-4f64-887a-d2c1b55ba368 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.248s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:34 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-e5494cc3-d839-4f64-887a-d2c1b55ba368 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:19:34 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-e5494cc3-d839-4f64-887a-d2c1b55ba368 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Deleted volume successfully. Nov 02 10:19:34 devstack cinder-volume[86890]: DEBUG oslo_service.periodic_task [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86890) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:19:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:19:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:19:34 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:19:34 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:19:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:19:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:34 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-e5494cc3-d839-4f64-887a-d2c1b55ba368 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Lock "cinder-987e1b6f-8093-4997-966a-677606551677-delete_volume" released by "delete_volume" :: held 1.157s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:19:34 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-cd40c420-ab71-43b1-b16f-79a5e6d2b8c7 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Acquiring lock "cinder-4ec5b92f-02dd-429b-8e7a-851c90c99dd6-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:19:34 devstack sudo[102055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:19:34 devstack sudo[102055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:34 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-cd40c420-ab71-43b1-b16f-79a5e6d2b8c7 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Lock "cinder-4ec5b92f-02dd-429b-8e7a-851c90c99dd6-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:19:34 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-cd40c420-ab71-43b1-b16f-79a5e6d2b8c7 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Acquiring lock "cinder-quobyte-4ec5b92f-02dd-429b-8e7a-851c90c99dd6" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:19:34 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-cd40c420-ab71-43b1-b16f-79a5e6d2b8c7 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Lock "cinder-quobyte-4ec5b92f-02dd-429b-8e7a-851c90c99dd6" acquired by "delete_volume" :: waited 0.017s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:19:35 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[113af8e3-efd7-4def-a3e7-1034bc606917]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:19:35 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-cd40c420-ab71-43b1-b16f-79a5e6d2b8c7 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-4ec5b92f-02dd-429b-8e7a-851c90c99dd6 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:35 devstack sudo[102057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-4ec5b92f-02dd-429b-8e7a-851c90c99dd6 Nov 02 10:19:35 devstack sudo[102057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:35 devstack sudo[102055]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:35 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.287s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:35 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:19:35 devstack cinder-volume[86890]: DEBUG oslo_service.periodic_task [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Running periodic task VolumeManager._thread_info {{(pid=86890) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:19:35 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] thread count: 29 {{(pid=86890) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:19:35 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] thread info: [<_MainThread(MainThread, started 133913319395456)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86890) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:19:35 devstack sudo[102057]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:35 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-cd40c420-ab71-43b1-b16f-79a5e6d2b8c7 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-4ec5b92f-02dd-429b-8e7a-851c90c99dd6" returned: 0 in 0.372s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:35 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-cd40c420-ab71-43b1-b16f-79a5e6d2b8c7 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-4ec5b92f-02dd-429b-8e7a-851c90c99dd6 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:35 devstack sudo[102063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-4ec5b92f-02dd-429b-8e7a-851c90c99dd6 Nov 02 10:19:35 devstack sudo[102063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:35 devstack sudo[102063]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:35 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-cd40c420-ab71-43b1-b16f-79a5e6d2b8c7 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-4ec5b92f-02dd-429b-8e7a-851c90c99dd6" returned: 0 in 0.247s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:35 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-cd40c420-ab71-43b1-b16f-79a5e6d2b8c7 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Lock "cinder-quobyte-4ec5b92f-02dd-429b-8e7a-851c90c99dd6" released by "delete_volume" :: held 0.675s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:19:35 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-cd40c420-ab71-43b1-b16f-79a5e6d2b8c7 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Created reservations ['f284f32c-db35-40d8-b5a9-2f7ff8b7d237', 'd74bca1e-d1b5-428b-b5cf-2c550cdd20de', '34bab844-9f92-4915-82ae-e64245fc8ff7', '1a5f1be2-d103-4c97-bcf4-1ce4452faf3e'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:19:35 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-cd40c420-ab71-43b1-b16f-79a5e6d2b8c7 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:19:35 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-cd40c420-ab71-43b1-b16f-79a5e6d2b8c7 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:19:35 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-cd40c420-ab71-43b1-b16f-79a5e6d2b8c7 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:19:35 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-cd40c420-ab71-43b1-b16f-79a5e6d2b8c7 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:19:35 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-cd40c420-ab71-43b1-b16f-79a5e6d2b8c7 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:19:35 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-cd40c420-ab71-43b1-b16f-79a5e6d2b8c7 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:35 devstack sudo[102066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:19:35 devstack sudo[102066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:36 devstack sudo[102066]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:36 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-cd40c420-ab71-43b1-b16f-79a5e6d2b8c7 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.250s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:36 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-cd40c420-ab71-43b1-b16f-79a5e6d2b8c7 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:19:36 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-cd40c420-ab71-43b1-b16f-79a5e6d2b8c7 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Deleted volume successfully. Nov 02 10:19:36 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-cd40c420-ab71-43b1-b16f-79a5e6d2b8c7 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Lock "cinder-4ec5b92f-02dd-429b-8e7a-851c90c99dd6-delete_volume" released by "delete_volume" :: held 1.135s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:19:36 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-a61c46b4-6cc0-4d79-b634-20f2c35310a2 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Acquiring lock "cinder-87ecb3af-6c50-475f-99ba-41677ae48f0f-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:19:36 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-a61c46b4-6cc0-4d79-b634-20f2c35310a2 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Lock "cinder-87ecb3af-6c50-475f-99ba-41677ae48f0f-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:19:36 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-a61c46b4-6cc0-4d79-b634-20f2c35310a2 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Acquiring lock "cinder-quobyte-87ecb3af-6c50-475f-99ba-41677ae48f0f" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:19:36 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-a61c46b4-6cc0-4d79-b634-20f2c35310a2 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Lock "cinder-quobyte-87ecb3af-6c50-475f-99ba-41677ae48f0f" acquired by "delete_volume" :: waited 0.012s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:19:36 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[f04ee2bf-000c-4f95-867e-dfcd021f4539]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:19:36 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a61c46b4-6cc0-4d79-b634-20f2c35310a2 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-87ecb3af-6c50-475f-99ba-41677ae48f0f {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:36 devstack sudo[102069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-87ecb3af-6c50-475f-99ba-41677ae48f0f Nov 02 10:19:36 devstack sudo[102069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:36 devstack sudo[102069]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:36 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a61c46b4-6cc0-4d79-b634-20f2c35310a2 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-87ecb3af-6c50-475f-99ba-41677ae48f0f" returned: 0 in 0.362s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:36 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a61c46b4-6cc0-4d79-b634-20f2c35310a2 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-87ecb3af-6c50-475f-99ba-41677ae48f0f {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:36 devstack sudo[102074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-87ecb3af-6c50-475f-99ba-41677ae48f0f Nov 02 10:19:36 devstack sudo[102074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:36 devstack sudo[102074]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:36 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a61c46b4-6cc0-4d79-b634-20f2c35310a2 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-87ecb3af-6c50-475f-99ba-41677ae48f0f" returned: 0 in 0.246s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:36 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-a61c46b4-6cc0-4d79-b634-20f2c35310a2 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Lock "cinder-quobyte-87ecb3af-6c50-475f-99ba-41677ae48f0f" released by "delete_volume" :: held 0.647s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:19:36 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-a61c46b4-6cc0-4d79-b634-20f2c35310a2 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Created reservations ['22bb01a8-9bce-4c9d-ad11-c6cac5632b5a', '422dbcf4-7fb4-4137-808e-b9bed9b680bb', 'fe2bddc8-c42a-4334-b310-493638652243', '9c1d38df-ee83-4066-b393-62b65b503cf0'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:19:36 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-a61c46b4-6cc0-4d79-b634-20f2c35310a2 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:19:36 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-a61c46b4-6cc0-4d79-b634-20f2c35310a2 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:19:36 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-a61c46b4-6cc0-4d79-b634-20f2c35310a2 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:19:36 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-a61c46b4-6cc0-4d79-b634-20f2c35310a2 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:19:36 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-a61c46b4-6cc0-4d79-b634-20f2c35310a2 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:19:36 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a61c46b4-6cc0-4d79-b634-20f2c35310a2 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:36 devstack sudo[102077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:19:36 devstack sudo[102077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:37 devstack sudo[102077]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:37 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a61c46b4-6cc0-4d79-b634-20f2c35310a2 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.241s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:37 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-a61c46b4-6cc0-4d79-b634-20f2c35310a2 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:19:37 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-a61c46b4-6cc0-4d79-b634-20f2c35310a2 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Deleted volume successfully. Nov 02 10:19:37 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-a61c46b4-6cc0-4d79-b634-20f2c35310a2 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Lock "cinder-87ecb3af-6c50-475f-99ba-41677ae48f0f-delete_volume" released by "delete_volume" :: held 1.102s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:19:37 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-a0ff080e-7a00-4e35-b670-147d13f49110 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Acquiring lock "cinder-01f7d8e8-b0cd-409c-82cd-c3b2944360ea-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:19:37 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-a0ff080e-7a00-4e35-b670-147d13f49110 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Lock "cinder-01f7d8e8-b0cd-409c-82cd-c3b2944360ea-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:19:37 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-a0ff080e-7a00-4e35-b670-147d13f49110 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Acquiring lock "cinder-quobyte-01f7d8e8-b0cd-409c-82cd-c3b2944360ea" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:19:37 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-a0ff080e-7a00-4e35-b670-147d13f49110 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Lock "cinder-quobyte-01f7d8e8-b0cd-409c-82cd-c3b2944360ea" acquired by "delete_volume" :: waited 0.016s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:19:37 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[68a2a994-c01f-42ba-a46e-2f6b7b4f3aea]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:19:37 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a0ff080e-7a00-4e35-b670-147d13f49110 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-01f7d8e8-b0cd-409c-82cd-c3b2944360ea {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:37 devstack sudo[102080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-01f7d8e8-b0cd-409c-82cd-c3b2944360ea Nov 02 10:19:37 devstack sudo[102080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:37 devstack sudo[102080]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:37 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a0ff080e-7a00-4e35-b670-147d13f49110 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-01f7d8e8-b0cd-409c-82cd-c3b2944360ea" returned: 0 in 0.385s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:37 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a0ff080e-7a00-4e35-b670-147d13f49110 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-01f7d8e8-b0cd-409c-82cd-c3b2944360ea {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:37 devstack sudo[102085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-01f7d8e8-b0cd-409c-82cd-c3b2944360ea Nov 02 10:19:37 devstack sudo[102085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:38 devstack sudo[102085]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:38 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a0ff080e-7a00-4e35-b670-147d13f49110 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-01f7d8e8-b0cd-409c-82cd-c3b2944360ea" returned: 0 in 0.241s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:38 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-a0ff080e-7a00-4e35-b670-147d13f49110 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Lock "cinder-quobyte-01f7d8e8-b0cd-409c-82cd-c3b2944360ea" released by "delete_volume" :: held 0.678s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:19:38 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-a0ff080e-7a00-4e35-b670-147d13f49110 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Created reservations ['6f9cee0d-5f2f-42f9-886b-c1ebb6420d63', '79be3c9b-c6ae-4c3f-bbff-4c21feaa8b9c', '21153411-a835-45cf-824e-38cd96c9d57b', '0b526575-4355-4974-bc8f-1fedffbf8516'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:19:38 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-a0ff080e-7a00-4e35-b670-147d13f49110 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:19:38 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-a0ff080e-7a00-4e35-b670-147d13f49110 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:19:38 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-a0ff080e-7a00-4e35-b670-147d13f49110 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:19:38 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-a0ff080e-7a00-4e35-b670-147d13f49110 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:19:38 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-a0ff080e-7a00-4e35-b670-147d13f49110 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:19:38 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a0ff080e-7a00-4e35-b670-147d13f49110 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:38 devstack sudo[102088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:19:38 devstack sudo[102088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:38 devstack sudo[102088]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:38 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a0ff080e-7a00-4e35-b670-147d13f49110 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.264s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:38 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-a0ff080e-7a00-4e35-b670-147d13f49110 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:19:38 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-a0ff080e-7a00-4e35-b670-147d13f49110 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Deleted volume successfully. Nov 02 10:19:38 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-11062a47-a47f-4b4b-91d7-951cea0760ec tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Acquiring lock "cinder-130dab52-f195-40cb-93ce-dece2aa280c3-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:19:38 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-11062a47-a47f-4b4b-91d7-951cea0760ec tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Lock "cinder-130dab52-f195-40cb-93ce-dece2aa280c3-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:19:38 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-a0ff080e-7a00-4e35-b670-147d13f49110 tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Lock "cinder-01f7d8e8-b0cd-409c-82cd-c3b2944360ea-delete_volume" released by "delete_volume" :: held 1.185s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:19:38 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-11062a47-a47f-4b4b-91d7-951cea0760ec tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Acquiring lock "cinder-quobyte-130dab52-f195-40cb-93ce-dece2aa280c3" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:19:38 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-11062a47-a47f-4b4b-91d7-951cea0760ec tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Lock "cinder-quobyte-130dab52-f195-40cb-93ce-dece2aa280c3" acquired by "delete_volume" :: waited 0.014s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:19:38 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bb48b64-69e2-4691-ba04-89a206d59103]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:19:38 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-11062a47-a47f-4b4b-91d7-951cea0760ec tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-130dab52-f195-40cb-93ce-dece2aa280c3 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:38 devstack sudo[102091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-130dab52-f195-40cb-93ce-dece2aa280c3 Nov 02 10:19:38 devstack sudo[102091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:38 devstack sudo[102091]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:38 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-11062a47-a47f-4b4b-91d7-951cea0760ec tempest-CreateVolumesFromSourceVolumeTest-428070546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-130dab52-f195-40cb-93ce-dece2aa280c3" returned: 0 in 0.383s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:38 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-11062a47-a47f-4b4b-91d7-951cea0760ec tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-130dab52-f195-40cb-93ce-dece2aa280c3 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:38 devstack sudo[102096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-130dab52-f195-40cb-93ce-dece2aa280c3 Nov 02 10:19:38 devstack sudo[102096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:39 devstack sudo[102096]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:39 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-11062a47-a47f-4b4b-91d7-951cea0760ec tempest-CreateVolumesFromSourceVolumeTest-428070546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-130dab52-f195-40cb-93ce-dece2aa280c3" returned: 0 in 0.271s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:39 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-11062a47-a47f-4b4b-91d7-951cea0760ec tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Lock "cinder-quobyte-130dab52-f195-40cb-93ce-dece2aa280c3" released by "delete_volume" :: held 0.698s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:19:39 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-11062a47-a47f-4b4b-91d7-951cea0760ec tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Created reservations ['7351488c-be35-4076-be99-af92d8844be7', '30249349-70ba-499c-ab5f-b124d90d8fd8', '633f4c60-226b-4423-9356-f34a6b59d5eb', '1c6046d4-2cc9-4dab-a9b3-d4a4eb670447'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:19:39 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-11062a47-a47f-4b4b-91d7-951cea0760ec tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:19:39 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-11062a47-a47f-4b4b-91d7-951cea0760ec tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:19:39 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-11062a47-a47f-4b4b-91d7-951cea0760ec tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:19:39 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-11062a47-a47f-4b4b-91d7-951cea0760ec tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:19:39 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-11062a47-a47f-4b4b-91d7-951cea0760ec tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:19:39 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-11062a47-a47f-4b4b-91d7-951cea0760ec tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:39 devstack sudo[102101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:19:39 devstack sudo[102101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:39 devstack sudo[102101]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:39 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-14367eb5-17e7-4e50-bae7-3ff7e429b76c tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Acquiring lock "cinder-c47588ab-bed4-415e-b859-7b56651e9f09-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:19:39 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-11062a47-a47f-4b4b-91d7-951cea0760ec tempest-CreateVolumesFromSourceVolumeTest-428070546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.275s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:39 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-11062a47-a47f-4b4b-91d7-951cea0760ec tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:19:39 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-11062a47-a47f-4b4b-91d7-951cea0760ec tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Deleted volume successfully. Nov 02 10:19:39 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-14367eb5-17e7-4e50-bae7-3ff7e429b76c tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Lock "cinder-c47588ab-bed4-415e-b859-7b56651e9f09-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:19:39 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-11062a47-a47f-4b4b-91d7-951cea0760ec tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Lock "cinder-130dab52-f195-40cb-93ce-dece2aa280c3-delete_volume" released by "delete_volume" :: held 1.200s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:19:39 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-14367eb5-17e7-4e50-bae7-3ff7e429b76c tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Acquiring lock "cinder-quobyte-c47588ab-bed4-415e-b859-7b56651e9f09" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:19:39 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-14367eb5-17e7-4e50-bae7-3ff7e429b76c tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Lock "cinder-quobyte-c47588ab-bed4-415e-b859-7b56651e9f09" acquired by "delete_volume" :: waited 0.016s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:19:39 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[f39983f6-52a8-40a2-a4ca-a83f5051cb80]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:19:39 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-14367eb5-17e7-4e50-bae7-3ff7e429b76c tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-c47588ab-bed4-415e-b859-7b56651e9f09 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:39 devstack sudo[102104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-c47588ab-bed4-415e-b859-7b56651e9f09 Nov 02 10:19:39 devstack sudo[102104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:40 devstack sudo[102104]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:40 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-14367eb5-17e7-4e50-bae7-3ff7e429b76c tempest-CreateVolumesFromSourceVolumeTest-428070546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-c47588ab-bed4-415e-b859-7b56651e9f09" returned: 0 in 0.387s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:40 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-14367eb5-17e7-4e50-bae7-3ff7e429b76c tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-c47588ab-bed4-415e-b859-7b56651e9f09 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:40 devstack sudo[102109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-c47588ab-bed4-415e-b859-7b56651e9f09 Nov 02 10:19:40 devstack sudo[102109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:40 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-14741398-cd59-4404-8c94-37390f018296 tempest-TestServerVolumeAttachScenarioOldVersion-476832747 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:19:40 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-14741398-cd59-4404-8c94-37390f018296 tempest-TestServerVolumeAttachScenarioOldVersion-476832747 None] Flow 'volume_create_manager' (6aae7a55-9f4b-449c-9966-dcea2ecc400d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:19:40 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-14741398-cd59-4404-8c94-37390f018296 tempest-TestServerVolumeAttachScenarioOldVersion-476832747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c0a19e9-17ae-4f80-8845-862543542d61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:40 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-14741398-cd59-4404-8c94-37390f018296 tempest-TestServerVolumeAttachScenarioOldVersion-476832747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c0a19e9-17ae-4f80-8845-862543542d61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:19:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1837738903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3feb3ab0-ec5a-4515-98d5-81a134b463aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3523981379d042bdaa32388d9baef692',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:19:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:19:40Z,use_quota=True,user_id='5173d53b1065447faf71a0881355b436',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:40 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-14741398-cd59-4404-8c94-37390f018296 tempest-TestServerVolumeAttachScenarioOldVersion-476832747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b723994-2250-4a2c-8afb-9e616444ef38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:40 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-14741398-cd59-4404-8c94-37390f018296 tempest-TestServerVolumeAttachScenarioOldVersion-476832747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b723994-2250-4a2c-8afb-9e616444ef38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:40 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-14741398-cd59-4404-8c94-37390f018296 tempest-TestServerVolumeAttachScenarioOldVersion-476832747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (675b6e98-66a5-4d61-9f9d-2f8d051851b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:40 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-14741398-cd59-4404-8c94-37390f018296 tempest-TestServerVolumeAttachScenarioOldVersion-476832747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (675b6e98-66a5-4d61-9f9d-2f8d051851b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3feb3ab0-ec5a-4515-98d5-81a134b463aa', 'volume_name': 'volume-3feb3ab0-ec5a-4515-98d5-81a134b463aa', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:40 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-14741398-cd59-4404-8c94-37390f018296 tempest-TestServerVolumeAttachScenarioOldVersion-476832747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbb84a5b-67a3-4a6f-8cb3-e16514857672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:40 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-14741398-cd59-4404-8c94-37390f018296 tempest-TestServerVolumeAttachScenarioOldVersion-476832747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbb84a5b-67a3-4a6f-8cb3-e16514857672) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:40 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-14741398-cd59-4404-8c94-37390f018296 tempest-TestServerVolumeAttachScenarioOldVersion-476832747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d153e9c5-95aa-42dc-b924-79d13648b8c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:40 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-14741398-cd59-4404-8c94-37390f018296 tempest-TestServerVolumeAttachScenarioOldVersion-476832747 None] Volume 3feb3ab0-ec5a-4515-98d5-81a134b463aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3feb3ab0-ec5a-4515-98d5-81a134b463aa', 'volume_size': 1} Nov 02 10:19:40 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-14741398-cd59-4404-8c94-37390f018296 tempest-TestServerVolumeAttachScenarioOldVersion-476832747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:19:40 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-14741398-cd59-4404-8c94-37390f018296 tempest-TestServerVolumeAttachScenarioOldVersion-476832747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:19:40 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-14741398-cd59-4404-8c94-37390f018296 tempest-TestServerVolumeAttachScenarioOldVersion-476832747 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:19:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1837738903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3feb3ab0-ec5a-4515-98d5-81a134b463aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3523981379d042bdaa32388d9baef692',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:19:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:19:40Z,use_quota=True,user_id='5173d53b1065447faf71a0881355b436',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:19:40 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-14741398-cd59-4404-8c94-37390f018296 tempest-TestServerVolumeAttachScenarioOldVersion-476832747 None] Creating volume 3feb3ab0-ec5a-4515-98d5-81a134b463aa {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:19:40 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-14741398-cd59-4404-8c94-37390f018296 tempest-TestServerVolumeAttachScenarioOldVersion-476832747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:19:40 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-14741398-cd59-4404-8c94-37390f018296 tempest-TestServerVolumeAttachScenarioOldVersion-476832747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:19:40 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-14741398-cd59-4404-8c94-37390f018296 tempest-TestServerVolumeAttachScenarioOldVersion-476832747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:19:40 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-14741398-cd59-4404-8c94-37390f018296 tempest-TestServerVolumeAttachScenarioOldVersion-476832747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:19:40 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-14741398-cd59-4404-8c94-37390f018296 tempest-TestServerVolumeAttachScenarioOldVersion-476832747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:19:40 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-14741398-cd59-4404-8c94-37390f018296 tempest-TestServerVolumeAttachScenarioOldVersion-476832747 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:19:40 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-14741398-cd59-4404-8c94-37390f018296 tempest-TestServerVolumeAttachScenarioOldVersion-476832747 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:19:40 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-14741398-cd59-4404-8c94-37390f018296 tempest-TestServerVolumeAttachScenarioOldVersion-476832747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3feb3ab0-ec5a-4515-98d5-81a134b463aa 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:40 devstack sudo[102111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3feb3ab0-ec5a-4515-98d5-81a134b463aa 1073741824 Nov 02 10:19:40 devstack sudo[102111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:40 devstack sudo[102109]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:40 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-14367eb5-17e7-4e50-bae7-3ff7e429b76c tempest-CreateVolumesFromSourceVolumeTest-428070546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-c47588ab-bed4-415e-b859-7b56651e9f09" returned: 0 in 0.277s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:40 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-14367eb5-17e7-4e50-bae7-3ff7e429b76c tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Lock "cinder-quobyte-c47588ab-bed4-415e-b859-7b56651e9f09" released by "delete_volume" :: held 0.720s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:19:40 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-14367eb5-17e7-4e50-bae7-3ff7e429b76c tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Created reservations ['093d4f96-e466-4caf-a626-089ee08f8f1e', '7aedcb3a-c74f-422e-8f35-3d9f112964d4', '6a89a706-ed9c-43fd-8132-696928c6991e', '957ad523-f8e4-46d4-897c-8de4939372f4'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:19:40 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-14367eb5-17e7-4e50-bae7-3ff7e429b76c tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:19:40 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-14367eb5-17e7-4e50-bae7-3ff7e429b76c tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:19:40 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-14367eb5-17e7-4e50-bae7-3ff7e429b76c tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:19:40 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-14367eb5-17e7-4e50-bae7-3ff7e429b76c tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:19:40 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-14367eb5-17e7-4e50-bae7-3ff7e429b76c tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:19:40 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-14367eb5-17e7-4e50-bae7-3ff7e429b76c tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:40 devstack sudo[102116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:19:40 devstack sudo[102116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:40 devstack sudo[102111]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:40 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-14741398-cd59-4404-8c94-37390f018296 tempest-TestServerVolumeAttachScenarioOldVersion-476832747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3feb3ab0-ec5a-4515-98d5-81a134b463aa 1073741824" returned: 0 in 0.485s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:40 devstack sudo[102116]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:40 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-14367eb5-17e7-4e50-bae7-3ff7e429b76c tempest-CreateVolumesFromSourceVolumeTest-428070546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.275s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:40 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-14367eb5-17e7-4e50-bae7-3ff7e429b76c tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:19:40 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-14367eb5-17e7-4e50-bae7-3ff7e429b76c tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Deleted volume successfully. Nov 02 10:19:40 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-14741398-cd59-4404-8c94-37390f018296 tempest-TestServerVolumeAttachScenarioOldVersion-476832747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3feb3ab0-ec5a-4515-98d5-81a134b463aa {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:40 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-14367eb5-17e7-4e50-bae7-3ff7e429b76c tempest-CreateVolumesFromSourceVolumeTest-428070546 None] Lock "cinder-c47588ab-bed4-415e-b859-7b56651e9f09-delete_volume" released by "delete_volume" :: held 1.240s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:19:40 devstack sudo[102121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3feb3ab0-ec5a-4515-98d5-81a134b463aa Nov 02 10:19:40 devstack sudo[102121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:41 devstack sudo[102121]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:41 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-14741398-cd59-4404-8c94-37390f018296 tempest-TestServerVolumeAttachScenarioOldVersion-476832747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3feb3ab0-ec5a-4515-98d5-81a134b463aa" returned: 0 in 0.317s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:41 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-14741398-cd59-4404-8c94-37390f018296 tempest-TestServerVolumeAttachScenarioOldVersion-476832747 None] <== create_volume: return (887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:19:41 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-14741398-cd59-4404-8c94-37390f018296 tempest-TestServerVolumeAttachScenarioOldVersion-476832747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:19:41 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-14741398-cd59-4404-8c94-37390f018296 tempest-TestServerVolumeAttachScenarioOldVersion-476832747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d153e9c5-95aa-42dc-b924-79d13648b8c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3feb3ab0-ec5a-4515-98d5-81a134b463aa', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:41 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-14741398-cd59-4404-8c94-37390f018296 tempest-TestServerVolumeAttachScenarioOldVersion-476832747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ab453b1-de48-4caa-9755-04d00b82ad1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:41 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-14741398-cd59-4404-8c94-37390f018296 tempest-TestServerVolumeAttachScenarioOldVersion-476832747 None] Volume volume-3feb3ab0-ec5a-4515-98d5-81a134b463aa (3feb3ab0-ec5a-4515-98d5-81a134b463aa): created successfully Nov 02 10:19:41 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-14741398-cd59-4404-8c94-37390f018296 tempest-TestServerVolumeAttachScenarioOldVersion-476832747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ab453b1-de48-4caa-9755-04d00b82ad1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:41 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-14741398-cd59-4404-8c94-37390f018296 tempest-TestServerVolumeAttachScenarioOldVersion-476832747 None] Flow 'volume_create_manager' (6aae7a55-9f4b-449c-9966-dcea2ecc400d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:19:41 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-14741398-cd59-4404-8c94-37390f018296 tempest-TestServerVolumeAttachScenarioOldVersion-476832747 None] Created volume successfully. Nov 02 10:19:43 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [req-f45ae0f9-ed77-4b14-bd2f-44af71983d13 req-094c4414-9e71-40c8-8a22-67e77fc8be38 tempest-TestServerVolumeAttachScenarioOldVersion-476832747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:19:43 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [req-f45ae0f9-ed77-4b14-bd2f-44af71983d13 req-094c4414-9e71-40c8-8a22-67e77fc8be38 tempest-TestServerVolumeAttachScenarioOldVersion-476832747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:19:43 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [req-f45ae0f9-ed77-4b14-bd2f-44af71983d13 req-094c4414-9e71-40c8-8a22-67e77fc8be38 tempest-TestServerVolumeAttachScenarioOldVersion-476832747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:19:43 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [req-f45ae0f9-ed77-4b14-bd2f-44af71983d13 req-094c4414-9e71-40c8-8a22-67e77fc8be38 tempest-TestServerVolumeAttachScenarioOldVersion-476832747 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67', 'name': 'volume-3feb3ab0-ec5a-4515-98d5-81a134b463aa', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '28b3cf43-fbd3-4e6a-a092-dc60d642f4a5', 'enforce_multipath': True} {{(pid=86890) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:19:43 devstack cinder-volume[86890]: INFO cinder.volume.manager [req-f45ae0f9-ed77-4b14-bd2f-44af71983d13 req-094c4414-9e71-40c8-8a22-67e77fc8be38 tempest-TestServerVolumeAttachScenarioOldVersion-476832747 None] attachment_update completed successfully. Nov 02 10:19:43 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-167febb2-0d98-4ec8-9890-e1561e5ee2c9 tempest-CinderUnicodeTest-2098388071 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:19:43 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-167febb2-0d98-4ec8-9890-e1561e5ee2c9 tempest-CinderUnicodeTest-2098388071 None] Flow 'volume_create_manager' (c26b0d46-36be-442a-8927-368109aff174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:19:43 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-167febb2-0d98-4ec8-9890-e1561e5ee2c9 tempest-CinderUnicodeTest-2098388071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (380dc1e8-2706-4f76-933e-814e03431eed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:43 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-167febb2-0d98-4ec8-9890-e1561e5ee2c9 tempest-CinderUnicodeTest-2098388071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (380dc1e8-2706-4f76-933e-814e03431eed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:19:43Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=807ce06b-310b-40e1-b382-a1d70232ed91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bdd18fadde04da8bffa5a7440c0cd08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:19:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:19:44Z,use_quota=True,user_id='4407d659300a49fe8815990988413754',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:43 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-167febb2-0d98-4ec8-9890-e1561e5ee2c9 tempest-CinderUnicodeTest-2098388071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e962c5ef-5177-4cbe-a585-09e8a790e156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:43 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-167febb2-0d98-4ec8-9890-e1561e5ee2c9 tempest-CinderUnicodeTest-2098388071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e962c5ef-5177-4cbe-a585-09e8a790e156) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:43 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-167febb2-0d98-4ec8-9890-e1561e5ee2c9 tempest-CinderUnicodeTest-2098388071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37b4b9a8-4e65-4dd6-b32d-0c50808ae930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:43 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-167febb2-0d98-4ec8-9890-e1561e5ee2c9 tempest-CinderUnicodeTest-2098388071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37b4b9a8-4e65-4dd6-b32d-0c50808ae930) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '807ce06b-310b-40e1-b382-a1d70232ed91', 'volume_name': 'volume-807ce06b-310b-40e1-b382-a1d70232ed91', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:43 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-167febb2-0d98-4ec8-9890-e1561e5ee2c9 tempest-CinderUnicodeTest-2098388071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1de12ea3-52e5-426d-b8db-6256a99d0d4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:43 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-167febb2-0d98-4ec8-9890-e1561e5ee2c9 tempest-CinderUnicodeTest-2098388071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1de12ea3-52e5-426d-b8db-6256a99d0d4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:43 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-167febb2-0d98-4ec8-9890-e1561e5ee2c9 tempest-CinderUnicodeTest-2098388071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e62157c-54a6-49de-b7c8-d28cd7fe7c62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:43 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-167febb2-0d98-4ec8-9890-e1561e5ee2c9 tempest-CinderUnicodeTest-2098388071 None] Volume 807ce06b-310b-40e1-b382-a1d70232ed91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-807ce06b-310b-40e1-b382-a1d70232ed91', 'volume_size': 1} Nov 02 10:19:43 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-167febb2-0d98-4ec8-9890-e1561e5ee2c9 tempest-CinderUnicodeTest-2098388071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:19:43 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-167febb2-0d98-4ec8-9890-e1561e5ee2c9 tempest-CinderUnicodeTest-2098388071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:19:43 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-167febb2-0d98-4ec8-9890-e1561e5ee2c9 tempest-CinderUnicodeTest-2098388071 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:19:43Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=807ce06b-310b-40e1-b382-a1d70232ed91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bdd18fadde04da8bffa5a7440c0cd08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:19:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:19:44Z,use_quota=True,user_id='4407d659300a49fe8815990988413754',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:19:43 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-167febb2-0d98-4ec8-9890-e1561e5ee2c9 tempest-CinderUnicodeTest-2098388071 None] Creating volume 807ce06b-310b-40e1-b382-a1d70232ed91 {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:19:43 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-167febb2-0d98-4ec8-9890-e1561e5ee2c9 tempest-CinderUnicodeTest-2098388071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:19:43 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-167febb2-0d98-4ec8-9890-e1561e5ee2c9 tempest-CinderUnicodeTest-2098388071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:19:43 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-167febb2-0d98-4ec8-9890-e1561e5ee2c9 tempest-CinderUnicodeTest-2098388071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:19:43 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-167febb2-0d98-4ec8-9890-e1561e5ee2c9 tempest-CinderUnicodeTest-2098388071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:19:43 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-167febb2-0d98-4ec8-9890-e1561e5ee2c9 tempest-CinderUnicodeTest-2098388071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:19:43 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-167febb2-0d98-4ec8-9890-e1561e5ee2c9 tempest-CinderUnicodeTest-2098388071 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:19:43 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-167febb2-0d98-4ec8-9890-e1561e5ee2c9 tempest-CinderUnicodeTest-2098388071 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:19:43 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-167febb2-0d98-4ec8-9890-e1561e5ee2c9 tempest-CinderUnicodeTest-2098388071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-807ce06b-310b-40e1-b382-a1d70232ed91 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:43 devstack sudo[102551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-807ce06b-310b-40e1-b382-a1d70232ed91 1073741824 Nov 02 10:19:43 devstack sudo[102551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:44 devstack sudo[102551]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:44 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-167febb2-0d98-4ec8-9890-e1561e5ee2c9 tempest-CinderUnicodeTest-2098388071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-807ce06b-310b-40e1-b382-a1d70232ed91 1073741824" returned: 0 in 0.452s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:44 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-167febb2-0d98-4ec8-9890-e1561e5ee2c9 tempest-CinderUnicodeTest-2098388071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-807ce06b-310b-40e1-b382-a1d70232ed91 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:44 devstack sudo[102557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-807ce06b-310b-40e1-b382-a1d70232ed91 Nov 02 10:19:44 devstack sudo[102557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:44 devstack sudo[102557]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:44 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-167febb2-0d98-4ec8-9890-e1561e5ee2c9 tempest-CinderUnicodeTest-2098388071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-807ce06b-310b-40e1-b382-a1d70232ed91" returned: 0 in 0.265s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:44 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-167febb2-0d98-4ec8-9890-e1561e5ee2c9 tempest-CinderUnicodeTest-2098388071 None] <== create_volume: return (768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:19:44 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-167febb2-0d98-4ec8-9890-e1561e5ee2c9 tempest-CinderUnicodeTest-2098388071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.771s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:19:44 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-167febb2-0d98-4ec8-9890-e1561e5ee2c9 tempest-CinderUnicodeTest-2098388071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e62157c-54a6-49de-b7c8-d28cd7fe7c62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-807ce06b-310b-40e1-b382-a1d70232ed91', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:44 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-167febb2-0d98-4ec8-9890-e1561e5ee2c9 tempest-CinderUnicodeTest-2098388071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3124875-308c-4dd2-bc40-33f3dd94ed52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:44 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-167febb2-0d98-4ec8-9890-e1561e5ee2c9 tempest-CinderUnicodeTest-2098388071 None] Volume volume-807ce06b-310b-40e1-b382-a1d70232ed91 (807ce06b-310b-40e1-b382-a1d70232ed91): created successfully Nov 02 10:19:44 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-167febb2-0d98-4ec8-9890-e1561e5ee2c9 tempest-CinderUnicodeTest-2098388071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3124875-308c-4dd2-bc40-33f3dd94ed52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:44 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-167febb2-0d98-4ec8-9890-e1561e5ee2c9 tempest-CinderUnicodeTest-2098388071 None] Flow 'volume_create_manager' (c26b0d46-36be-442a-8927-368109aff174) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:19:44 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-167febb2-0d98-4ec8-9890-e1561e5ee2c9 tempest-CinderUnicodeTest-2098388071 None] Created volume successfully. Nov 02 10:19:46 devstack cinder-volume[86890]: INFO cinder.volume.manager [req-e6109757-f450-457f-b18f-f530bbaa8487 req-f0f5225b-6813-48e0-811e-77dcd5aeb8c1 tempest-TestServerVolumeAttachScenarioOldVersion-476832747 None] Terminate volume connection completed successfully. Nov 02 10:19:46 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [req-e6109757-f450-457f-b18f-f530bbaa8487 req-f0f5225b-6813-48e0-811e-77dcd5aeb8c1 tempest-TestServerVolumeAttachScenarioOldVersion-476832747 None] Deleting attachment 28b3cf43-fbd3-4e6a-a092-dc60d642f4a5. {{(pid=86890) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:19:46 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-13d57154-100a-4b65-8973-453e8ddda3fd tempest-CinderUnicodeTest-2098388071 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:19:46 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-13d57154-100a-4b65-8973-453e8ddda3fd tempest-CinderUnicodeTest-2098388071 None] Flow 'volume_create_manager' (74202725-1f78-4d06-8da4-b84f31442401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:19:46 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-13d57154-100a-4b65-8973-453e8ddda3fd tempest-CinderUnicodeTest-2098388071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d66cb1b9-fdf8-4162-9278-1e4f0e1fb915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:46 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-13d57154-100a-4b65-8973-453e8ddda3fd tempest-CinderUnicodeTest-2098388071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d66cb1b9-fdf8-4162-9278-1e4f0e1fb915) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:19:46Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1384654315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37a851a7-5c26-44b9-93bd-78f7a52309ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bdd18fadde04da8bffa5a7440c0cd08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:19:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:19:47Z,use_quota=True,user_id='4407d659300a49fe8815990988413754',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:46 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-13d57154-100a-4b65-8973-453e8ddda3fd tempest-CinderUnicodeTest-2098388071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7546c6b6-166b-48a5-8d0a-c3690c61f543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:46 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-13d57154-100a-4b65-8973-453e8ddda3fd tempest-CinderUnicodeTest-2098388071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7546c6b6-166b-48a5-8d0a-c3690c61f543) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:46 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-13d57154-100a-4b65-8973-453e8ddda3fd tempest-CinderUnicodeTest-2098388071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a3906c2-b677-4609-8557-5c18a6d5210f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:46 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-13d57154-100a-4b65-8973-453e8ddda3fd tempest-CinderUnicodeTest-2098388071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a3906c2-b677-4609-8557-5c18a6d5210f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37a851a7-5c26-44b9-93bd-78f7a52309ec', 'volume_name': 'volume-37a851a7-5c26-44b9-93bd-78f7a52309ec', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:46 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-13d57154-100a-4b65-8973-453e8ddda3fd tempest-CinderUnicodeTest-2098388071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82ff02e4-98d7-45b5-8542-352854ccb21b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:46 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-13d57154-100a-4b65-8973-453e8ddda3fd tempest-CinderUnicodeTest-2098388071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82ff02e4-98d7-45b5-8542-352854ccb21b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:46 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-13d57154-100a-4b65-8973-453e8ddda3fd tempest-CinderUnicodeTest-2098388071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05f399b6-a856-46ee-895a-59856a8cb10f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:46 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-13d57154-100a-4b65-8973-453e8ddda3fd tempest-CinderUnicodeTest-2098388071 None] Volume 37a851a7-5c26-44b9-93bd-78f7a52309ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37a851a7-5c26-44b9-93bd-78f7a52309ec', 'volume_size': 1} Nov 02 10:19:46 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-13d57154-100a-4b65-8973-453e8ddda3fd tempest-CinderUnicodeTest-2098388071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:19:46 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-13d57154-100a-4b65-8973-453e8ddda3fd tempest-CinderUnicodeTest-2098388071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:19:46 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-13d57154-100a-4b65-8973-453e8ddda3fd tempest-CinderUnicodeTest-2098388071 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:19:46Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1384654315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37a851a7-5c26-44b9-93bd-78f7a52309ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bdd18fadde04da8bffa5a7440c0cd08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:19:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:19:47Z,use_quota=True,user_id='4407d659300a49fe8815990988413754',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:19:46 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-13d57154-100a-4b65-8973-453e8ddda3fd tempest-CinderUnicodeTest-2098388071 None] Creating volume 37a851a7-5c26-44b9-93bd-78f7a52309ec {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:19:46 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-13d57154-100a-4b65-8973-453e8ddda3fd tempest-CinderUnicodeTest-2098388071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:19:46 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-13d57154-100a-4b65-8973-453e8ddda3fd tempest-CinderUnicodeTest-2098388071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:19:46 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-13d57154-100a-4b65-8973-453e8ddda3fd tempest-CinderUnicodeTest-2098388071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:19:46 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-13d57154-100a-4b65-8973-453e8ddda3fd tempest-CinderUnicodeTest-2098388071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:19:46 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-13d57154-100a-4b65-8973-453e8ddda3fd tempest-CinderUnicodeTest-2098388071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:19:46 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-13d57154-100a-4b65-8973-453e8ddda3fd tempest-CinderUnicodeTest-2098388071 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:19:46 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-13d57154-100a-4b65-8973-453e8ddda3fd tempest-CinderUnicodeTest-2098388071 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:19:46 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-13d57154-100a-4b65-8973-453e8ddda3fd tempest-CinderUnicodeTest-2098388071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-37a851a7-5c26-44b9-93bd-78f7a52309ec 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:46 devstack sudo[102587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-37a851a7-5c26-44b9-93bd-78f7a52309ec 1073741824 Nov 02 10:19:46 devstack sudo[102587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:47 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-ec378155-bfe0-46ec-b95f-f532169b816e tempest-TestServerVolumeAttachScenarioOldVersion-476832747 None] Acquiring lock "cinder-3feb3ab0-ec5a-4515-98d5-81a134b463aa-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:19:47 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-ec378155-bfe0-46ec-b95f-f532169b816e tempest-TestServerVolumeAttachScenarioOldVersion-476832747 None] Lock "cinder-3feb3ab0-ec5a-4515-98d5-81a134b463aa-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:19:47 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-ec378155-bfe0-46ec-b95f-f532169b816e tempest-TestServerVolumeAttachScenarioOldVersion-476832747 None] Acquiring lock "cinder-quobyte-3feb3ab0-ec5a-4515-98d5-81a134b463aa" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:19:47 devstack sudo[102587]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:47 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-ec378155-bfe0-46ec-b95f-f532169b816e tempest-TestServerVolumeAttachScenarioOldVersion-476832747 None] Lock "cinder-quobyte-3feb3ab0-ec5a-4515-98d5-81a134b463aa" acquired by "delete_volume" :: waited 0.020s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:19:47 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-13d57154-100a-4b65-8973-453e8ddda3fd tempest-CinderUnicodeTest-2098388071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-37a851a7-5c26-44b9-93bd-78f7a52309ec 1073741824" returned: 0 in 0.510s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:47 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1b283e1-12e0-415f-8330-80b25d442fb0]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:19:47 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ec378155-bfe0-46ec-b95f-f532169b816e tempest-TestServerVolumeAttachScenarioOldVersion-476832747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3feb3ab0-ec5a-4515-98d5-81a134b463aa {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:47 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-13d57154-100a-4b65-8973-453e8ddda3fd tempest-CinderUnicodeTest-2098388071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-37a851a7-5c26-44b9-93bd-78f7a52309ec {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:47 devstack sudo[102594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-37a851a7-5c26-44b9-93bd-78f7a52309ec Nov 02 10:19:47 devstack sudo[102594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:47 devstack sudo[102593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3feb3ab0-ec5a-4515-98d5-81a134b463aa Nov 02 10:19:47 devstack sudo[102593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:47 devstack sudo[102594]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:47 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-13d57154-100a-4b65-8973-453e8ddda3fd tempest-CinderUnicodeTest-2098388071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-37a851a7-5c26-44b9-93bd-78f7a52309ec" returned: 0 in 0.248s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:47 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-13d57154-100a-4b65-8973-453e8ddda3fd tempest-CinderUnicodeTest-2098388071 None] <== create_volume: return (807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:19:47 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-13d57154-100a-4b65-8973-453e8ddda3fd tempest-CinderUnicodeTest-2098388071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.810s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:19:47 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-13d57154-100a-4b65-8973-453e8ddda3fd tempest-CinderUnicodeTest-2098388071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05f399b6-a856-46ee-895a-59856a8cb10f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37a851a7-5c26-44b9-93bd-78f7a52309ec', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:47 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-13d57154-100a-4b65-8973-453e8ddda3fd tempest-CinderUnicodeTest-2098388071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f8f5884-5bcd-4d9a-a8c9-9ccee3975a02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:47 devstack sudo[102593]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:47 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ec378155-bfe0-46ec-b95f-f532169b816e tempest-TestServerVolumeAttachScenarioOldVersion-476832747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3feb3ab0-ec5a-4515-98d5-81a134b463aa" returned: 0 in 0.375s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:47 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ec378155-bfe0-46ec-b95f-f532169b816e tempest-TestServerVolumeAttachScenarioOldVersion-476832747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3feb3ab0-ec5a-4515-98d5-81a134b463aa {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:47 devstack sudo[102601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3feb3ab0-ec5a-4515-98d5-81a134b463aa Nov 02 10:19:47 devstack sudo[102601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:47 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-13d57154-100a-4b65-8973-453e8ddda3fd tempest-CinderUnicodeTest-2098388071 None] Volume volume-37a851a7-5c26-44b9-93bd-78f7a52309ec (37a851a7-5c26-44b9-93bd-78f7a52309ec): created successfully Nov 02 10:19:47 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-13d57154-100a-4b65-8973-453e8ddda3fd tempest-CinderUnicodeTest-2098388071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f8f5884-5bcd-4d9a-a8c9-9ccee3975a02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:47 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-13d57154-100a-4b65-8973-453e8ddda3fd tempest-CinderUnicodeTest-2098388071 None] Flow 'volume_create_manager' (74202725-1f78-4d06-8da4-b84f31442401) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:19:47 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-13d57154-100a-4b65-8973-453e8ddda3fd tempest-CinderUnicodeTest-2098388071 None] Created volume successfully. Nov 02 10:19:47 devstack sudo[102601]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:47 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ec378155-bfe0-46ec-b95f-f532169b816e tempest-TestServerVolumeAttachScenarioOldVersion-476832747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3feb3ab0-ec5a-4515-98d5-81a134b463aa" returned: 0 in 0.247s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:47 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-ec378155-bfe0-46ec-b95f-f532169b816e tempest-TestServerVolumeAttachScenarioOldVersion-476832747 None] Lock "cinder-quobyte-3feb3ab0-ec5a-4515-98d5-81a134b463aa" released by "delete_volume" :: held 0.665s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:19:47 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-ec378155-bfe0-46ec-b95f-f532169b816e tempest-TestServerVolumeAttachScenarioOldVersion-476832747 None] Created reservations ['41a7cc22-b56c-43f5-b02d-dbeac512609b', 'b9f6ab32-c10f-4f68-b063-31da2ed7f71c', '156210fd-53c3-462b-a493-ce476756519c', '2bc4188f-3d7e-4f9a-aba2-b99080d2a082'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:19:47 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-ec378155-bfe0-46ec-b95f-f532169b816e tempest-TestServerVolumeAttachScenarioOldVersion-476832747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:19:47 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-ec378155-bfe0-46ec-b95f-f532169b816e tempest-TestServerVolumeAttachScenarioOldVersion-476832747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:19:47 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-ec378155-bfe0-46ec-b95f-f532169b816e tempest-TestServerVolumeAttachScenarioOldVersion-476832747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:19:47 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-ec378155-bfe0-46ec-b95f-f532169b816e tempest-TestServerVolumeAttachScenarioOldVersion-476832747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:19:47 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-ec378155-bfe0-46ec-b95f-f532169b816e tempest-TestServerVolumeAttachScenarioOldVersion-476832747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:19:47 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ec378155-bfe0-46ec-b95f-f532169b816e tempest-TestServerVolumeAttachScenarioOldVersion-476832747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:48 devstack sudo[102604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:19:48 devstack sudo[102604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:48 devstack sudo[102604]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:48 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ec378155-bfe0-46ec-b95f-f532169b816e tempest-TestServerVolumeAttachScenarioOldVersion-476832747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.252s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:48 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-ec378155-bfe0-46ec-b95f-f532169b816e tempest-TestServerVolumeAttachScenarioOldVersion-476832747 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:19:48 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-ec378155-bfe0-46ec-b95f-f532169b816e tempest-TestServerVolumeAttachScenarioOldVersion-476832747 None] Deleted volume successfully. Nov 02 10:19:48 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-ec378155-bfe0-46ec-b95f-f532169b816e tempest-TestServerVolumeAttachScenarioOldVersion-476832747 None] Lock "cinder-3feb3ab0-ec5a-4515-98d5-81a134b463aa-delete_volume" released by "delete_volume" :: held 1.123s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:19:49 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-2881be19-3200-406b-ab09-76cf1f96e720 tempest-CinderUnicodeTest-2098388071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:19:49 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-2881be19-3200-406b-ab09-76cf1f96e720 tempest-CinderUnicodeTest-2098388071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:19:49 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-2881be19-3200-406b-ab09-76cf1f96e720 tempest-CinderUnicodeTest-2098388071 None] Creating offline snapshot b69e4c50-a907-43da-a428-b0c1d21bd4f7 of volume 37a851a7-5c26-44b9-93bd-78f7a52309ec {{(pid=86890) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:19:49 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[023397e9-9c9a-4831-898c-feb75eb3c6ff]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:19:49 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-2881be19-3200-406b-ab09-76cf1f96e720 tempest-CinderUnicodeTest-2098388071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-37a851a7-5c26-44b9-93bd-78f7a52309ec {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:49 devstack sudo[102627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-37a851a7-5c26-44b9-93bd-78f7a52309ec Nov 02 10:19:49 devstack sudo[102627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:49 devstack sudo[102627]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:49 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-2881be19-3200-406b-ab09-76cf1f96e720 tempest-CinderUnicodeTest-2098388071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-37a851a7-5c26-44b9-93bd-78f7a52309ec" returned: 0 in 0.411s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:49 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-2881be19-3200-406b-ab09-76cf1f96e720 tempest-CinderUnicodeTest-2098388071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-37a851a7-5c26-44b9-93bd-78f7a52309ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-37a851a7-5c26-44b9-93bd-78f7a52309ec.b69e4c50-a907-43da-a428-b0c1d21bd4f7 1G {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:49 devstack sudo[102632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-37a851a7-5c26-44b9-93bd-78f7a52309ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-37a851a7-5c26-44b9-93bd-78f7a52309ec.b69e4c50-a907-43da-a428-b0c1d21bd4f7 1G Nov 02 10:19:49 devstack sudo[102632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:50 devstack sudo[102632]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:50 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-2881be19-3200-406b-ab09-76cf1f96e720 tempest-CinderUnicodeTest-2098388071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-37a851a7-5c26-44b9-93bd-78f7a52309ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-37a851a7-5c26-44b9-93bd-78f7a52309ec.b69e4c50-a907-43da-a428-b0c1d21bd4f7 1G" returned: 0 in 0.550s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:50 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-2881be19-3200-406b-ab09-76cf1f96e720 tempest-CinderUnicodeTest-2098388071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37a851a7-5c26-44b9-93bd-78f7a52309ec -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-37a851a7-5c26-44b9-93bd-78f7a52309ec.b69e4c50-a907-43da-a428-b0c1d21bd4f7 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:50 devstack sudo[102640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37a851a7-5c26-44b9-93bd-78f7a52309ec -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-37a851a7-5c26-44b9-93bd-78f7a52309ec.b69e4c50-a907-43da-a428-b0c1d21bd4f7 Nov 02 10:19:50 devstack sudo[102640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:50 devstack sudo[102640]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:50 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-2881be19-3200-406b-ab09-76cf1f96e720 tempest-CinderUnicodeTest-2098388071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37a851a7-5c26-44b9-93bd-78f7a52309ec -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-37a851a7-5c26-44b9-93bd-78f7a52309ec.b69e4c50-a907-43da-a428-b0c1d21bd4f7" returned: 0 in 0.346s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:50 devstack cinder-volume[86890]: WARNING cinder.volume.drivers.remotefs [None req-2881be19-3200-406b-ab09-76cf1f96e720 tempest-CinderUnicodeTest-2098388071 None] /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-37a851a7-5c26-44b9-93bd-78f7a52309ec.b69e4c50-a907-43da-a428-b0c1d21bd4f7 is being set with open permissions: ugo+rw Nov 02 10:19:50 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-2881be19-3200-406b-ab09-76cf1f96e720 tempest-CinderUnicodeTest-2098388071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-37a851a7-5c26-44b9-93bd-78f7a52309ec.b69e4c50-a907-43da-a428-b0c1d21bd4f7 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:50 devstack sudo[102646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-37a851a7-5c26-44b9-93bd-78f7a52309ec.b69e4c50-a907-43da-a428-b0c1d21bd4f7 Nov 02 10:19:50 devstack sudo[102646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:50 devstack sudo[102646]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:50 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-2881be19-3200-406b-ab09-76cf1f96e720 tempest-CinderUnicodeTest-2098388071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-37a851a7-5c26-44b9-93bd-78f7a52309ec.b69e4c50-a907-43da-a428-b0c1d21bd4f7" returned: 0 in 0.286s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:50 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-2881be19-3200-406b-ab09-76cf1f96e720 tempest-CinderUnicodeTest-2098388071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-37a851a7-5c26-44b9-93bd-78f7a52309ec.info {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:50 devstack sudo[102649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-37a851a7-5c26-44b9-93bd-78f7a52309ec.info Nov 02 10:19:50 devstack sudo[102649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:51 devstack sudo[102649]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:51 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-2881be19-3200-406b-ab09-76cf1f96e720 tempest-CinderUnicodeTest-2098388071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-37a851a7-5c26-44b9-93bd-78f7a52309ec.info" returned: 0 in 0.264s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:51 devstack cinder-volume[86890]: WARNING cinder.volume.drivers.remotefs [None req-2881be19-3200-406b-ab09-76cf1f96e720 tempest-CinderUnicodeTest-2098388071 None] /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-37a851a7-5c26-44b9-93bd-78f7a52309ec.info is being set with open permissions: ugo+rw Nov 02 10:19:51 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-2881be19-3200-406b-ab09-76cf1f96e720 tempest-CinderUnicodeTest-2098388071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-37a851a7-5c26-44b9-93bd-78f7a52309ec.info {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:51 devstack sudo[102652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-37a851a7-5c26-44b9-93bd-78f7a52309ec.info Nov 02 10:19:51 devstack sudo[102652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:51 devstack sudo[102652]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:51 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-2881be19-3200-406b-ab09-76cf1f96e720 tempest-CinderUnicodeTest-2098388071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-37a851a7-5c26-44b9-93bd-78f7a52309ec.info" returned: 0 in 0.286s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:51 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-2881be19-3200-406b-ab09-76cf1f96e720 tempest-CinderUnicodeTest-2098388071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.267s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:19:51 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-2881be19-3200-406b-ab09-76cf1f96e720 tempest-CinderUnicodeTest-2098388071 None] Create snapshot completed successfully Nov 02 10:19:52 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-5e4edd71-4da0-45aa-aaa1-3ebfcb6d8c6b tempest-CinderUnicodeTest-2098388071 None] Acquiring lock "cinder-b69e4c50-a907-43da-a428-b0c1d21bd4f7-delete_snapshot" by "delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:19:52 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-5e4edd71-4da0-45aa-aaa1-3ebfcb6d8c6b tempest-CinderUnicodeTest-2098388071 None] Lock "cinder-b69e4c50-a907-43da-a428-b0c1d21bd4f7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:19:52 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-5e4edd71-4da0-45aa-aaa1-3ebfcb6d8c6b tempest-CinderUnicodeTest-2098388071 None] Acquiring lock "cinder-quobyte-37a851a7-5c26-44b9-93bd-78f7a52309ec" by "delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:19:52 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-5e4edd71-4da0-45aa-aaa1-3ebfcb6d8c6b tempest-CinderUnicodeTest-2098388071 None] Lock "cinder-quobyte-37a851a7-5c26-44b9-93bd-78f7a52309ec" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:19:52 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-5e4edd71-4da0-45aa-aaa1-3ebfcb6d8c6b tempest-CinderUnicodeTest-2098388071 None] Acquiring lock "cinder-quobyte-b69e4c50-a907-43da-a428-b0c1d21bd4f7" by "_delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:19:52 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-5e4edd71-4da0-45aa-aaa1-3ebfcb6d8c6b tempest-CinderUnicodeTest-2098388071 None] Lock "cinder-quobyte-b69e4c50-a907-43da-a428-b0c1d21bd4f7" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:19:52 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-5e4edd71-4da0-45aa-aaa1-3ebfcb6d8c6b tempest-CinderUnicodeTest-2098388071 None] Deleting offline snapshot b69e4c50-a907-43da-a428-b0c1d21bd4f7 of volume 37a851a7-5c26-44b9-93bd-78f7a52309ec {{(pid=86890) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:19:52 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-5e4edd71-4da0-45aa-aaa1-3ebfcb6d8c6b tempest-CinderUnicodeTest-2098388071 None] snapshot_file for this snap is: volume-37a851a7-5c26-44b9-93bd-78f7a52309ec.b69e4c50-a907-43da-a428-b0c1d21bd4f7 {{(pid=86890) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:19:52 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[9656ffd9-62c2-4e67-83d0-ecfa2aec8772]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:19:52 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-5e4edd71-4da0-45aa-aaa1-3ebfcb6d8c6b tempest-CinderUnicodeTest-2098388071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-37a851a7-5c26-44b9-93bd-78f7a52309ec.b69e4c50-a907-43da-a428-b0c1d21bd4f7 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:52 devstack sudo[102655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-37a851a7-5c26-44b9-93bd-78f7a52309ec.b69e4c50-a907-43da-a428-b0c1d21bd4f7 Nov 02 10:19:52 devstack sudo[102655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:52 devstack sudo[102655]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:52 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-5e4edd71-4da0-45aa-aaa1-3ebfcb6d8c6b tempest-CinderUnicodeTest-2098388071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-37a851a7-5c26-44b9-93bd-78f7a52309ec.b69e4c50-a907-43da-a428-b0c1d21bd4f7" returned: 0 in 0.397s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:52 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-5e4edd71-4da0-45aa-aaa1-3ebfcb6d8c6b tempest-CinderUnicodeTest-2098388071 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-37a851a7-5c26-44b9-93bd-78f7a52309ec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86890) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:19:52 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[05ccfe13-1dfc-495c-8e4d-59bef10ce1f7]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:19:52 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-5e4edd71-4da0-45aa-aaa1-3ebfcb6d8c6b tempest-CinderUnicodeTest-2098388071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-37a851a7-5c26-44b9-93bd-78f7a52309ec {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:52 devstack sudo[102661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-37a851a7-5c26-44b9-93bd-78f7a52309ec Nov 02 10:19:52 devstack sudo[102661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:53 devstack sudo[102661]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:53 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-5e4edd71-4da0-45aa-aaa1-3ebfcb6d8c6b tempest-CinderUnicodeTest-2098388071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-37a851a7-5c26-44b9-93bd-78f7a52309ec" returned: 0 in 0.422s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:53 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-5e4edd71-4da0-45aa-aaa1-3ebfcb6d8c6b tempest-CinderUnicodeTest-2098388071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-37a851a7-5c26-44b9-93bd-78f7a52309ec.b69e4c50-a907-43da-a428-b0c1d21bd4f7 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:53 devstack sudo[102666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-37a851a7-5c26-44b9-93bd-78f7a52309ec.b69e4c50-a907-43da-a428-b0c1d21bd4f7 Nov 02 10:19:53 devstack sudo[102666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:53 devstack sudo[102666]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:53 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-5e4edd71-4da0-45aa-aaa1-3ebfcb6d8c6b tempest-CinderUnicodeTest-2098388071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-37a851a7-5c26-44b9-93bd-78f7a52309ec.b69e4c50-a907-43da-a428-b0c1d21bd4f7" returned: 0 in 0.453s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:53 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-5e4edd71-4da0-45aa-aaa1-3ebfcb6d8c6b tempest-CinderUnicodeTest-2098388071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-37a851a7-5c26-44b9-93bd-78f7a52309ec.b69e4c50-a907-43da-a428-b0c1d21bd4f7 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:53 devstack sudo[102678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-37a851a7-5c26-44b9-93bd-78f7a52309ec.b69e4c50-a907-43da-a428-b0c1d21bd4f7 Nov 02 10:19:53 devstack sudo[102678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:53 devstack sudo[102678]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:53 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-5e4edd71-4da0-45aa-aaa1-3ebfcb6d8c6b tempest-CinderUnicodeTest-2098388071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-37a851a7-5c26-44b9-93bd-78f7a52309ec.b69e4c50-a907-43da-a428-b0c1d21bd4f7" returned: 0 in 0.283s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:54 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-5e4edd71-4da0-45aa-aaa1-3ebfcb6d8c6b tempest-CinderUnicodeTest-2098388071 None] Lock "cinder-quobyte-b69e4c50-a907-43da-a428-b0c1d21bd4f7" released by "_delete_snapshot" :: held 1.703s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:19:54 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-5e4edd71-4da0-45aa-aaa1-3ebfcb6d8c6b tempest-CinderUnicodeTest-2098388071 None] Lock "cinder-quobyte-37a851a7-5c26-44b9-93bd-78f7a52309ec" released by "delete_snapshot" :: held 1.732s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:19:54 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-5e4edd71-4da0-45aa-aaa1-3ebfcb6d8c6b tempest-CinderUnicodeTest-2098388071 None] Created reservations ['89deead4-923f-42de-8437-d0d7517ea0a4', '20132a72-f83c-4d7a-bab4-07785a123208', '4768d2f6-bb94-41f2-bfba-bd59bbc7d712', '56887462-524c-449c-8821-e752e24d2869'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:19:54 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-5e4edd71-4da0-45aa-aaa1-3ebfcb6d8c6b tempest-CinderUnicodeTest-2098388071 None] Delete snapshot completed successfully. Nov 02 10:19:54 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-5e4edd71-4da0-45aa-aaa1-3ebfcb6d8c6b tempest-CinderUnicodeTest-2098388071 None] Lock "cinder-b69e4c50-a907-43da-a428-b0c1d21bd4f7-delete_snapshot" released by "delete_snapshot" :: held 1.895s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:19:54 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-eb902dfd-c419-4ed7-88e9-71b861b36f3e tempest-CinderUnicodeTest-2098388071 None] Acquiring lock "cinder-37a851a7-5c26-44b9-93bd-78f7a52309ec-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:19:54 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-eb902dfd-c419-4ed7-88e9-71b861b36f3e tempest-CinderUnicodeTest-2098388071 None] Lock "cinder-37a851a7-5c26-44b9-93bd-78f7a52309ec-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:19:54 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-eb902dfd-c419-4ed7-88e9-71b861b36f3e tempest-CinderUnicodeTest-2098388071 None] Acquiring lock "cinder-quobyte-37a851a7-5c26-44b9-93bd-78f7a52309ec" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:19:54 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-eb902dfd-c419-4ed7-88e9-71b861b36f3e tempest-CinderUnicodeTest-2098388071 None] Lock "cinder-quobyte-37a851a7-5c26-44b9-93bd-78f7a52309ec" acquired by "delete_volume" :: waited 0.017s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:19:54 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[51c8f672-722f-4106-85be-570b83700695]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:19:54 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-eb902dfd-c419-4ed7-88e9-71b861b36f3e tempest-CinderUnicodeTest-2098388071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-37a851a7-5c26-44b9-93bd-78f7a52309ec {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:54 devstack sudo[102682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-37a851a7-5c26-44b9-93bd-78f7a52309ec Nov 02 10:19:54 devstack sudo[102682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:54 devstack sudo[102682]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:54 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-eb902dfd-c419-4ed7-88e9-71b861b36f3e tempest-CinderUnicodeTest-2098388071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-37a851a7-5c26-44b9-93bd-78f7a52309ec" returned: 0 in 0.401s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:54 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-eb902dfd-c419-4ed7-88e9-71b861b36f3e tempest-CinderUnicodeTest-2098388071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-37a851a7-5c26-44b9-93bd-78f7a52309ec {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:54 devstack sudo[102687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-37a851a7-5c26-44b9-93bd-78f7a52309ec Nov 02 10:19:54 devstack sudo[102687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:55 devstack sudo[102687]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:55 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-eb902dfd-c419-4ed7-88e9-71b861b36f3e tempest-CinderUnicodeTest-2098388071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-37a851a7-5c26-44b9-93bd-78f7a52309ec" returned: 0 in 0.258s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:55 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-eb902dfd-c419-4ed7-88e9-71b861b36f3e tempest-CinderUnicodeTest-2098388071 None] Lock "cinder-quobyte-37a851a7-5c26-44b9-93bd-78f7a52309ec" released by "delete_volume" :: held 0.729s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:19:55 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-eb902dfd-c419-4ed7-88e9-71b861b36f3e tempest-CinderUnicodeTest-2098388071 None] Created reservations ['721b630e-1c09-430b-841e-f99101798215', 'e665d66b-9394-41dc-a840-93f10b5c9092', '558123c4-e00e-4cbc-88b7-002bf2eaa315', '06a00f0e-f27d-457c-b354-de06847c07bb'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:19:55 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-eb902dfd-c419-4ed7-88e9-71b861b36f3e tempest-CinderUnicodeTest-2098388071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:19:55 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-eb902dfd-c419-4ed7-88e9-71b861b36f3e tempest-CinderUnicodeTest-2098388071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:19:55 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-eb902dfd-c419-4ed7-88e9-71b861b36f3e tempest-CinderUnicodeTest-2098388071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:19:55 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-eb902dfd-c419-4ed7-88e9-71b861b36f3e tempest-CinderUnicodeTest-2098388071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:19:55 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-eb902dfd-c419-4ed7-88e9-71b861b36f3e tempest-CinderUnicodeTest-2098388071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:19:55 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-eb902dfd-c419-4ed7-88e9-71b861b36f3e tempest-CinderUnicodeTest-2098388071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:55 devstack sudo[102690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:19:55 devstack sudo[102690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:55 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-8588301e-35c0-4c07-a8dd-2ea0bd14c0b3 tempest-CinderUnicodeTest-2098388071 None] Acquiring lock "cinder-807ce06b-310b-40e1-b382-a1d70232ed91-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:19:55 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-8588301e-35c0-4c07-a8dd-2ea0bd14c0b3 tempest-CinderUnicodeTest-2098388071 None] Lock "cinder-807ce06b-310b-40e1-b382-a1d70232ed91-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:19:55 devstack sudo[102690]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:55 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-eb902dfd-c419-4ed7-88e9-71b861b36f3e tempest-CinderUnicodeTest-2098388071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.400s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:55 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-8588301e-35c0-4c07-a8dd-2ea0bd14c0b3 tempest-CinderUnicodeTest-2098388071 None] Acquiring lock "cinder-quobyte-807ce06b-310b-40e1-b382-a1d70232ed91" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:19:55 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-eb902dfd-c419-4ed7-88e9-71b861b36f3e tempest-CinderUnicodeTest-2098388071 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:19:55 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-eb902dfd-c419-4ed7-88e9-71b861b36f3e tempest-CinderUnicodeTest-2098388071 None] Deleted volume successfully. Nov 02 10:19:55 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-8588301e-35c0-4c07-a8dd-2ea0bd14c0b3 tempest-CinderUnicodeTest-2098388071 None] Lock "cinder-quobyte-807ce06b-310b-40e1-b382-a1d70232ed91" acquired by "delete_volume" :: waited 0.025s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:19:55 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-eb902dfd-c419-4ed7-88e9-71b861b36f3e tempest-CinderUnicodeTest-2098388071 None] Lock "cinder-37a851a7-5c26-44b9-93bd-78f7a52309ec-delete_volume" released by "delete_volume" :: held 1.361s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:19:55 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1017a08-7bc6-4417-a7f1-86f824f02664]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:19:55 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8588301e-35c0-4c07-a8dd-2ea0bd14c0b3 tempest-CinderUnicodeTest-2098388071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-807ce06b-310b-40e1-b382-a1d70232ed91 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:55 devstack sudo[102693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-807ce06b-310b-40e1-b382-a1d70232ed91 Nov 02 10:19:55 devstack sudo[102693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:56 devstack sudo[102693]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:56 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8588301e-35c0-4c07-a8dd-2ea0bd14c0b3 tempest-CinderUnicodeTest-2098388071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-807ce06b-310b-40e1-b382-a1d70232ed91" returned: 0 in 0.433s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:56 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8588301e-35c0-4c07-a8dd-2ea0bd14c0b3 tempest-CinderUnicodeTest-2098388071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-807ce06b-310b-40e1-b382-a1d70232ed91 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:56 devstack sudo[102699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-807ce06b-310b-40e1-b382-a1d70232ed91 Nov 02 10:19:56 devstack sudo[102699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:56 devstack sudo[102699]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:56 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8588301e-35c0-4c07-a8dd-2ea0bd14c0b3 tempest-CinderUnicodeTest-2098388071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-807ce06b-310b-40e1-b382-a1d70232ed91" returned: 0 in 0.318s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:56 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-8588301e-35c0-4c07-a8dd-2ea0bd14c0b3 tempest-CinderUnicodeTest-2098388071 None] Lock "cinder-quobyte-807ce06b-310b-40e1-b382-a1d70232ed91" released by "delete_volume" :: held 0.816s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:19:56 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-8588301e-35c0-4c07-a8dd-2ea0bd14c0b3 tempest-CinderUnicodeTest-2098388071 None] Created reservations ['564ece7e-405f-4012-a8d9-656cfa3b2f8b', '9d6f206d-92f1-427f-ab04-6d47efe31a75', '930d8973-c808-4e88-83c8-e7bc7c4f3fb6', 'e8fe0932-be6d-4ef9-ad05-0878c86697c9'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:19:56 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-8588301e-35c0-4c07-a8dd-2ea0bd14c0b3 tempest-CinderUnicodeTest-2098388071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:19:56 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-8588301e-35c0-4c07-a8dd-2ea0bd14c0b3 tempest-CinderUnicodeTest-2098388071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:19:56 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-8588301e-35c0-4c07-a8dd-2ea0bd14c0b3 tempest-CinderUnicodeTest-2098388071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:19:56 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-8588301e-35c0-4c07-a8dd-2ea0bd14c0b3 tempest-CinderUnicodeTest-2098388071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:19:56 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-8588301e-35c0-4c07-a8dd-2ea0bd14c0b3 tempest-CinderUnicodeTest-2098388071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:19:56 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8588301e-35c0-4c07-a8dd-2ea0bd14c0b3 tempest-CinderUnicodeTest-2098388071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:56 devstack sudo[102703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:19:56 devstack sudo[102703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:57 devstack sudo[102703]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:57 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8588301e-35c0-4c07-a8dd-2ea0bd14c0b3 tempest-CinderUnicodeTest-2098388071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.264s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:57 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-8588301e-35c0-4c07-a8dd-2ea0bd14c0b3 tempest-CinderUnicodeTest-2098388071 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:19:57 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-8588301e-35c0-4c07-a8dd-2ea0bd14c0b3 tempest-CinderUnicodeTest-2098388071 None] Deleted volume successfully. Nov 02 10:19:57 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-8588301e-35c0-4c07-a8dd-2ea0bd14c0b3 tempest-CinderUnicodeTest-2098388071 None] Lock "cinder-807ce06b-310b-40e1-b382-a1d70232ed91-delete_volume" released by "delete_volume" :: held 1.364s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:20:06 devstack cinder-volume[86890]: DEBUG dbcounter [-] [86890] Writing DB stats cinder:SELECT=70,cinder:UPDATE=119,cinder:INSERT=23,cinder:DELETE=9 {{(pid=86890) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:20:07 devstack cinder-volume[86890]: DEBUG dbcounter [-] [86890] Writing DB stats cinder:UPDATE=96,cinder:SELECT=89,cinder:DELETE=10,cinder:INSERT=27 {{(pid=86890) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:20:25 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-519a89cd-2348-40fe-a262-79e88384c0f1 tempest-TestStampPattern-1570091031 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:20:25 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-519a89cd-2348-40fe-a262-79e88384c0f1 tempest-TestStampPattern-1570091031 None] Flow 'volume_create_manager' (4f241734-b52b-416c-88ba-7afa0fa6c468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:20:25 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-519a89cd-2348-40fe-a262-79e88384c0f1 tempest-TestStampPattern-1570091031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15eb01e5-545f-4198-8e5d-5f7d739d8b14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:25 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-519a89cd-2348-40fe-a262-79e88384c0f1 tempest-TestStampPattern-1570091031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15eb01e5-545f-4198-8e5d-5f7d739d8b14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:20:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-262236577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0c2f5c4-74b4-43f3-b31d-1c3746645815,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d993603ee556451e8daa0a19efde07c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:20:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:20:26Z,use_quota=True,user_id='bb69204a224c45f49797fa77a37c8029',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:25 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-519a89cd-2348-40fe-a262-79e88384c0f1 tempest-TestStampPattern-1570091031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c8b2618-eaaf-4cdc-808c-391ae8f7279c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:25 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-519a89cd-2348-40fe-a262-79e88384c0f1 tempest-TestStampPattern-1570091031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c8b2618-eaaf-4cdc-808c-391ae8f7279c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:25 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-519a89cd-2348-40fe-a262-79e88384c0f1 tempest-TestStampPattern-1570091031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ed94a1c-2904-430b-91d4-d3dbb6af5c02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:25 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-519a89cd-2348-40fe-a262-79e88384c0f1 tempest-TestStampPattern-1570091031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ed94a1c-2904-430b-91d4-d3dbb6af5c02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0c2f5c4-74b4-43f3-b31d-1c3746645815', 'volume_name': 'volume-b0c2f5c4-74b4-43f3-b31d-1c3746645815', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:25 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-519a89cd-2348-40fe-a262-79e88384c0f1 tempest-TestStampPattern-1570091031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (000ac9ab-f5e7-48e1-90fd-aa84c2e211b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:25 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-519a89cd-2348-40fe-a262-79e88384c0f1 tempest-TestStampPattern-1570091031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (000ac9ab-f5e7-48e1-90fd-aa84c2e211b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:25 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-519a89cd-2348-40fe-a262-79e88384c0f1 tempest-TestStampPattern-1570091031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29c063c7-6ede-4adc-ba9e-c3fb5aeff667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:25 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-519a89cd-2348-40fe-a262-79e88384c0f1 tempest-TestStampPattern-1570091031 None] Volume b0c2f5c4-74b4-43f3-b31d-1c3746645815: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0c2f5c4-74b4-43f3-b31d-1c3746645815', 'volume_size': 1} Nov 02 10:20:25 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-519a89cd-2348-40fe-a262-79e88384c0f1 tempest-TestStampPattern-1570091031 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:25 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-519a89cd-2348-40fe-a262-79e88384c0f1 tempest-TestStampPattern-1570091031 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:25 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-519a89cd-2348-40fe-a262-79e88384c0f1 tempest-TestStampPattern-1570091031 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:20:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-262236577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0c2f5c4-74b4-43f3-b31d-1c3746645815,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d993603ee556451e8daa0a19efde07c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:20:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:20:26Z,use_quota=True,user_id='bb69204a224c45f49797fa77a37c8029',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:20:25 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-519a89cd-2348-40fe-a262-79e88384c0f1 tempest-TestStampPattern-1570091031 None] Creating volume b0c2f5c4-74b4-43f3-b31d-1c3746645815 {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:20:25 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-519a89cd-2348-40fe-a262-79e88384c0f1 tempest-TestStampPattern-1570091031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:25 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-519a89cd-2348-40fe-a262-79e88384c0f1 tempest-TestStampPattern-1570091031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:25 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-519a89cd-2348-40fe-a262-79e88384c0f1 tempest-TestStampPattern-1570091031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:20:25 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-519a89cd-2348-40fe-a262-79e88384c0f1 tempest-TestStampPattern-1570091031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:20:25 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-519a89cd-2348-40fe-a262-79e88384c0f1 tempest-TestStampPattern-1570091031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:25 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-519a89cd-2348-40fe-a262-79e88384c0f1 tempest-TestStampPattern-1570091031 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:20:25 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-519a89cd-2348-40fe-a262-79e88384c0f1 tempest-TestStampPattern-1570091031 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:20:25 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-519a89cd-2348-40fe-a262-79e88384c0f1 tempest-TestStampPattern-1570091031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b0c2f5c4-74b4-43f3-b31d-1c3746645815 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:25 devstack sudo[102761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b0c2f5c4-74b4-43f3-b31d-1c3746645815 1073741824 Nov 02 10:20:25 devstack sudo[102761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:26 devstack sudo[102761]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:26 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-519a89cd-2348-40fe-a262-79e88384c0f1 tempest-TestStampPattern-1570091031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b0c2f5c4-74b4-43f3-b31d-1c3746645815 1073741824" returned: 0 in 0.543s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:26 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-519a89cd-2348-40fe-a262-79e88384c0f1 tempest-TestStampPattern-1570091031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b0c2f5c4-74b4-43f3-b31d-1c3746645815 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:26 devstack sudo[102768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b0c2f5c4-74b4-43f3-b31d-1c3746645815 Nov 02 10:20:26 devstack sudo[102768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:26 devstack sudo[102768]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:26 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-519a89cd-2348-40fe-a262-79e88384c0f1 tempest-TestStampPattern-1570091031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b0c2f5c4-74b4-43f3-b31d-1c3746645815" returned: 0 in 0.263s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:26 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-519a89cd-2348-40fe-a262-79e88384c0f1 tempest-TestStampPattern-1570091031 None] <== create_volume: return (861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:20:26 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-519a89cd-2348-40fe-a262-79e88384c0f1 tempest-TestStampPattern-1570091031 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.863s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:26 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-519a89cd-2348-40fe-a262-79e88384c0f1 tempest-TestStampPattern-1570091031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29c063c7-6ede-4adc-ba9e-c3fb5aeff667) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0c2f5c4-74b4-43f3-b31d-1c3746645815', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:26 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-519a89cd-2348-40fe-a262-79e88384c0f1 tempest-TestStampPattern-1570091031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49275642-046b-4cfb-8b0d-62e132c6471b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:26 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-519a89cd-2348-40fe-a262-79e88384c0f1 tempest-TestStampPattern-1570091031 None] Volume volume-b0c2f5c4-74b4-43f3-b31d-1c3746645815 (b0c2f5c4-74b4-43f3-b31d-1c3746645815): created successfully Nov 02 10:20:26 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-519a89cd-2348-40fe-a262-79e88384c0f1 tempest-TestStampPattern-1570091031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49275642-046b-4cfb-8b0d-62e132c6471b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:26 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-519a89cd-2348-40fe-a262-79e88384c0f1 tempest-TestStampPattern-1570091031 None] Flow 'volume_create_manager' (4f241734-b52b-416c-88ba-7afa0fa6c468) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:20:26 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-519a89cd-2348-40fe-a262-79e88384c0f1 tempest-TestStampPattern-1570091031 None] Created volume successfully. Nov 02 10:20:34 devstack cinder-volume[86890]: DEBUG oslo_service.periodic_task [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86890) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:20:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:34 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:20:34 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:20:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:34 devstack sudo[102859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:20:34 devstack sudo[102859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:35 devstack sudo[102859]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:35 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.319s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:35 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:20:35 devstack cinder-volume[86890]: DEBUG oslo_service.periodic_task [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Running periodic task VolumeManager._thread_info {{(pid=86890) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:20:35 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] thread count: 29 {{(pid=86890) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:20:35 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] thread info: [<_MainThread(MainThread, started 133913319395456)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86890) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:20:36 devstack cinder-volume[86890]: DEBUG dbcounter [-] [86890] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3 {{(pid=86890) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:20:36 devstack cinder-volume[86890]: DEBUG dbcounter [-] [86890] Writing DB stats cinder:SELECT=1,cinder:UPDATE=3,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86890) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:20:56 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [req-a6d8d7f2-90d3-4f2f-8a40-18c1b13103f6 req-d58b1744-ef72-4d28-adac-52060040af59 tempest-TestStampPattern-1570091031 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:56 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [req-a6d8d7f2-90d3-4f2f-8a40-18c1b13103f6 req-d58b1744-ef72-4d28-adac-52060040af59 tempest-TestStampPattern-1570091031 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:56 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [req-a6d8d7f2-90d3-4f2f-8a40-18c1b13103f6 req-d58b1744-ef72-4d28-adac-52060040af59 tempest-TestStampPattern-1570091031 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:56 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [req-a6d8d7f2-90d3-4f2f-8a40-18c1b13103f6 req-d58b1744-ef72-4d28-adac-52060040af59 tempest-TestStampPattern-1570091031 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67', 'name': 'volume-b0c2f5c4-74b4-43f3-b31d-1c3746645815', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bafc9fc1-9117-44b4-8992-90ab5a945546', 'enforce_multipath': True} {{(pid=86890) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:20:56 devstack cinder-volume[86890]: INFO cinder.volume.manager [req-a6d8d7f2-90d3-4f2f-8a40-18c1b13103f6 req-d58b1744-ef72-4d28-adac-52060040af59 tempest-TestStampPattern-1570091031 None] attachment_update completed successfully. Nov 02 10:21:00 devstack cinder-volume[86890]: INFO cinder.volume.manager [req-aa40ac0d-abe7-4e40-9f08-a4997f2a24b8 req-cc69ce49-6d59-4ff2-bed8-90d79f19533b tempest-TestStampPattern-1570091031 None] Terminate volume connection completed successfully. Nov 02 10:21:00 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [req-aa40ac0d-abe7-4e40-9f08-a4997f2a24b8 req-cc69ce49-6d59-4ff2-bed8-90d79f19533b tempest-TestStampPattern-1570091031 None] Deleting attachment bafc9fc1-9117-44b4-8992-90ab5a945546. {{(pid=86890) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:21:01 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-2795f8a0-4b6c-4d18-8d5f-5a015d1f7cea tempest-TestStampPattern-1570091031 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:21:01 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-2795f8a0-4b6c-4d18-8d5f-5a015d1f7cea tempest-TestStampPattern-1570091031 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:21:01 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-2795f8a0-4b6c-4d18-8d5f-5a015d1f7cea tempest-TestStampPattern-1570091031 None] Creating offline snapshot 1c117071-4de6-41b1-8565-5821c387fb91 of volume b0c2f5c4-74b4-43f3-b31d-1c3746645815 {{(pid=86890) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:21:01 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddb15e0e-5c67-4cfd-ab17-d9749d36900d]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:21:01 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-2795f8a0-4b6c-4d18-8d5f-5a015d1f7cea tempest-TestStampPattern-1570091031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b0c2f5c4-74b4-43f3-b31d-1c3746645815 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:01 devstack sudo[103361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b0c2f5c4-74b4-43f3-b31d-1c3746645815 Nov 02 10:21:01 devstack sudo[103361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:02 devstack sudo[103361]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:02 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-2795f8a0-4b6c-4d18-8d5f-5a015d1f7cea tempest-TestStampPattern-1570091031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b0c2f5c4-74b4-43f3-b31d-1c3746645815" returned: 0 in 0.346s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:02 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-2795f8a0-4b6c-4d18-8d5f-5a015d1f7cea tempest-TestStampPattern-1570091031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b0c2f5c4-74b4-43f3-b31d-1c3746645815,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b0c2f5c4-74b4-43f3-b31d-1c3746645815.1c117071-4de6-41b1-8565-5821c387fb91 1G {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:02 devstack sudo[103366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b0c2f5c4-74b4-43f3-b31d-1c3746645815,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b0c2f5c4-74b4-43f3-b31d-1c3746645815.1c117071-4de6-41b1-8565-5821c387fb91 1G Nov 02 10:21:02 devstack sudo[103366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:02 devstack sudo[103366]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:02 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-2795f8a0-4b6c-4d18-8d5f-5a015d1f7cea tempest-TestStampPattern-1570091031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b0c2f5c4-74b4-43f3-b31d-1c3746645815,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b0c2f5c4-74b4-43f3-b31d-1c3746645815.1c117071-4de6-41b1-8565-5821c387fb91 1G" returned: 0 in 0.381s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:02 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-2795f8a0-4b6c-4d18-8d5f-5a015d1f7cea tempest-TestStampPattern-1570091031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0c2f5c4-74b4-43f3-b31d-1c3746645815 -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b0c2f5c4-74b4-43f3-b31d-1c3746645815.1c117071-4de6-41b1-8565-5821c387fb91 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:02 devstack sudo[103371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0c2f5c4-74b4-43f3-b31d-1c3746645815 -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b0c2f5c4-74b4-43f3-b31d-1c3746645815.1c117071-4de6-41b1-8565-5821c387fb91 Nov 02 10:21:02 devstack sudo[103371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:02 devstack sudo[103371]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:02 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-2795f8a0-4b6c-4d18-8d5f-5a015d1f7cea tempest-TestStampPattern-1570091031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0c2f5c4-74b4-43f3-b31d-1c3746645815 -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b0c2f5c4-74b4-43f3-b31d-1c3746645815.1c117071-4de6-41b1-8565-5821c387fb91" returned: 0 in 0.308s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:02 devstack cinder-volume[86890]: WARNING cinder.volume.drivers.remotefs [None req-2795f8a0-4b6c-4d18-8d5f-5a015d1f7cea tempest-TestStampPattern-1570091031 None] /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b0c2f5c4-74b4-43f3-b31d-1c3746645815.1c117071-4de6-41b1-8565-5821c387fb91 is being set with open permissions: ugo+rw Nov 02 10:21:02 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-2795f8a0-4b6c-4d18-8d5f-5a015d1f7cea tempest-TestStampPattern-1570091031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b0c2f5c4-74b4-43f3-b31d-1c3746645815.1c117071-4de6-41b1-8565-5821c387fb91 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:02 devstack sudo[103376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b0c2f5c4-74b4-43f3-b31d-1c3746645815.1c117071-4de6-41b1-8565-5821c387fb91 Nov 02 10:21:02 devstack sudo[103376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:03 devstack sudo[103376]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:03 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-2795f8a0-4b6c-4d18-8d5f-5a015d1f7cea tempest-TestStampPattern-1570091031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b0c2f5c4-74b4-43f3-b31d-1c3746645815.1c117071-4de6-41b1-8565-5821c387fb91" returned: 0 in 0.256s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:03 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-2795f8a0-4b6c-4d18-8d5f-5a015d1f7cea tempest-TestStampPattern-1570091031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b0c2f5c4-74b4-43f3-b31d-1c3746645815.info {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:03 devstack sudo[103379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b0c2f5c4-74b4-43f3-b31d-1c3746645815.info Nov 02 10:21:03 devstack sudo[103379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:03 devstack sudo[103379]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:03 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-2795f8a0-4b6c-4d18-8d5f-5a015d1f7cea tempest-TestStampPattern-1570091031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b0c2f5c4-74b4-43f3-b31d-1c3746645815.info" returned: 0 in 0.270s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:03 devstack cinder-volume[86890]: WARNING cinder.volume.drivers.remotefs [None req-2795f8a0-4b6c-4d18-8d5f-5a015d1f7cea tempest-TestStampPattern-1570091031 None] /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b0c2f5c4-74b4-43f3-b31d-1c3746645815.info is being set with open permissions: ugo+rw Nov 02 10:21:03 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-2795f8a0-4b6c-4d18-8d5f-5a015d1f7cea tempest-TestStampPattern-1570091031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b0c2f5c4-74b4-43f3-b31d-1c3746645815.info {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:03 devstack sudo[103382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b0c2f5c4-74b4-43f3-b31d-1c3746645815.info Nov 02 10:21:03 devstack sudo[103382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:03 devstack sudo[103382]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:03 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-2795f8a0-4b6c-4d18-8d5f-5a015d1f7cea tempest-TestStampPattern-1570091031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b0c2f5c4-74b4-43f3-b31d-1c3746645815.info" returned: 0 in 0.244s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:03 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-2795f8a0-4b6c-4d18-8d5f-5a015d1f7cea tempest-TestStampPattern-1570091031 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.897s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:21:03 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-2795f8a0-4b6c-4d18-8d5f-5a015d1f7cea tempest-TestStampPattern-1570091031 None] Create snapshot completed successfully Nov 02 10:21:10 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b45c044-efcc-4e63-bb5c-a60a23716243 tempest-TestStampPattern-1570091031 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:21:10 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-0b45c044-efcc-4e63-bb5c-a60a23716243 tempest-TestStampPattern-1570091031 None] Flow 'volume_create_manager' (b4d2ddb4-4e56-4bbd-ae96-0c5caec5965a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:21:10 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-0b45c044-efcc-4e63-bb5c-a60a23716243 tempest-TestStampPattern-1570091031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b958d80-5bf0-4a12-9941-f02d8b9fa06a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:10 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-0b45c044-efcc-4e63-bb5c-a60a23716243 tempest-TestStampPattern-1570091031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b958d80-5bf0-4a12-9941-f02d8b9fa06a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:21:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1438465255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bfe50f8-be3f-4cea-b413-fd4c019dc946,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d993603ee556451e8daa0a19efde07c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:21:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1c117071-4de6-41b1-8565-5821c387fb91,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:21:11Z,use_quota=True,user_id='bb69204a224c45f49797fa77a37c8029',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:10 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-0b45c044-efcc-4e63-bb5c-a60a23716243 tempest-TestStampPattern-1570091031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25a0033e-dd86-4d1d-a848-9ab468c8481e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:10 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-0b45c044-efcc-4e63-bb5c-a60a23716243 tempest-TestStampPattern-1570091031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25a0033e-dd86-4d1d-a848-9ab468c8481e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:10 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-0b45c044-efcc-4e63-bb5c-a60a23716243 tempest-TestStampPattern-1570091031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1c455e3-99d0-4507-97f8-67ba96808fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:10 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-0b45c044-efcc-4e63-bb5c-a60a23716243 tempest-TestStampPattern-1570091031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1c455e3-99d0-4507-97f8-67ba96808fe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1bfe50f8-be3f-4cea-b413-fd4c019dc946', 'volume_name': 'volume-1bfe50f8-be3f-4cea-b413-fd4c019dc946', 'volume_size': 1, 'snapshot_id': '1c117071-4de6-41b1-8565-5821c387fb91'}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:10 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-0b45c044-efcc-4e63-bb5c-a60a23716243 tempest-TestStampPattern-1570091031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63c100ea-7007-455c-a3cf-816874bc3a21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:10 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-0b45c044-efcc-4e63-bb5c-a60a23716243 tempest-TestStampPattern-1570091031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63c100ea-7007-455c-a3cf-816874bc3a21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:10 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-0b45c044-efcc-4e63-bb5c-a60a23716243 tempest-TestStampPattern-1570091031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0146496-b5b4-496c-b683-0cafb3a2a02b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:10 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-0b45c044-efcc-4e63-bb5c-a60a23716243 tempest-TestStampPattern-1570091031 None] Volume 1bfe50f8-be3f-4cea-b413-fd4c019dc946: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1bfe50f8-be3f-4cea-b413-fd4c019dc946', 'volume_size': 1, 'snapshot_id': '1c117071-4de6-41b1-8565-5821c387fb91'} Nov 02 10:21:10 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-0b45c044-efcc-4e63-bb5c-a60a23716243 tempest-TestStampPattern-1570091031 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:21:10 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-0b45c044-efcc-4e63-bb5c-a60a23716243 tempest-TestStampPattern-1570091031 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:21:10 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-0b45c044-efcc-4e63-bb5c-a60a23716243 tempest-TestStampPattern-1570091031 None] Acquiring lock "cinder-quobyte-1c117071-4de6-41b1-8565-5821c387fb91-1bfe50f8-be3f-4cea-b413-fd4c019dc946" by "_create_volume_from_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:21:10 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-0b45c044-efcc-4e63-bb5c-a60a23716243 tempest-TestStampPattern-1570091031 None] Lock "cinder-quobyte-1c117071-4de6-41b1-8565-5821c387fb91-1bfe50f8-be3f-4cea-b413-fd4c019dc946" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:21:10 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-0b45c044-efcc-4e63-bb5c-a60a23716243 tempest-TestStampPattern-1570091031 None] Creating volume 1bfe50f8-be3f-4cea-b413-fd4c019dc946 from snapshot 1c117071-4de6-41b1-8565-5821c387fb91 {{(pid=86890) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 02 10:21:10 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-0b45c044-efcc-4e63-bb5c-a60a23716243 tempest-TestStampPattern-1570091031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:21:10 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-0b45c044-efcc-4e63-bb5c-a60a23716243 tempest-TestStampPattern-1570091031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:21:10 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-0b45c044-efcc-4e63-bb5c-a60a23716243 tempest-TestStampPattern-1570091031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:21:10 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-0b45c044-efcc-4e63-bb5c-a60a23716243 tempest-TestStampPattern-1570091031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:21:10 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-0b45c044-efcc-4e63-bb5c-a60a23716243 tempest-TestStampPattern-1570091031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:21:10 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-0b45c044-efcc-4e63-bb5c-a60a23716243 tempest-TestStampPattern-1570091031 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:21:10 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-0b45c044-efcc-4e63-bb5c-a60a23716243 tempest-TestStampPattern-1570091031 None] Acquiring lock "cinder-quobyte-1bfe50f8-be3f-4cea-b413-fd4c019dc946" by "_copy_volume_from_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:21:11 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-0b45c044-efcc-4e63-bb5c-a60a23716243 tempest-TestStampPattern-1570091031 None] Lock "cinder-quobyte-1bfe50f8-be3f-4cea-b413-fd4c019dc946" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:21:11 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-0b45c044-efcc-4e63-bb5c-a60a23716243 tempest-TestStampPattern-1570091031 None] snapshot: 1c117071-4de6-41b1-8565-5821c387fb91, volume: 1bfe50f8-be3f-4cea-b413-fd4c019dc946, {{(pid=86890) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 10:21:11 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-0b45c044-efcc-4e63-bb5c-a60a23716243 tempest-TestStampPattern-1570091031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:21:11 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-0b45c044-efcc-4e63-bb5c-a60a23716243 tempest-TestStampPattern-1570091031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:21:11 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-0b45c044-efcc-4e63-bb5c-a60a23716243 tempest-TestStampPattern-1570091031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:21:11 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-0b45c044-efcc-4e63-bb5c-a60a23716243 tempest-TestStampPattern-1570091031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:21:11 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-0b45c044-efcc-4e63-bb5c-a60a23716243 tempest-TestStampPattern-1570091031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:21:11 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[98c69a4a-0409-4604-b5ca-8b8d0c3d01cf]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:21:11 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-0b45c044-efcc-4e63-bb5c-a60a23716243 tempest-TestStampPattern-1570091031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b0c2f5c4-74b4-43f3-b31d-1c3746645815.1c117071-4de6-41b1-8565-5821c387fb91 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:11 devstack sudo[103418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b0c2f5c4-74b4-43f3-b31d-1c3746645815.1c117071-4de6-41b1-8565-5821c387fb91 Nov 02 10:21:11 devstack sudo[103418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:11 devstack sudo[103418]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:11 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-0b45c044-efcc-4e63-bb5c-a60a23716243 tempest-TestStampPattern-1570091031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b0c2f5c4-74b4-43f3-b31d-1c3746645815.1c117071-4de6-41b1-8565-5821c387fb91" returned: 0 in 0.485s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:11 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-0b45c044-efcc-4e63-bb5c-a60a23716243 tempest-TestStampPattern-1570091031 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b0c2f5c4-74b4-43f3-b31d-1c3746645815(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86890) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:21:11 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[47a024e9-ff33-4041-a505-42ec1aa27853]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:21:11 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-0b45c044-efcc-4e63-bb5c-a60a23716243 tempest-TestStampPattern-1570091031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b0c2f5c4-74b4-43f3-b31d-1c3746645815 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:11 devstack sudo[103423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b0c2f5c4-74b4-43f3-b31d-1c3746645815 Nov 02 10:21:11 devstack sudo[103423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:12 devstack sudo[103423]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:12 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-0b45c044-efcc-4e63-bb5c-a60a23716243 tempest-TestStampPattern-1570091031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b0c2f5c4-74b4-43f3-b31d-1c3746645815" returned: 0 in 0.451s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:12 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-0b45c044-efcc-4e63-bb5c-a60a23716243 tempest-TestStampPattern-1570091031 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b0c2f5c4-74b4-43f3-b31d-1c3746645815 {{(pid=86890) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 10:21:12 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-0b45c044-efcc-4e63-bb5c-a60a23716243 tempest-TestStampPattern-1570091031 None] Creating direct copy from snapshot {{(pid=86890) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 10:21:12 devstack cinder-volume[86890]: DEBUG cinder.utils [None req-0b45c044-efcc-4e63-bb5c-a60a23716243 tempest-TestStampPattern-1570091031 None] Path /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-1bfe50f8-be3f-4cea-b413-fd4c019dc946 not found in is_blk_device check {{(pid=86890) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 10:21:12 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-0b45c044-efcc-4e63-bb5c-a60a23716243 tempest-TestStampPattern-1570091031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b0c2f5c4-74b4-43f3-b31d-1c3746645815 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-1bfe50f8-be3f-4cea-b413-fd4c019dc946 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:12 devstack sudo[103431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b0c2f5c4-74b4-43f3-b31d-1c3746645815 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-1bfe50f8-be3f-4cea-b413-fd4c019dc946 Nov 02 10:21:12 devstack sudo[103431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:20 devstack sudo[103431]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:20 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-0b45c044-efcc-4e63-bb5c-a60a23716243 tempest-TestStampPattern-1570091031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b0c2f5c4-74b4-43f3-b31d-1c3746645815 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-1bfe50f8-be3f-4cea-b413-fd4c019dc946" returned: 0 in 8.605s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:20 devstack cinder-volume[86890]: DEBUG cinder.image.image_utils [None req-0b45c044-efcc-4e63-bb5c-a60a23716243 tempest-TestStampPattern-1570091031 None] Image conversion details: src /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b0c2f5c4-74b4-43f3-b31d-1c3746645815, size 1024.00 MB, duration 8.61 sec, destination /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-1bfe50f8-be3f-4cea-b413-fd4c019dc946 {{(pid=86890) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 10:21:20 devstack cinder-volume[86890]: INFO cinder.image.image_utils [None req-0b45c044-efcc-4e63-bb5c-a60a23716243 tempest-TestStampPattern-1570091031 None] Converted 1024.00 MB image at 118.97 MB/s Nov 02 10:21:20 devstack cinder-volume[86890]: WARNING cinder.volume.drivers.remotefs [None req-0b45c044-efcc-4e63-bb5c-a60a23716243 tempest-TestStampPattern-1570091031 None] /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-1bfe50f8-be3f-4cea-b413-fd4c019dc946 is being set with open permissions: ugo+rw Nov 02 10:21:20 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-0b45c044-efcc-4e63-bb5c-a60a23716243 tempest-TestStampPattern-1570091031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-1bfe50f8-be3f-4cea-b413-fd4c019dc946 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:20 devstack sudo[103560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-1bfe50f8-be3f-4cea-b413-fd4c019dc946 Nov 02 10:21:20 devstack sudo[103560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:20 devstack cinder-volume[86890]: DEBUG dbcounter [-] [86890] Writing DB stats cinder:SELECT=11,cinder:UPDATE=5,cinder:INSERT=1 {{(pid=86890) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:21:21 devstack cinder-volume[86890]: DEBUG dbcounter [-] [86890] Writing DB stats cinder:SELECT=16,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=86890) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:21:21 devstack sudo[103560]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:21 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-0b45c044-efcc-4e63-bb5c-a60a23716243 tempest-TestStampPattern-1570091031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-1bfe50f8-be3f-4cea-b413-fd4c019dc946" returned: 0 in 0.357s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:21 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-0b45c044-efcc-4e63-bb5c-a60a23716243 tempest-TestStampPattern-1570091031 None] Lock "cinder-quobyte-1bfe50f8-be3f-4cea-b413-fd4c019dc946" released by "_copy_volume_from_snapshot" :: held 10.042s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:21:21 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-0b45c044-efcc-4e63-bb5c-a60a23716243 tempest-TestStampPattern-1570091031 None] Lock "cinder-quobyte-1c117071-4de6-41b1-8565-5821c387fb91-1bfe50f8-be3f-4cea-b413-fd4c019dc946" released by "_create_volume_from_snapshot" :: held 10.138s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:21:21 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-0b45c044-efcc-4e63-bb5c-a60a23716243 tempest-TestStampPattern-1570091031 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.158s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:21:21 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-0b45c044-efcc-4e63-bb5c-a60a23716243 tempest-TestStampPattern-1570091031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0146496-b5b4-496c-b683-0cafb3a2a02b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1bfe50f8-be3f-4cea-b413-fd4c019dc946', 'volume_size': 1, 'snapshot_id': '1c117071-4de6-41b1-8565-5821c387fb91'}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:21 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-0b45c044-efcc-4e63-bb5c-a60a23716243 tempest-TestStampPattern-1570091031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87da8245-71f3-48c3-9879-77f5d669b582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:21 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-0b45c044-efcc-4e63-bb5c-a60a23716243 tempest-TestStampPattern-1570091031 None] Volume volume-1bfe50f8-be3f-4cea-b413-fd4c019dc946 (1bfe50f8-be3f-4cea-b413-fd4c019dc946): created successfully Nov 02 10:21:21 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-0b45c044-efcc-4e63-bb5c-a60a23716243 tempest-TestStampPattern-1570091031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87da8245-71f3-48c3-9879-77f5d669b582) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:21 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-0b45c044-efcc-4e63-bb5c-a60a23716243 tempest-TestStampPattern-1570091031 None] Flow 'volume_create_manager' (b4d2ddb4-4e56-4bbd-ae96-0c5caec5965a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:21:21 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-0b45c044-efcc-4e63-bb5c-a60a23716243 tempest-TestStampPattern-1570091031 None] Created volume successfully. Nov 02 10:21:31 devstack cinder-volume[86890]: DEBUG dbcounter [-] [86890] Writing DB stats cinder:SELECT=1,cinder:UPDATE=4 {{(pid=86890) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:21:31 devstack cinder-volume[86890]: DEBUG dbcounter [-] [86890] Writing DB stats cinder:SELECT=2,cinder:INSERT=1,cinder:UPDATE=1,cinder:DELETE=1 {{(pid=86890) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:21:34 devstack cinder-volume[86890]: DEBUG oslo_service.periodic_task [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86890) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:21:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:21:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:21:34 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:21:34 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:21:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:21:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:34 devstack sudo[103585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:21:34 devstack sudo[103585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:35 devstack sudo[103585]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:35 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.257s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:35 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:21:35 devstack cinder-volume[86890]: DEBUG oslo_service.periodic_task [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Running periodic task VolumeManager._thread_info {{(pid=86890) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:21:35 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] thread count: 29 {{(pid=86890) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:21:35 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] thread info: [<_MainThread(MainThread, started 133913319395456)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86890) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:22:02 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [req-c1cf37ca-e869-49c4-a243-644249e05e96 req-83fa280c-029d-4c28-9e62-3efbf45f8d06 tempest-TestStampPattern-1570091031 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:22:02 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [req-c1cf37ca-e869-49c4-a243-644249e05e96 req-83fa280c-029d-4c28-9e62-3efbf45f8d06 tempest-TestStampPattern-1570091031 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:22:02 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [req-c1cf37ca-e869-49c4-a243-644249e05e96 req-83fa280c-029d-4c28-9e62-3efbf45f8d06 tempest-TestStampPattern-1570091031 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:22:02 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [req-c1cf37ca-e869-49c4-a243-644249e05e96 req-83fa280c-029d-4c28-9e62-3efbf45f8d06 tempest-TestStampPattern-1570091031 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67', 'name': 'volume-1bfe50f8-be3f-4cea-b413-fd4c019dc946', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2a90e5be-377b-47b5-870d-bcc0e57db260', 'enforce_multipath': True} {{(pid=86890) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:22:02 devstack cinder-volume[86890]: INFO cinder.volume.manager [req-c1cf37ca-e869-49c4-a243-644249e05e96 req-83fa280c-029d-4c28-9e62-3efbf45f8d06 tempest-TestStampPattern-1570091031 None] attachment_update completed successfully. Nov 02 10:22:05 devstack cinder-volume[86890]: INFO cinder.volume.manager [req-b8bea0b2-7e2c-4e31-a81f-76a46354535b req-63bb18d6-8b1b-45a4-9d3b-ab5b61a0d440 tempest-TestStampPattern-1570091031 None] Terminate volume connection completed successfully. Nov 02 10:22:05 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [req-b8bea0b2-7e2c-4e31-a81f-76a46354535b req-63bb18d6-8b1b-45a4-9d3b-ab5b61a0d440 tempest-TestStampPattern-1570091031 None] Deleting attachment 2a90e5be-377b-47b5-870d-bcc0e57db260. {{(pid=86890) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:22:09 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-9dd4e1ae-b366-4c8d-9f1e-516679aef17b tempest-TestStampPattern-1570091031 None] Acquiring lock "cinder-1bfe50f8-be3f-4cea-b413-fd4c019dc946-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:22:09 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-9dd4e1ae-b366-4c8d-9f1e-516679aef17b tempest-TestStampPattern-1570091031 None] Lock "cinder-1bfe50f8-be3f-4cea-b413-fd4c019dc946-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:22:09 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-9dd4e1ae-b366-4c8d-9f1e-516679aef17b tempest-TestStampPattern-1570091031 None] Acquiring lock "cinder-quobyte-1bfe50f8-be3f-4cea-b413-fd4c019dc946" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:22:09 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-9dd4e1ae-b366-4c8d-9f1e-516679aef17b tempest-TestStampPattern-1570091031 None] Lock "cinder-quobyte-1bfe50f8-be3f-4cea-b413-fd4c019dc946" acquired by "delete_volume" :: waited 0.019s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:22:09 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0aa2261-8485-47e6-aed9-32e1747df1fa]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:22:09 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-9dd4e1ae-b366-4c8d-9f1e-516679aef17b tempest-TestStampPattern-1570091031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-1bfe50f8-be3f-4cea-b413-fd4c019dc946 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:10 devstack sudo[104100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-1bfe50f8-be3f-4cea-b413-fd4c019dc946 Nov 02 10:22:10 devstack sudo[104100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:10 devstack sudo[104100]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:10 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-9dd4e1ae-b366-4c8d-9f1e-516679aef17b tempest-TestStampPattern-1570091031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-1bfe50f8-be3f-4cea-b413-fd4c019dc946" returned: 0 in 0.373s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:10 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-9dd4e1ae-b366-4c8d-9f1e-516679aef17b tempest-TestStampPattern-1570091031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-1bfe50f8-be3f-4cea-b413-fd4c019dc946 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:10 devstack sudo[104105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-1bfe50f8-be3f-4cea-b413-fd4c019dc946 Nov 02 10:22:10 devstack sudo[104105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:10 devstack sudo[104105]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:10 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-9dd4e1ae-b366-4c8d-9f1e-516679aef17b tempest-TestStampPattern-1570091031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-1bfe50f8-be3f-4cea-b413-fd4c019dc946" returned: 0 in 0.249s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:10 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-9dd4e1ae-b366-4c8d-9f1e-516679aef17b tempest-TestStampPattern-1570091031 None] Lock "cinder-quobyte-1bfe50f8-be3f-4cea-b413-fd4c019dc946" released by "delete_volume" :: held 0.667s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:22:10 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-9dd4e1ae-b366-4c8d-9f1e-516679aef17b tempest-TestStampPattern-1570091031 None] Created reservations ['08b74d84-31d9-488e-b156-0ed663064142', '3098ee44-c082-4828-8de0-e3c72b4a7a22', 'd6a2377f-a29c-4089-8f18-c3fe804d9f2c', 'cef052a9-6bbc-4ee0-94a5-98d2ec54b40f'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:22:10 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-9dd4e1ae-b366-4c8d-9f1e-516679aef17b tempest-TestStampPattern-1570091031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:22:10 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-9dd4e1ae-b366-4c8d-9f1e-516679aef17b tempest-TestStampPattern-1570091031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:22:10 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-9dd4e1ae-b366-4c8d-9f1e-516679aef17b tempest-TestStampPattern-1570091031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:22:10 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-9dd4e1ae-b366-4c8d-9f1e-516679aef17b tempest-TestStampPattern-1570091031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:22:10 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-9dd4e1ae-b366-4c8d-9f1e-516679aef17b tempest-TestStampPattern-1570091031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:22:10 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-9dd4e1ae-b366-4c8d-9f1e-516679aef17b tempest-TestStampPattern-1570091031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:10 devstack sudo[104108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:22:10 devstack sudo[104108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:11 devstack sudo[104108]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:11 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-9dd4e1ae-b366-4c8d-9f1e-516679aef17b tempest-TestStampPattern-1570091031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.287s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:11 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-9dd4e1ae-b366-4c8d-9f1e-516679aef17b tempest-TestStampPattern-1570091031 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:22:11 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-9dd4e1ae-b366-4c8d-9f1e-516679aef17b tempest-TestStampPattern-1570091031 None] Deleted volume successfully. Nov 02 10:22:11 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-9dd4e1ae-b366-4c8d-9f1e-516679aef17b tempest-TestStampPattern-1570091031 None] Lock "cinder-1bfe50f8-be3f-4cea-b413-fd4c019dc946-delete_volume" released by "delete_volume" :: held 1.185s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:22:11 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-486b3835-fadc-4cd1-abd1-1e32419aac27 tempest-TestStampPattern-1570091031 None] Acquiring lock "cinder-1c117071-4de6-41b1-8565-5821c387fb91-delete_snapshot" by "delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:22:11 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-486b3835-fadc-4cd1-abd1-1e32419aac27 tempest-TestStampPattern-1570091031 None] Lock "cinder-1c117071-4de6-41b1-8565-5821c387fb91-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:22:11 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-486b3835-fadc-4cd1-abd1-1e32419aac27 tempest-TestStampPattern-1570091031 None] Acquiring lock "cinder-quobyte-b0c2f5c4-74b4-43f3-b31d-1c3746645815" by "delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:22:11 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-486b3835-fadc-4cd1-abd1-1e32419aac27 tempest-TestStampPattern-1570091031 None] Lock "cinder-quobyte-b0c2f5c4-74b4-43f3-b31d-1c3746645815" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:22:11 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-486b3835-fadc-4cd1-abd1-1e32419aac27 tempest-TestStampPattern-1570091031 None] Acquiring lock "cinder-quobyte-1c117071-4de6-41b1-8565-5821c387fb91" by "_delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:22:11 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-486b3835-fadc-4cd1-abd1-1e32419aac27 tempest-TestStampPattern-1570091031 None] Lock "cinder-quobyte-1c117071-4de6-41b1-8565-5821c387fb91" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:22:11 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-486b3835-fadc-4cd1-abd1-1e32419aac27 tempest-TestStampPattern-1570091031 None] Deleting offline snapshot 1c117071-4de6-41b1-8565-5821c387fb91 of volume b0c2f5c4-74b4-43f3-b31d-1c3746645815 {{(pid=86890) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:22:11 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-486b3835-fadc-4cd1-abd1-1e32419aac27 tempest-TestStampPattern-1570091031 None] snapshot_file for this snap is: volume-b0c2f5c4-74b4-43f3-b31d-1c3746645815.1c117071-4de6-41b1-8565-5821c387fb91 {{(pid=86890) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:22:11 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bb94bdb-1c8e-429f-9eb5-52fb140f8fa1]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:22:11 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-486b3835-fadc-4cd1-abd1-1e32419aac27 tempest-TestStampPattern-1570091031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b0c2f5c4-74b4-43f3-b31d-1c3746645815.1c117071-4de6-41b1-8565-5821c387fb91 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:11 devstack sudo[104111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b0c2f5c4-74b4-43f3-b31d-1c3746645815.1c117071-4de6-41b1-8565-5821c387fb91 Nov 02 10:22:11 devstack sudo[104111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:11 devstack sudo[104111]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:11 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-486b3835-fadc-4cd1-abd1-1e32419aac27 tempest-TestStampPattern-1570091031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b0c2f5c4-74b4-43f3-b31d-1c3746645815.1c117071-4de6-41b1-8565-5821c387fb91" returned: 0 in 0.351s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:11 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-486b3835-fadc-4cd1-abd1-1e32419aac27 tempest-TestStampPattern-1570091031 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b0c2f5c4-74b4-43f3-b31d-1c3746645815(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86890) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:22:11 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a31105b-64fa-479e-b482-5208e0ba5b18]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:22:11 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-486b3835-fadc-4cd1-abd1-1e32419aac27 tempest-TestStampPattern-1570091031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b0c2f5c4-74b4-43f3-b31d-1c3746645815 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:11 devstack sudo[104116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b0c2f5c4-74b4-43f3-b31d-1c3746645815 Nov 02 10:22:11 devstack sudo[104116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:12 devstack sudo[104116]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:12 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-486b3835-fadc-4cd1-abd1-1e32419aac27 tempest-TestStampPattern-1570091031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b0c2f5c4-74b4-43f3-b31d-1c3746645815" returned: 0 in 0.529s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:12 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-486b3835-fadc-4cd1-abd1-1e32419aac27 tempest-TestStampPattern-1570091031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b0c2f5c4-74b4-43f3-b31d-1c3746645815.1c117071-4de6-41b1-8565-5821c387fb91 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:12 devstack sudo[104121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b0c2f5c4-74b4-43f3-b31d-1c3746645815.1c117071-4de6-41b1-8565-5821c387fb91 Nov 02 10:22:12 devstack sudo[104121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:12 devstack sudo[104121]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:12 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-486b3835-fadc-4cd1-abd1-1e32419aac27 tempest-TestStampPattern-1570091031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b0c2f5c4-74b4-43f3-b31d-1c3746645815.1c117071-4de6-41b1-8565-5821c387fb91" returned: 0 in 0.348s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:12 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-486b3835-fadc-4cd1-abd1-1e32419aac27 tempest-TestStampPattern-1570091031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b0c2f5c4-74b4-43f3-b31d-1c3746645815.1c117071-4de6-41b1-8565-5821c387fb91 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:12 devstack sudo[104126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b0c2f5c4-74b4-43f3-b31d-1c3746645815.1c117071-4de6-41b1-8565-5821c387fb91 Nov 02 10:22:12 devstack sudo[104126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:12 devstack sudo[104126]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:12 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-486b3835-fadc-4cd1-abd1-1e32419aac27 tempest-TestStampPattern-1570091031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b0c2f5c4-74b4-43f3-b31d-1c3746645815.1c117071-4de6-41b1-8565-5821c387fb91" returned: 0 in 0.249s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:12 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-486b3835-fadc-4cd1-abd1-1e32419aac27 tempest-TestStampPattern-1570091031 None] Lock "cinder-quobyte-1c117071-4de6-41b1-8565-5821c387fb91" released by "_delete_snapshot" :: held 1.581s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:22:12 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-486b3835-fadc-4cd1-abd1-1e32419aac27 tempest-TestStampPattern-1570091031 None] Lock "cinder-quobyte-b0c2f5c4-74b4-43f3-b31d-1c3746645815" released by "delete_snapshot" :: held 1.602s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:22:12 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-486b3835-fadc-4cd1-abd1-1e32419aac27 tempest-TestStampPattern-1570091031 None] Created reservations ['0e5ebe3e-71cd-49ba-9ad5-603aa4a1b122', '0cb3f0a5-0cca-4ac9-9d95-d9117aabc4ff', '9536bb01-b1f9-4b4e-92d4-fa04d0865e23', 'fdd058a2-55ad-42a0-805a-baf2737abb43'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:22:13 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-486b3835-fadc-4cd1-abd1-1e32419aac27 tempest-TestStampPattern-1570091031 None] Delete snapshot completed successfully. Nov 02 10:22:13 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-486b3835-fadc-4cd1-abd1-1e32419aac27 tempest-TestStampPattern-1570091031 None] Lock "cinder-1c117071-4de6-41b1-8565-5821c387fb91-delete_snapshot" released by "delete_snapshot" :: held 1.739s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:22:17 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-d9593877-b665-42c1-bf2d-c805fb30f1e1 tempest-TestStampPattern-1570091031 None] Acquiring lock "cinder-b0c2f5c4-74b4-43f3-b31d-1c3746645815-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:22:17 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-d9593877-b665-42c1-bf2d-c805fb30f1e1 tempest-TestStampPattern-1570091031 None] Lock "cinder-b0c2f5c4-74b4-43f3-b31d-1c3746645815-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:22:17 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-d9593877-b665-42c1-bf2d-c805fb30f1e1 tempest-TestStampPattern-1570091031 None] Acquiring lock "cinder-quobyte-b0c2f5c4-74b4-43f3-b31d-1c3746645815" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:22:17 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-d9593877-b665-42c1-bf2d-c805fb30f1e1 tempest-TestStampPattern-1570091031 None] Lock "cinder-quobyte-b0c2f5c4-74b4-43f3-b31d-1c3746645815" acquired by "delete_volume" :: waited 0.015s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:22:17 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[20bef516-9d46-40a1-89e8-06df42f1b7c7]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:22:17 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-d9593877-b665-42c1-bf2d-c805fb30f1e1 tempest-TestStampPattern-1570091031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b0c2f5c4-74b4-43f3-b31d-1c3746645815 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:17 devstack sudo[104169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b0c2f5c4-74b4-43f3-b31d-1c3746645815 Nov 02 10:22:17 devstack sudo[104169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:17 devstack sudo[104169]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:17 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-d9593877-b665-42c1-bf2d-c805fb30f1e1 tempest-TestStampPattern-1570091031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b0c2f5c4-74b4-43f3-b31d-1c3746645815" returned: 0 in 0.351s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:18 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-d9593877-b665-42c1-bf2d-c805fb30f1e1 tempest-TestStampPattern-1570091031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b0c2f5c4-74b4-43f3-b31d-1c3746645815 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:18 devstack sudo[104174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b0c2f5c4-74b4-43f3-b31d-1c3746645815 Nov 02 10:22:18 devstack sudo[104174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:18 devstack sudo[104174]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:18 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-d9593877-b665-42c1-bf2d-c805fb30f1e1 tempest-TestStampPattern-1570091031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b0c2f5c4-74b4-43f3-b31d-1c3746645815" returned: 0 in 0.245s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:18 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-d9593877-b665-42c1-bf2d-c805fb30f1e1 tempest-TestStampPattern-1570091031 None] Lock "cinder-quobyte-b0c2f5c4-74b4-43f3-b31d-1c3746645815" released by "delete_volume" :: held 0.664s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:22:18 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-d9593877-b665-42c1-bf2d-c805fb30f1e1 tempest-TestStampPattern-1570091031 None] Created reservations ['bdd2bc95-7f4c-41be-b3c4-a197750e03ac', '1e6f5ccf-ce96-47c6-a7fb-9e3a5163c2df', '42d7ac52-00d7-4ddb-b325-0ecd67015dd4', '7ff022cf-6fd4-43f5-866c-cc8932e4ffc4'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:22:18 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-d9593877-b665-42c1-bf2d-c805fb30f1e1 tempest-TestStampPattern-1570091031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:22:18 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-d9593877-b665-42c1-bf2d-c805fb30f1e1 tempest-TestStampPattern-1570091031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:22:18 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-d9593877-b665-42c1-bf2d-c805fb30f1e1 tempest-TestStampPattern-1570091031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:22:18 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-d9593877-b665-42c1-bf2d-c805fb30f1e1 tempest-TestStampPattern-1570091031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:22:18 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-d9593877-b665-42c1-bf2d-c805fb30f1e1 tempest-TestStampPattern-1570091031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:22:18 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-d9593877-b665-42c1-bf2d-c805fb30f1e1 tempest-TestStampPattern-1570091031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:18 devstack sudo[104178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:22:18 devstack sudo[104178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:18 devstack sudo[104178]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:18 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-d9593877-b665-42c1-bf2d-c805fb30f1e1 tempest-TestStampPattern-1570091031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.256s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:18 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-d9593877-b665-42c1-bf2d-c805fb30f1e1 tempest-TestStampPattern-1570091031 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:22:18 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-d9593877-b665-42c1-bf2d-c805fb30f1e1 tempest-TestStampPattern-1570091031 None] Deleted volume successfully. Nov 02 10:22:18 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-d9593877-b665-42c1-bf2d-c805fb30f1e1 tempest-TestStampPattern-1570091031 None] Lock "cinder-b0c2f5c4-74b4-43f3-b31d-1c3746645815-delete_volume" released by "delete_volume" :: held 1.138s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:22:28 devstack cinder-volume[86890]: DEBUG dbcounter [-] [86890] Writing DB stats cinder:SELECT=23,cinder:UPDATE=24,cinder:INSERT=5 {{(pid=86890) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:22:28 devstack cinder-volume[86890]: DEBUG dbcounter [-] [86890] Writing DB stats cinder:SELECT=23,cinder:UPDATE=22,cinder:INSERT=7,cinder:DELETE=2 {{(pid=86890) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:22:30 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-7549920c-fe1b-4152-84ee-34299b7dba06 tempest-CreateVolumesFromImageTest-1070498256 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:22:30 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-7549920c-fe1b-4152-84ee-34299b7dba06 tempest-CreateVolumesFromImageTest-1070498256 None] Flow 'volume_create_manager' (6873e945-8ee9-4964-b373-6bd99c9e98a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:22:30 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-7549920c-fe1b-4152-84ee-34299b7dba06 tempest-CreateVolumesFromImageTest-1070498256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9f335c5-d90e-48a2-8e8d-c14919afb23f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:30 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-7549920c-fe1b-4152-84ee-34299b7dba06 tempest-CreateVolumesFromImageTest-1070498256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9f335c5-d90e-48a2-8e8d-c14919afb23f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:22:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1831216988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0a3e0f4-a5e2-4b6c-b025-697ab174713d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='645bdb12f43e4cac851f4ef75d0e0de3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:22:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:22:30Z,use_quota=True,user_id='268375d5ee60495f9dd3821b42724ca3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:30 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-7549920c-fe1b-4152-84ee-34299b7dba06 tempest-CreateVolumesFromImageTest-1070498256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e16fcae-5471-4c9f-98ba-63e4f750253c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:30 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-7549920c-fe1b-4152-84ee-34299b7dba06 tempest-CreateVolumesFromImageTest-1070498256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e16fcae-5471-4c9f-98ba-63e4f750253c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:30 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-7549920c-fe1b-4152-84ee-34299b7dba06 tempest-CreateVolumesFromImageTest-1070498256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8488878f-5dd6-405a-a25e-d1fa2cccb959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:30 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-7549920c-fe1b-4152-84ee-34299b7dba06 tempest-CreateVolumesFromImageTest-1070498256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8488878f-5dd6-405a-a25e-d1fa2cccb959) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0a3e0f4-a5e2-4b6c-b025-697ab174713d', 'volume_name': 'volume-c0a3e0f4-a5e2-4b6c-b025-697ab174713d', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:30 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-7549920c-fe1b-4152-84ee-34299b7dba06 tempest-CreateVolumesFromImageTest-1070498256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0eefe34-5b00-473b-810c-8c5855220161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:30 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-7549920c-fe1b-4152-84ee-34299b7dba06 tempest-CreateVolumesFromImageTest-1070498256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0eefe34-5b00-473b-810c-8c5855220161) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:30 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-7549920c-fe1b-4152-84ee-34299b7dba06 tempest-CreateVolumesFromImageTest-1070498256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bab35db-b49e-4d88-987e-cd94f935a50d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:30 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-7549920c-fe1b-4152-84ee-34299b7dba06 tempest-CreateVolumesFromImageTest-1070498256 None] Volume c0a3e0f4-a5e2-4b6c-b025-697ab174713d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0a3e0f4-a5e2-4b6c-b025-697ab174713d', 'volume_size': 1} Nov 02 10:22:30 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-7549920c-fe1b-4152-84ee-34299b7dba06 tempest-CreateVolumesFromImageTest-1070498256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:22:30 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-7549920c-fe1b-4152-84ee-34299b7dba06 tempest-CreateVolumesFromImageTest-1070498256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:22:30 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-7549920c-fe1b-4152-84ee-34299b7dba06 tempest-CreateVolumesFromImageTest-1070498256 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:22:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1831216988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0a3e0f4-a5e2-4b6c-b025-697ab174713d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='645bdb12f43e4cac851f4ef75d0e0de3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:22:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:22:30Z,use_quota=True,user_id='268375d5ee60495f9dd3821b42724ca3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:22:30 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-7549920c-fe1b-4152-84ee-34299b7dba06 tempest-CreateVolumesFromImageTest-1070498256 None] Creating volume c0a3e0f4-a5e2-4b6c-b025-697ab174713d {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:22:30 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-7549920c-fe1b-4152-84ee-34299b7dba06 tempest-CreateVolumesFromImageTest-1070498256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:22:30 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-7549920c-fe1b-4152-84ee-34299b7dba06 tempest-CreateVolumesFromImageTest-1070498256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:22:30 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-7549920c-fe1b-4152-84ee-34299b7dba06 tempest-CreateVolumesFromImageTest-1070498256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:22:30 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-7549920c-fe1b-4152-84ee-34299b7dba06 tempest-CreateVolumesFromImageTest-1070498256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:22:30 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-7549920c-fe1b-4152-84ee-34299b7dba06 tempest-CreateVolumesFromImageTest-1070498256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:22:30 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-7549920c-fe1b-4152-84ee-34299b7dba06 tempest-CreateVolumesFromImageTest-1070498256 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:22:30 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-7549920c-fe1b-4152-84ee-34299b7dba06 tempest-CreateVolumesFromImageTest-1070498256 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:22:30 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-7549920c-fe1b-4152-84ee-34299b7dba06 tempest-CreateVolumesFromImageTest-1070498256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-c0a3e0f4-a5e2-4b6c-b025-697ab174713d 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:30 devstack sudo[104222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-c0a3e0f4-a5e2-4b6c-b025-697ab174713d 1073741824 Nov 02 10:22:30 devstack sudo[104222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:30 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cb9f427-98e0-4166-bf67-a3eb2619dded tempest-CreateVolumesFromImageTest-1070498256 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:22:30 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-7cb9f427-98e0-4166-bf67-a3eb2619dded tempest-CreateVolumesFromImageTest-1070498256 None] Flow 'volume_create_manager' (58b0ebaa-c666-4594-8e21-41de1f87c3a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:22:30 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-7cb9f427-98e0-4166-bf67-a3eb2619dded tempest-CreateVolumesFromImageTest-1070498256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f47743a-ec3a-4a73-b97b-573d4979c4c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:30 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-7cb9f427-98e0-4166-bf67-a3eb2619dded tempest-CreateVolumesFromImageTest-1070498256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f47743a-ec3a-4a73-b97b-573d4979c4c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:22:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1294977464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3076d13-4038-46ed-b181-e06ffcaff3cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='645bdb12f43e4cac851f4ef75d0e0de3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:22:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:22:31Z,use_quota=True,user_id='268375d5ee60495f9dd3821b42724ca3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:30 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-7cb9f427-98e0-4166-bf67-a3eb2619dded tempest-CreateVolumesFromImageTest-1070498256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f405a23a-ec96-4871-bf32-5a332a871f2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:30 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-7cb9f427-98e0-4166-bf67-a3eb2619dded tempest-CreateVolumesFromImageTest-1070498256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f405a23a-ec96-4871-bf32-5a332a871f2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:30 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-7cb9f427-98e0-4166-bf67-a3eb2619dded tempest-CreateVolumesFromImageTest-1070498256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cc6aad9-ca35-44fd-8508-63eb3d8f8ac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:30 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-7cb9f427-98e0-4166-bf67-a3eb2619dded tempest-CreateVolumesFromImageTest-1070498256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cc6aad9-ca35-44fd-8508-63eb3d8f8ac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3076d13-4038-46ed-b181-e06ffcaff3cc', 'volume_name': 'volume-b3076d13-4038-46ed-b181-e06ffcaff3cc', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:30 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-7cb9f427-98e0-4166-bf67-a3eb2619dded tempest-CreateVolumesFromImageTest-1070498256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e7058ae-f104-4856-85ea-3742914097d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:30 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-7cb9f427-98e0-4166-bf67-a3eb2619dded tempest-CreateVolumesFromImageTest-1070498256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e7058ae-f104-4856-85ea-3742914097d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:30 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-7cb9f427-98e0-4166-bf67-a3eb2619dded tempest-CreateVolumesFromImageTest-1070498256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69081aac-42eb-4dda-b69e-80d9c06a2569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:30 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-7cb9f427-98e0-4166-bf67-a3eb2619dded tempest-CreateVolumesFromImageTest-1070498256 None] Volume b3076d13-4038-46ed-b181-e06ffcaff3cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3076d13-4038-46ed-b181-e06ffcaff3cc', 'volume_size': 1} Nov 02 10:22:30 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-7cb9f427-98e0-4166-bf67-a3eb2619dded tempest-CreateVolumesFromImageTest-1070498256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:22:31 devstack sudo[104222]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:31 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-7549920c-fe1b-4152-84ee-34299b7dba06 tempest-CreateVolumesFromImageTest-1070498256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-c0a3e0f4-a5e2-4b6c-b025-697ab174713d 1073741824" returned: 0 in 0.498s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:31 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-7549920c-fe1b-4152-84ee-34299b7dba06 tempest-CreateVolumesFromImageTest-1070498256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-c0a3e0f4-a5e2-4b6c-b025-697ab174713d {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:31 devstack sudo[104228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-c0a3e0f4-a5e2-4b6c-b025-697ab174713d Nov 02 10:22:31 devstack sudo[104228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:31 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-870d3587-2eb4-44dc-9822-9c85dbe46dc6 tempest-CreateVolumesFromImageTest-1070498256 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:22:31 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-870d3587-2eb4-44dc-9822-9c85dbe46dc6 tempest-CreateVolumesFromImageTest-1070498256 None] Flow 'volume_create_manager' (8172798e-25a2-4e4d-b8da-61fc4aa81428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:22:31 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-870d3587-2eb4-44dc-9822-9c85dbe46dc6 tempest-CreateVolumesFromImageTest-1070498256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (361091dc-510c-473c-a676-666d69f76491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:31 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-870d3587-2eb4-44dc-9822-9c85dbe46dc6 tempest-CreateVolumesFromImageTest-1070498256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (361091dc-510c-473c-a676-666d69f76491) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:22:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-734773798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4464650b-e353-44cf-831c-e814157991f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='645bdb12f43e4cac851f4ef75d0e0de3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:22:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:22:31Z,use_quota=True,user_id='268375d5ee60495f9dd3821b42724ca3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:31 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-870d3587-2eb4-44dc-9822-9c85dbe46dc6 tempest-CreateVolumesFromImageTest-1070498256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (176d5478-c4e2-4141-abcb-90e769f9257b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:31 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-870d3587-2eb4-44dc-9822-9c85dbe46dc6 tempest-CreateVolumesFromImageTest-1070498256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (176d5478-c4e2-4141-abcb-90e769f9257b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:31 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-870d3587-2eb4-44dc-9822-9c85dbe46dc6 tempest-CreateVolumesFromImageTest-1070498256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c9c7800-a015-474e-aa27-a0e6876570b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:31 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-870d3587-2eb4-44dc-9822-9c85dbe46dc6 tempest-CreateVolumesFromImageTest-1070498256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c9c7800-a015-474e-aa27-a0e6876570b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4464650b-e353-44cf-831c-e814157991f5', 'volume_name': 'volume-4464650b-e353-44cf-831c-e814157991f5', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:31 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-870d3587-2eb4-44dc-9822-9c85dbe46dc6 tempest-CreateVolumesFromImageTest-1070498256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b42b5085-7458-461d-8acf-8fb27c2725cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:31 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-870d3587-2eb4-44dc-9822-9c85dbe46dc6 tempest-CreateVolumesFromImageTest-1070498256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b42b5085-7458-461d-8acf-8fb27c2725cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:31 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-870d3587-2eb4-44dc-9822-9c85dbe46dc6 tempest-CreateVolumesFromImageTest-1070498256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4e8eb74-5f94-4fa4-92bb-e91f03a38595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:31 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-870d3587-2eb4-44dc-9822-9c85dbe46dc6 tempest-CreateVolumesFromImageTest-1070498256 None] Volume 4464650b-e353-44cf-831c-e814157991f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4464650b-e353-44cf-831c-e814157991f5', 'volume_size': 1} Nov 02 10:22:31 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-870d3587-2eb4-44dc-9822-9c85dbe46dc6 tempest-CreateVolumesFromImageTest-1070498256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:22:31 devstack sudo[104228]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:31 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-7549920c-fe1b-4152-84ee-34299b7dba06 tempest-CreateVolumesFromImageTest-1070498256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-c0a3e0f4-a5e2-4b6c-b025-697ab174713d" returned: 0 in 0.289s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:31 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-7549920c-fe1b-4152-84ee-34299b7dba06 tempest-CreateVolumesFromImageTest-1070498256 None] <== create_volume: return (844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:22:31 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-7549920c-fe1b-4152-84ee-34299b7dba06 tempest-CreateVolumesFromImageTest-1070498256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.847s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:22:31 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-7cb9f427-98e0-4166-bf67-a3eb2619dded tempest-CreateVolumesFromImageTest-1070498256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.457s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:22:31 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-7cb9f427-98e0-4166-bf67-a3eb2619dded tempest-CreateVolumesFromImageTest-1070498256 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:22:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1294977464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3076d13-4038-46ed-b181-e06ffcaff3cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='645bdb12f43e4cac851f4ef75d0e0de3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:22:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:22:31Z,use_quota=True,user_id='268375d5ee60495f9dd3821b42724ca3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:22:31 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-7cb9f427-98e0-4166-bf67-a3eb2619dded tempest-CreateVolumesFromImageTest-1070498256 None] Creating volume b3076d13-4038-46ed-b181-e06ffcaff3cc {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:22:31 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-7cb9f427-98e0-4166-bf67-a3eb2619dded tempest-CreateVolumesFromImageTest-1070498256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:22:31 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-7cb9f427-98e0-4166-bf67-a3eb2619dded tempest-CreateVolumesFromImageTest-1070498256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:22:31 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-7cb9f427-98e0-4166-bf67-a3eb2619dded tempest-CreateVolumesFromImageTest-1070498256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:22:31 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-7cb9f427-98e0-4166-bf67-a3eb2619dded tempest-CreateVolumesFromImageTest-1070498256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:22:31 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-7cb9f427-98e0-4166-bf67-a3eb2619dded tempest-CreateVolumesFromImageTest-1070498256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:22:31 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-7cb9f427-98e0-4166-bf67-a3eb2619dded tempest-CreateVolumesFromImageTest-1070498256 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:22:31 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-7cb9f427-98e0-4166-bf67-a3eb2619dded tempest-CreateVolumesFromImageTest-1070498256 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:22:31 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-7cb9f427-98e0-4166-bf67-a3eb2619dded tempest-CreateVolumesFromImageTest-1070498256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b3076d13-4038-46ed-b181-e06ffcaff3cc 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:31 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-7549920c-fe1b-4152-84ee-34299b7dba06 tempest-CreateVolumesFromImageTest-1070498256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bab35db-b49e-4d88-987e-cd94f935a50d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0a3e0f4-a5e2-4b6c-b025-697ab174713d', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:31 devstack sudo[104231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b3076d13-4038-46ed-b181-e06ffcaff3cc 1073741824 Nov 02 10:22:31 devstack sudo[104231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:31 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-7549920c-fe1b-4152-84ee-34299b7dba06 tempest-CreateVolumesFromImageTest-1070498256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (750ba9e1-d623-405e-b49a-6a3a91b665ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:31 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-7549920c-fe1b-4152-84ee-34299b7dba06 tempest-CreateVolumesFromImageTest-1070498256 None] Volume volume-c0a3e0f4-a5e2-4b6c-b025-697ab174713d (c0a3e0f4-a5e2-4b6c-b025-697ab174713d): created successfully Nov 02 10:22:31 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-7549920c-fe1b-4152-84ee-34299b7dba06 tempest-CreateVolumesFromImageTest-1070498256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (750ba9e1-d623-405e-b49a-6a3a91b665ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:31 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-7549920c-fe1b-4152-84ee-34299b7dba06 tempest-CreateVolumesFromImageTest-1070498256 None] Flow 'volume_create_manager' (6873e945-8ee9-4964-b373-6bd99c9e98a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:22:31 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-7549920c-fe1b-4152-84ee-34299b7dba06 tempest-CreateVolumesFromImageTest-1070498256 None] Created volume successfully. Nov 02 10:22:31 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-85e3f670-a3cf-4ea9-b056-025b2dddfa52 tempest-CreateVolumesFromImageTest-1070498256 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:22:31 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-85e3f670-a3cf-4ea9-b056-025b2dddfa52 tempest-CreateVolumesFromImageTest-1070498256 None] Flow 'volume_create_manager' (d0902e79-25a8-45c7-ad3e-ca7cbc2cd837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:22:31 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-85e3f670-a3cf-4ea9-b056-025b2dddfa52 tempest-CreateVolumesFromImageTest-1070498256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdb2f057-64be-49c7-b02f-41435cafc617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:31 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-85e3f670-a3cf-4ea9-b056-025b2dddfa52 tempest-CreateVolumesFromImageTest-1070498256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdb2f057-64be-49c7-b02f-41435cafc617) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:22:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2095815996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa3d2d7e-93c9-4d78-b74a-3cab2fd89c1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='645bdb12f43e4cac851f4ef75d0e0de3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:22:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:22:32Z,use_quota=True,user_id='268375d5ee60495f9dd3821b42724ca3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:31 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-85e3f670-a3cf-4ea9-b056-025b2dddfa52 tempest-CreateVolumesFromImageTest-1070498256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (726cb07d-cfa2-45f3-bccd-49ca07f10e2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:31 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-85e3f670-a3cf-4ea9-b056-025b2dddfa52 tempest-CreateVolumesFromImageTest-1070498256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (726cb07d-cfa2-45f3-bccd-49ca07f10e2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:31 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-85e3f670-a3cf-4ea9-b056-025b2dddfa52 tempest-CreateVolumesFromImageTest-1070498256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2991dbfc-220c-4bbd-a4da-8240e87f0143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:31 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-85e3f670-a3cf-4ea9-b056-025b2dddfa52 tempest-CreateVolumesFromImageTest-1070498256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2991dbfc-220c-4bbd-a4da-8240e87f0143) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa3d2d7e-93c9-4d78-b74a-3cab2fd89c1f', 'volume_name': 'volume-fa3d2d7e-93c9-4d78-b74a-3cab2fd89c1f', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:31 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-85e3f670-a3cf-4ea9-b056-025b2dddfa52 tempest-CreateVolumesFromImageTest-1070498256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb58f355-b9b8-4a47-95df-ed65807e13c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:31 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-85e3f670-a3cf-4ea9-b056-025b2dddfa52 tempest-CreateVolumesFromImageTest-1070498256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb58f355-b9b8-4a47-95df-ed65807e13c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:31 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-85e3f670-a3cf-4ea9-b056-025b2dddfa52 tempest-CreateVolumesFromImageTest-1070498256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ba371fe-3cc2-4385-b99a-fd60525b9cd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:31 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-85e3f670-a3cf-4ea9-b056-025b2dddfa52 tempest-CreateVolumesFromImageTest-1070498256 None] Volume fa3d2d7e-93c9-4d78-b74a-3cab2fd89c1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa3d2d7e-93c9-4d78-b74a-3cab2fd89c1f', 'volume_size': 1} Nov 02 10:22:31 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-85e3f670-a3cf-4ea9-b056-025b2dddfa52 tempest-CreateVolumesFromImageTest-1070498256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:22:31 devstack sudo[104231]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:31 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-7cb9f427-98e0-4166-bf67-a3eb2619dded tempest-CreateVolumesFromImageTest-1070498256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b3076d13-4038-46ed-b181-e06ffcaff3cc 1073741824" returned: 0 in 0.538s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:31 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-7cb9f427-98e0-4166-bf67-a3eb2619dded tempest-CreateVolumesFromImageTest-1070498256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b3076d13-4038-46ed-b181-e06ffcaff3cc {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:31 devstack sudo[104237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b3076d13-4038-46ed-b181-e06ffcaff3cc Nov 02 10:22:31 devstack sudo[104237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:32 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-4bcc1611-4249-430e-8b3d-367a584ae8cf tempest-CreateVolumesFromImageTest-1070498256 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:22:32 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-4bcc1611-4249-430e-8b3d-367a584ae8cf tempest-CreateVolumesFromImageTest-1070498256 None] Flow 'volume_create_manager' (042ece63-1755-4706-a2c6-fed10aaa28a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:22:32 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-4bcc1611-4249-430e-8b3d-367a584ae8cf tempest-CreateVolumesFromImageTest-1070498256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83f4c1dd-122a-484d-852d-67ea9308cb1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:32 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-4bcc1611-4249-430e-8b3d-367a584ae8cf tempest-CreateVolumesFromImageTest-1070498256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83f4c1dd-122a-484d-852d-67ea9308cb1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:22:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1791616157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d2ecf2f-f796-4aa0-9e95-934f8f6abb87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='645bdb12f43e4cac851f4ef75d0e0de3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:22:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:22:32Z,use_quota=True,user_id='268375d5ee60495f9dd3821b42724ca3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:32 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-4bcc1611-4249-430e-8b3d-367a584ae8cf tempest-CreateVolumesFromImageTest-1070498256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc9e3061-7fa7-47a1-8a2a-13db7fda1600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:32 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-4bcc1611-4249-430e-8b3d-367a584ae8cf tempest-CreateVolumesFromImageTest-1070498256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc9e3061-7fa7-47a1-8a2a-13db7fda1600) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:32 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-4bcc1611-4249-430e-8b3d-367a584ae8cf tempest-CreateVolumesFromImageTest-1070498256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e73141e-63a9-489f-a9cc-d5cc82a7e88e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:32 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-4bcc1611-4249-430e-8b3d-367a584ae8cf tempest-CreateVolumesFromImageTest-1070498256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e73141e-63a9-489f-a9cc-d5cc82a7e88e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d2ecf2f-f796-4aa0-9e95-934f8f6abb87', 'volume_name': 'volume-6d2ecf2f-f796-4aa0-9e95-934f8f6abb87', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:32 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-4bcc1611-4249-430e-8b3d-367a584ae8cf tempest-CreateVolumesFromImageTest-1070498256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45011158-1303-4359-b117-d1c4373ac30c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:32 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-4bcc1611-4249-430e-8b3d-367a584ae8cf tempest-CreateVolumesFromImageTest-1070498256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45011158-1303-4359-b117-d1c4373ac30c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:32 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-4bcc1611-4249-430e-8b3d-367a584ae8cf tempest-CreateVolumesFromImageTest-1070498256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4329b0e-bcfd-4736-9b61-ef31b2391b06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:32 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-4bcc1611-4249-430e-8b3d-367a584ae8cf tempest-CreateVolumesFromImageTest-1070498256 None] Volume 6d2ecf2f-f796-4aa0-9e95-934f8f6abb87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d2ecf2f-f796-4aa0-9e95-934f8f6abb87', 'volume_size': 1} Nov 02 10:22:32 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-4bcc1611-4249-430e-8b3d-367a584ae8cf tempest-CreateVolumesFromImageTest-1070498256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:22:32 devstack sudo[104237]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:32 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-7cb9f427-98e0-4166-bf67-a3eb2619dded tempest-CreateVolumesFromImageTest-1070498256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b3076d13-4038-46ed-b181-e06ffcaff3cc" returned: 0 in 0.266s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:32 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-7cb9f427-98e0-4166-bf67-a3eb2619dded tempest-CreateVolumesFromImageTest-1070498256 None] <== create_volume: return (850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:22:32 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-7cb9f427-98e0-4166-bf67-a3eb2619dded tempest-CreateVolumesFromImageTest-1070498256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.854s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:22:32 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-870d3587-2eb4-44dc-9822-9c85dbe46dc6 tempest-CreateVolumesFromImageTest-1070498256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.888s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:22:32 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-870d3587-2eb4-44dc-9822-9c85dbe46dc6 tempest-CreateVolumesFromImageTest-1070498256 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:22:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-734773798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4464650b-e353-44cf-831c-e814157991f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='645bdb12f43e4cac851f4ef75d0e0de3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:22:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:22:31Z,use_quota=True,user_id='268375d5ee60495f9dd3821b42724ca3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:22:32 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-870d3587-2eb4-44dc-9822-9c85dbe46dc6 tempest-CreateVolumesFromImageTest-1070498256 None] Creating volume 4464650b-e353-44cf-831c-e814157991f5 {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:22:32 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-870d3587-2eb4-44dc-9822-9c85dbe46dc6 tempest-CreateVolumesFromImageTest-1070498256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:22:32 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-870d3587-2eb4-44dc-9822-9c85dbe46dc6 tempest-CreateVolumesFromImageTest-1070498256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:22:32 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-870d3587-2eb4-44dc-9822-9c85dbe46dc6 tempest-CreateVolumesFromImageTest-1070498256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:22:32 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-870d3587-2eb4-44dc-9822-9c85dbe46dc6 tempest-CreateVolumesFromImageTest-1070498256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:22:32 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-870d3587-2eb4-44dc-9822-9c85dbe46dc6 tempest-CreateVolumesFromImageTest-1070498256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:22:32 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-870d3587-2eb4-44dc-9822-9c85dbe46dc6 tempest-CreateVolumesFromImageTest-1070498256 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:22:32 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-870d3587-2eb4-44dc-9822-9c85dbe46dc6 tempest-CreateVolumesFromImageTest-1070498256 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:22:32 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-870d3587-2eb4-44dc-9822-9c85dbe46dc6 tempest-CreateVolumesFromImageTest-1070498256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-4464650b-e353-44cf-831c-e814157991f5 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:32 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-7cb9f427-98e0-4166-bf67-a3eb2619dded tempest-CreateVolumesFromImageTest-1070498256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69081aac-42eb-4dda-b69e-80d9c06a2569) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3076d13-4038-46ed-b181-e06ffcaff3cc', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:32 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-7cb9f427-98e0-4166-bf67-a3eb2619dded tempest-CreateVolumesFromImageTest-1070498256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7df6988a-d8d1-4dd5-84a1-649eba8c39a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:32 devstack sudo[104240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-4464650b-e353-44cf-831c-e814157991f5 1073741824 Nov 02 10:22:32 devstack sudo[104240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:32 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-7cb9f427-98e0-4166-bf67-a3eb2619dded tempest-CreateVolumesFromImageTest-1070498256 None] Volume volume-b3076d13-4038-46ed-b181-e06ffcaff3cc (b3076d13-4038-46ed-b181-e06ffcaff3cc): created successfully Nov 02 10:22:32 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-7cb9f427-98e0-4166-bf67-a3eb2619dded tempest-CreateVolumesFromImageTest-1070498256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7df6988a-d8d1-4dd5-84a1-649eba8c39a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:32 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-7cb9f427-98e0-4166-bf67-a3eb2619dded tempest-CreateVolumesFromImageTest-1070498256 None] Flow 'volume_create_manager' (58b0ebaa-c666-4594-8e21-41de1f87c3a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:22:32 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-7cb9f427-98e0-4166-bf67-a3eb2619dded tempest-CreateVolumesFromImageTest-1070498256 None] Created volume successfully. Nov 02 10:22:32 devstack sudo[104240]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:32 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-870d3587-2eb4-44dc-9822-9c85dbe46dc6 tempest-CreateVolumesFromImageTest-1070498256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-4464650b-e353-44cf-831c-e814157991f5 1073741824" returned: 0 in 0.440s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:32 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-870d3587-2eb4-44dc-9822-9c85dbe46dc6 tempest-CreateVolumesFromImageTest-1070498256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-4464650b-e353-44cf-831c-e814157991f5 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:32 devstack sudo[104246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-4464650b-e353-44cf-831c-e814157991f5 Nov 02 10:22:32 devstack sudo[104246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:32 devstack sudo[104246]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:32 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-870d3587-2eb4-44dc-9822-9c85dbe46dc6 tempest-CreateVolumesFromImageTest-1070498256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-4464650b-e353-44cf-831c-e814157991f5" returned: 0 in 0.227s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:32 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-870d3587-2eb4-44dc-9822-9c85dbe46dc6 tempest-CreateVolumesFromImageTest-1070498256 None] <== create_volume: return (704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:22:32 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-870d3587-2eb4-44dc-9822-9c85dbe46dc6 tempest-CreateVolumesFromImageTest-1070498256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.707s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:22:32 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-85e3f670-a3cf-4ea9-b056-025b2dddfa52 tempest-CreateVolumesFromImageTest-1070498256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.131s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:22:32 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-85e3f670-a3cf-4ea9-b056-025b2dddfa52 tempest-CreateVolumesFromImageTest-1070498256 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:22:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2095815996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa3d2d7e-93c9-4d78-b74a-3cab2fd89c1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='645bdb12f43e4cac851f4ef75d0e0de3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:22:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:22:32Z,use_quota=True,user_id='268375d5ee60495f9dd3821b42724ca3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:22:32 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-85e3f670-a3cf-4ea9-b056-025b2dddfa52 tempest-CreateVolumesFromImageTest-1070498256 None] Creating volume fa3d2d7e-93c9-4d78-b74a-3cab2fd89c1f {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:22:32 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-85e3f670-a3cf-4ea9-b056-025b2dddfa52 tempest-CreateVolumesFromImageTest-1070498256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:22:32 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-85e3f670-a3cf-4ea9-b056-025b2dddfa52 tempest-CreateVolumesFromImageTest-1070498256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:22:32 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-85e3f670-a3cf-4ea9-b056-025b2dddfa52 tempest-CreateVolumesFromImageTest-1070498256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:22:32 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-85e3f670-a3cf-4ea9-b056-025b2dddfa52 tempest-CreateVolumesFromImageTest-1070498256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:22:32 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-85e3f670-a3cf-4ea9-b056-025b2dddfa52 tempest-CreateVolumesFromImageTest-1070498256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:22:32 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-85e3f670-a3cf-4ea9-b056-025b2dddfa52 tempest-CreateVolumesFromImageTest-1070498256 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:22:32 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-85e3f670-a3cf-4ea9-b056-025b2dddfa52 tempest-CreateVolumesFromImageTest-1070498256 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:22:32 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-85e3f670-a3cf-4ea9-b056-025b2dddfa52 tempest-CreateVolumesFromImageTest-1070498256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-fa3d2d7e-93c9-4d78-b74a-3cab2fd89c1f 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:32 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-870d3587-2eb4-44dc-9822-9c85dbe46dc6 tempest-CreateVolumesFromImageTest-1070498256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4e8eb74-5f94-4fa4-92bb-e91f03a38595) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4464650b-e353-44cf-831c-e814157991f5', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:32 devstack sudo[104249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-fa3d2d7e-93c9-4d78-b74a-3cab2fd89c1f 1073741824 Nov 02 10:22:32 devstack sudo[104249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:32 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-870d3587-2eb4-44dc-9822-9c85dbe46dc6 tempest-CreateVolumesFromImageTest-1070498256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2803c1a4-d3e1-4dba-81d5-ea126d83f60b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:32 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-870d3587-2eb4-44dc-9822-9c85dbe46dc6 tempest-CreateVolumesFromImageTest-1070498256 None] Volume volume-4464650b-e353-44cf-831c-e814157991f5 (4464650b-e353-44cf-831c-e814157991f5): created successfully Nov 02 10:22:32 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-870d3587-2eb4-44dc-9822-9c85dbe46dc6 tempest-CreateVolumesFromImageTest-1070498256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2803c1a4-d3e1-4dba-81d5-ea126d83f60b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:32 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-870d3587-2eb4-44dc-9822-9c85dbe46dc6 tempest-CreateVolumesFromImageTest-1070498256 None] Flow 'volume_create_manager' (8172798e-25a2-4e4d-b8da-61fc4aa81428) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:22:33 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-870d3587-2eb4-44dc-9822-9c85dbe46dc6 tempest-CreateVolumesFromImageTest-1070498256 None] Created volume successfully. Nov 02 10:22:33 devstack sudo[104249]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:33 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-85e3f670-a3cf-4ea9-b056-025b2dddfa52 tempest-CreateVolumesFromImageTest-1070498256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-fa3d2d7e-93c9-4d78-b74a-3cab2fd89c1f 1073741824" returned: 0 in 0.426s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:33 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-85e3f670-a3cf-4ea9-b056-025b2dddfa52 tempest-CreateVolumesFromImageTest-1070498256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-fa3d2d7e-93c9-4d78-b74a-3cab2fd89c1f {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:33 devstack sudo[104255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-fa3d2d7e-93c9-4d78-b74a-3cab2fd89c1f Nov 02 10:22:33 devstack sudo[104255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:33 devstack sudo[104255]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:33 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-85e3f670-a3cf-4ea9-b056-025b2dddfa52 tempest-CreateVolumesFromImageTest-1070498256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-fa3d2d7e-93c9-4d78-b74a-3cab2fd89c1f" returned: 0 in 0.246s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:33 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-85e3f670-a3cf-4ea9-b056-025b2dddfa52 tempest-CreateVolumesFromImageTest-1070498256 None] <== create_volume: return (709ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:22:33 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-85e3f670-a3cf-4ea9-b056-025b2dddfa52 tempest-CreateVolumesFromImageTest-1070498256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.712s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:22:33 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-4bcc1611-4249-430e-8b3d-367a584ae8cf tempest-CreateVolumesFromImageTest-1070498256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.466s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:22:33 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-4bcc1611-4249-430e-8b3d-367a584ae8cf tempest-CreateVolumesFromImageTest-1070498256 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:22:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1791616157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d2ecf2f-f796-4aa0-9e95-934f8f6abb87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='645bdb12f43e4cac851f4ef75d0e0de3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:22:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:22:32Z,use_quota=True,user_id='268375d5ee60495f9dd3821b42724ca3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:22:33 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-4bcc1611-4249-430e-8b3d-367a584ae8cf tempest-CreateVolumesFromImageTest-1070498256 None] Creating volume 6d2ecf2f-f796-4aa0-9e95-934f8f6abb87 {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:22:33 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-4bcc1611-4249-430e-8b3d-367a584ae8cf tempest-CreateVolumesFromImageTest-1070498256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:22:33 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-4bcc1611-4249-430e-8b3d-367a584ae8cf tempest-CreateVolumesFromImageTest-1070498256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:22:33 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-4bcc1611-4249-430e-8b3d-367a584ae8cf tempest-CreateVolumesFromImageTest-1070498256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:22:33 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-4bcc1611-4249-430e-8b3d-367a584ae8cf tempest-CreateVolumesFromImageTest-1070498256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:22:33 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-4bcc1611-4249-430e-8b3d-367a584ae8cf tempest-CreateVolumesFromImageTest-1070498256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:22:33 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-4bcc1611-4249-430e-8b3d-367a584ae8cf tempest-CreateVolumesFromImageTest-1070498256 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:22:33 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-4bcc1611-4249-430e-8b3d-367a584ae8cf tempest-CreateVolumesFromImageTest-1070498256 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:22:33 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-4bcc1611-4249-430e-8b3d-367a584ae8cf tempest-CreateVolumesFromImageTest-1070498256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-6d2ecf2f-f796-4aa0-9e95-934f8f6abb87 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:33 devstack sudo[104258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-6d2ecf2f-f796-4aa0-9e95-934f8f6abb87 1073741824 Nov 02 10:22:33 devstack sudo[104258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:33 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-85e3f670-a3cf-4ea9-b056-025b2dddfa52 tempest-CreateVolumesFromImageTest-1070498256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ba371fe-3cc2-4385-b99a-fd60525b9cd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa3d2d7e-93c9-4d78-b74a-3cab2fd89c1f', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:33 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-85e3f670-a3cf-4ea9-b056-025b2dddfa52 tempest-CreateVolumesFromImageTest-1070498256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39853673-9c2b-4c60-8eb4-247c9d6e8497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:33 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-85e3f670-a3cf-4ea9-b056-025b2dddfa52 tempest-CreateVolumesFromImageTest-1070498256 None] Volume volume-fa3d2d7e-93c9-4d78-b74a-3cab2fd89c1f (fa3d2d7e-93c9-4d78-b74a-3cab2fd89c1f): created successfully Nov 02 10:22:33 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-85e3f670-a3cf-4ea9-b056-025b2dddfa52 tempest-CreateVolumesFromImageTest-1070498256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39853673-9c2b-4c60-8eb4-247c9d6e8497) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:33 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-85e3f670-a3cf-4ea9-b056-025b2dddfa52 tempest-CreateVolumesFromImageTest-1070498256 None] Flow 'volume_create_manager' (d0902e79-25a8-45c7-ad3e-ca7cbc2cd837) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:22:33 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-85e3f670-a3cf-4ea9-b056-025b2dddfa52 tempest-CreateVolumesFromImageTest-1070498256 None] Created volume successfully. Nov 02 10:22:34 devstack sudo[104258]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-4bcc1611-4249-430e-8b3d-367a584ae8cf tempest-CreateVolumesFromImageTest-1070498256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-6d2ecf2f-f796-4aa0-9e95-934f8f6abb87 1073741824" returned: 0 in 0.432s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-4bcc1611-4249-430e-8b3d-367a584ae8cf tempest-CreateVolumesFromImageTest-1070498256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-6d2ecf2f-f796-4aa0-9e95-934f8f6abb87 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:34 devstack sudo[104265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-6d2ecf2f-f796-4aa0-9e95-934f8f6abb87 Nov 02 10:22:34 devstack sudo[104265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:34 devstack sudo[104265]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-4bcc1611-4249-430e-8b3d-367a584ae8cf tempest-CreateVolumesFromImageTest-1070498256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-6d2ecf2f-f796-4aa0-9e95-934f8f6abb87" returned: 0 in 0.246s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:34 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-4bcc1611-4249-430e-8b3d-367a584ae8cf tempest-CreateVolumesFromImageTest-1070498256 None] <== create_volume: return (718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:22:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-4bcc1611-4249-430e-8b3d-367a584ae8cf tempest-CreateVolumesFromImageTest-1070498256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.721s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:22:34 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-4bcc1611-4249-430e-8b3d-367a584ae8cf tempest-CreateVolumesFromImageTest-1070498256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4329b0e-bcfd-4736-9b61-ef31b2391b06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d2ecf2f-f796-4aa0-9e95-934f8f6abb87', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:34 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-4bcc1611-4249-430e-8b3d-367a584ae8cf tempest-CreateVolumesFromImageTest-1070498256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b11729a-e681-4e3e-98b5-b874580172c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:34 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-4bcc1611-4249-430e-8b3d-367a584ae8cf tempest-CreateVolumesFromImageTest-1070498256 None] Volume volume-6d2ecf2f-f796-4aa0-9e95-934f8f6abb87 (6d2ecf2f-f796-4aa0-9e95-934f8f6abb87): created successfully Nov 02 10:22:34 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-4bcc1611-4249-430e-8b3d-367a584ae8cf tempest-CreateVolumesFromImageTest-1070498256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b11729a-e681-4e3e-98b5-b874580172c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:34 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-4bcc1611-4249-430e-8b3d-367a584ae8cf tempest-CreateVolumesFromImageTest-1070498256 None] Flow 'volume_create_manager' (042ece63-1755-4706-a2c6-fed10aaa28a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:22:34 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-4bcc1611-4249-430e-8b3d-367a584ae8cf tempest-CreateVolumesFromImageTest-1070498256 None] Created volume successfully. Nov 02 10:22:34 devstack cinder-volume[86890]: DEBUG oslo_service.periodic_task [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86890) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:22:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:22:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:22:34 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:22:34 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:22:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:22:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:34 devstack sudo[104268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:22:34 devstack sudo[104268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:35 devstack sudo[104268]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:35 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.259s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:35 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:22:35 devstack cinder-volume[86890]: DEBUG oslo_service.periodic_task [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Running periodic task VolumeManager._thread_info {{(pid=86890) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:22:35 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] thread count: 29 {{(pid=86890) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:22:35 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] thread info: [<_MainThread(MainThread, started 133913319395456)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86890) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:22:35 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-d861def8-c9be-4f86-9d5d-898140258ebc tempest-CreateVolumesFromImageTest-1070498256 None] Acquiring lock "cinder-6d2ecf2f-f796-4aa0-9e95-934f8f6abb87-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:22:35 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-d861def8-c9be-4f86-9d5d-898140258ebc tempest-CreateVolumesFromImageTest-1070498256 None] Lock "cinder-6d2ecf2f-f796-4aa0-9e95-934f8f6abb87-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:22:35 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-d861def8-c9be-4f86-9d5d-898140258ebc tempest-CreateVolumesFromImageTest-1070498256 None] Acquiring lock "cinder-quobyte-6d2ecf2f-f796-4aa0-9e95-934f8f6abb87" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:22:35 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-d861def8-c9be-4f86-9d5d-898140258ebc tempest-CreateVolumesFromImageTest-1070498256 None] Lock "cinder-quobyte-6d2ecf2f-f796-4aa0-9e95-934f8f6abb87" acquired by "delete_volume" :: waited 0.016s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:22:35 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[895ddc01-0259-4159-bca3-b80b8d3a6eba]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:22:35 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-d861def8-c9be-4f86-9d5d-898140258ebc tempest-CreateVolumesFromImageTest-1070498256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-6d2ecf2f-f796-4aa0-9e95-934f8f6abb87 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:35 devstack sudo[104271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-6d2ecf2f-f796-4aa0-9e95-934f8f6abb87 Nov 02 10:22:35 devstack sudo[104271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:35 devstack sudo[104271]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:35 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-d861def8-c9be-4f86-9d5d-898140258ebc tempest-CreateVolumesFromImageTest-1070498256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-6d2ecf2f-f796-4aa0-9e95-934f8f6abb87" returned: 0 in 0.378s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:35 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-d861def8-c9be-4f86-9d5d-898140258ebc tempest-CreateVolumesFromImageTest-1070498256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-6d2ecf2f-f796-4aa0-9e95-934f8f6abb87 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:35 devstack sudo[104276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-6d2ecf2f-f796-4aa0-9e95-934f8f6abb87 Nov 02 10:22:35 devstack sudo[104276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:36 devstack sudo[104276]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:36 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-d861def8-c9be-4f86-9d5d-898140258ebc tempest-CreateVolumesFromImageTest-1070498256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-6d2ecf2f-f796-4aa0-9e95-934f8f6abb87" returned: 0 in 0.306s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:36 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-d861def8-c9be-4f86-9d5d-898140258ebc tempest-CreateVolumesFromImageTest-1070498256 None] Lock "cinder-quobyte-6d2ecf2f-f796-4aa0-9e95-934f8f6abb87" released by "delete_volume" :: held 0.728s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:22:36 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-d861def8-c9be-4f86-9d5d-898140258ebc tempest-CreateVolumesFromImageTest-1070498256 None] Created reservations ['f2619092-536a-4108-93a8-66d004aa6302', '4f3ebb06-b29f-4d4c-add9-fb867a2eebb6', '4fb4a076-be1d-403b-b8ec-b80ae01610ba', 'f0b9b478-57d0-45ba-af9e-3628997af128'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:22:36 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-d861def8-c9be-4f86-9d5d-898140258ebc tempest-CreateVolumesFromImageTest-1070498256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:22:36 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-d861def8-c9be-4f86-9d5d-898140258ebc tempest-CreateVolumesFromImageTest-1070498256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:22:36 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-d861def8-c9be-4f86-9d5d-898140258ebc tempest-CreateVolumesFromImageTest-1070498256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:22:36 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-d861def8-c9be-4f86-9d5d-898140258ebc tempest-CreateVolumesFromImageTest-1070498256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:22:36 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-d861def8-c9be-4f86-9d5d-898140258ebc tempest-CreateVolumesFromImageTest-1070498256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:22:36 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-d861def8-c9be-4f86-9d5d-898140258ebc tempest-CreateVolumesFromImageTest-1070498256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:36 devstack sudo[104279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:22:36 devstack sudo[104279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:36 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-7e37d201-83e0-406d-a594-5c23a7a8cc9f tempest-CreateVolumesFromImageTest-1070498256 None] Acquiring lock "cinder-fa3d2d7e-93c9-4d78-b74a-3cab2fd89c1f-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:22:36 devstack sudo[104279]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:36 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-7e37d201-83e0-406d-a594-5c23a7a8cc9f tempest-CreateVolumesFromImageTest-1070498256 None] Lock "cinder-fa3d2d7e-93c9-4d78-b74a-3cab2fd89c1f-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:22:36 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-d861def8-c9be-4f86-9d5d-898140258ebc tempest-CreateVolumesFromImageTest-1070498256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.289s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:36 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-d861def8-c9be-4f86-9d5d-898140258ebc tempest-CreateVolumesFromImageTest-1070498256 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:22:36 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-d861def8-c9be-4f86-9d5d-898140258ebc tempest-CreateVolumesFromImageTest-1070498256 None] Deleted volume successfully. Nov 02 10:22:36 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-d861def8-c9be-4f86-9d5d-898140258ebc tempest-CreateVolumesFromImageTest-1070498256 None] Lock "cinder-6d2ecf2f-f796-4aa0-9e95-934f8f6abb87-delete_volume" released by "delete_volume" :: held 1.235s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:22:36 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-7e37d201-83e0-406d-a594-5c23a7a8cc9f tempest-CreateVolumesFromImageTest-1070498256 None] Acquiring lock "cinder-quobyte-fa3d2d7e-93c9-4d78-b74a-3cab2fd89c1f" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:22:36 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-7e37d201-83e0-406d-a594-5c23a7a8cc9f tempest-CreateVolumesFromImageTest-1070498256 None] Lock "cinder-quobyte-fa3d2d7e-93c9-4d78-b74a-3cab2fd89c1f" acquired by "delete_volume" :: waited 0.015s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:22:36 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[e240c08f-b69a-453a-be5f-d137aabb077e]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:22:36 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-7e37d201-83e0-406d-a594-5c23a7a8cc9f tempest-CreateVolumesFromImageTest-1070498256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-fa3d2d7e-93c9-4d78-b74a-3cab2fd89c1f {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:36 devstack sudo[104282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-fa3d2d7e-93c9-4d78-b74a-3cab2fd89c1f Nov 02 10:22:36 devstack sudo[104282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:37 devstack sudo[104282]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:37 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-7e37d201-83e0-406d-a594-5c23a7a8cc9f tempest-CreateVolumesFromImageTest-1070498256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-fa3d2d7e-93c9-4d78-b74a-3cab2fd89c1f" returned: 0 in 0.360s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:37 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-7e37d201-83e0-406d-a594-5c23a7a8cc9f tempest-CreateVolumesFromImageTest-1070498256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-fa3d2d7e-93c9-4d78-b74a-3cab2fd89c1f {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:37 devstack sudo[104287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-fa3d2d7e-93c9-4d78-b74a-3cab2fd89c1f Nov 02 10:22:37 devstack sudo[104287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:37 devstack sudo[104287]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:37 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-7e37d201-83e0-406d-a594-5c23a7a8cc9f tempest-CreateVolumesFromImageTest-1070498256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-fa3d2d7e-93c9-4d78-b74a-3cab2fd89c1f" returned: 0 in 0.254s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:37 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-7e37d201-83e0-406d-a594-5c23a7a8cc9f tempest-CreateVolumesFromImageTest-1070498256 None] Lock "cinder-quobyte-fa3d2d7e-93c9-4d78-b74a-3cab2fd89c1f" released by "delete_volume" :: held 0.658s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:22:37 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-7e37d201-83e0-406d-a594-5c23a7a8cc9f tempest-CreateVolumesFromImageTest-1070498256 None] Created reservations ['16648ab4-2be3-4e74-b941-719b0e6ead9c', '01201580-5eed-4279-acad-23097a122deb', '5cbc719f-25cb-4668-97c3-6f4e6f5642dd', '6abe6d89-9481-489d-abb3-1176623ea62c'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:22:37 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-7e37d201-83e0-406d-a594-5c23a7a8cc9f tempest-CreateVolumesFromImageTest-1070498256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:22:37 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-7e37d201-83e0-406d-a594-5c23a7a8cc9f tempest-CreateVolumesFromImageTest-1070498256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:22:37 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-7e37d201-83e0-406d-a594-5c23a7a8cc9f tempest-CreateVolumesFromImageTest-1070498256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:22:37 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-7e37d201-83e0-406d-a594-5c23a7a8cc9f tempest-CreateVolumesFromImageTest-1070498256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:22:37 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-7e37d201-83e0-406d-a594-5c23a7a8cc9f tempest-CreateVolumesFromImageTest-1070498256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:22:37 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-7e37d201-83e0-406d-a594-5c23a7a8cc9f tempest-CreateVolumesFromImageTest-1070498256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:37 devstack sudo[104290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:22:37 devstack sudo[104290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:37 devstack sudo[104290]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:37 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-7e37d201-83e0-406d-a594-5c23a7a8cc9f tempest-CreateVolumesFromImageTest-1070498256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.251s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:37 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-7e37d201-83e0-406d-a594-5c23a7a8cc9f tempest-CreateVolumesFromImageTest-1070498256 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:22:37 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-7e37d201-83e0-406d-a594-5c23a7a8cc9f tempest-CreateVolumesFromImageTest-1070498256 None] Deleted volume successfully. Nov 02 10:22:37 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-7e37d201-83e0-406d-a594-5c23a7a8cc9f tempest-CreateVolumesFromImageTest-1070498256 None] Lock "cinder-fa3d2d7e-93c9-4d78-b74a-3cab2fd89c1f-delete_volume" released by "delete_volume" :: held 1.141s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:22:37 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-220c2af0-b1a5-4c5f-9ce9-1eaaeff5e12a tempest-CreateVolumesFromImageTest-1070498256 None] Acquiring lock "cinder-4464650b-e353-44cf-831c-e814157991f5-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:22:37 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-220c2af0-b1a5-4c5f-9ce9-1eaaeff5e12a tempest-CreateVolumesFromImageTest-1070498256 None] Lock "cinder-4464650b-e353-44cf-831c-e814157991f5-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:22:37 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-220c2af0-b1a5-4c5f-9ce9-1eaaeff5e12a tempest-CreateVolumesFromImageTest-1070498256 None] Acquiring lock "cinder-quobyte-4464650b-e353-44cf-831c-e814157991f5" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:22:37 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-220c2af0-b1a5-4c5f-9ce9-1eaaeff5e12a tempest-CreateVolumesFromImageTest-1070498256 None] Lock "cinder-quobyte-4464650b-e353-44cf-831c-e814157991f5" acquired by "delete_volume" :: waited 0.015s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:22:37 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[4422111b-31cd-4031-ae41-f0f4b7c6d87c]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:22:37 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-220c2af0-b1a5-4c5f-9ce9-1eaaeff5e12a tempest-CreateVolumesFromImageTest-1070498256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-4464650b-e353-44cf-831c-e814157991f5 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:38 devstack sudo[104293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-4464650b-e353-44cf-831c-e814157991f5 Nov 02 10:22:38 devstack sudo[104293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:38 devstack sudo[104293]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:38 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-220c2af0-b1a5-4c5f-9ce9-1eaaeff5e12a tempest-CreateVolumesFromImageTest-1070498256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-4464650b-e353-44cf-831c-e814157991f5" returned: 0 in 0.366s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:38 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-220c2af0-b1a5-4c5f-9ce9-1eaaeff5e12a tempest-CreateVolumesFromImageTest-1070498256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-4464650b-e353-44cf-831c-e814157991f5 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:38 devstack sudo[104298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-4464650b-e353-44cf-831c-e814157991f5 Nov 02 10:22:38 devstack sudo[104298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:38 devstack sudo[104298]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:38 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-220c2af0-b1a5-4c5f-9ce9-1eaaeff5e12a tempest-CreateVolumesFromImageTest-1070498256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-4464650b-e353-44cf-831c-e814157991f5" returned: 0 in 0.240s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:38 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-220c2af0-b1a5-4c5f-9ce9-1eaaeff5e12a tempest-CreateVolumesFromImageTest-1070498256 None] Lock "cinder-quobyte-4464650b-e353-44cf-831c-e814157991f5" released by "delete_volume" :: held 0.647s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:22:38 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-220c2af0-b1a5-4c5f-9ce9-1eaaeff5e12a tempest-CreateVolumesFromImageTest-1070498256 None] Created reservations ['f60bb810-d3ac-423d-866b-d2fbc880178c', '15509483-8e34-4cd1-8e3e-6201a9738808', '869a1ac8-092b-4a66-b564-e336d5cb5af9', '23a7d20c-aa22-4d31-9e39-351234977d69'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:22:38 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-220c2af0-b1a5-4c5f-9ce9-1eaaeff5e12a tempest-CreateVolumesFromImageTest-1070498256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:22:38 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-220c2af0-b1a5-4c5f-9ce9-1eaaeff5e12a tempest-CreateVolumesFromImageTest-1070498256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:22:38 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-220c2af0-b1a5-4c5f-9ce9-1eaaeff5e12a tempest-CreateVolumesFromImageTest-1070498256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:22:38 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-220c2af0-b1a5-4c5f-9ce9-1eaaeff5e12a tempest-CreateVolumesFromImageTest-1070498256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:22:38 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-220c2af0-b1a5-4c5f-9ce9-1eaaeff5e12a tempest-CreateVolumesFromImageTest-1070498256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:22:38 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-220c2af0-b1a5-4c5f-9ce9-1eaaeff5e12a tempest-CreateVolumesFromImageTest-1070498256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:38 devstack sudo[104301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:22:38 devstack sudo[104301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:38 devstack sudo[104301]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:38 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-220c2af0-b1a5-4c5f-9ce9-1eaaeff5e12a tempest-CreateVolumesFromImageTest-1070498256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.237s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:38 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-220c2af0-b1a5-4c5f-9ce9-1eaaeff5e12a tempest-CreateVolumesFromImageTest-1070498256 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:22:38 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-220c2af0-b1a5-4c5f-9ce9-1eaaeff5e12a tempest-CreateVolumesFromImageTest-1070498256 None] Deleted volume successfully. Nov 02 10:22:38 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-220c2af0-b1a5-4c5f-9ce9-1eaaeff5e12a tempest-CreateVolumesFromImageTest-1070498256 None] Lock "cinder-4464650b-e353-44cf-831c-e814157991f5-delete_volume" released by "delete_volume" :: held 1.086s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:22:39 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-c629d81b-7df6-41ae-97a5-2b8c853dc4d3 tempest-CreateVolumesFromImageTest-1070498256 None] Acquiring lock "cinder-b3076d13-4038-46ed-b181-e06ffcaff3cc-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:22:39 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-c629d81b-7df6-41ae-97a5-2b8c853dc4d3 tempest-CreateVolumesFromImageTest-1070498256 None] Lock "cinder-b3076d13-4038-46ed-b181-e06ffcaff3cc-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:22:39 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-c629d81b-7df6-41ae-97a5-2b8c853dc4d3 tempest-CreateVolumesFromImageTest-1070498256 None] Acquiring lock "cinder-quobyte-b3076d13-4038-46ed-b181-e06ffcaff3cc" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:22:39 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-c629d81b-7df6-41ae-97a5-2b8c853dc4d3 tempest-CreateVolumesFromImageTest-1070498256 None] Lock "cinder-quobyte-b3076d13-4038-46ed-b181-e06ffcaff3cc" acquired by "delete_volume" :: waited 0.025s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:22:39 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eb548b6-38d1-46ef-a668-82980014dd85]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:22:39 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c629d81b-7df6-41ae-97a5-2b8c853dc4d3 tempest-CreateVolumesFromImageTest-1070498256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b3076d13-4038-46ed-b181-e06ffcaff3cc {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:39 devstack sudo[104304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b3076d13-4038-46ed-b181-e06ffcaff3cc Nov 02 10:22:39 devstack sudo[104304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:39 devstack sudo[104304]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:39 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c629d81b-7df6-41ae-97a5-2b8c853dc4d3 tempest-CreateVolumesFromImageTest-1070498256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b3076d13-4038-46ed-b181-e06ffcaff3cc" returned: 0 in 0.396s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:39 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c629d81b-7df6-41ae-97a5-2b8c853dc4d3 tempest-CreateVolumesFromImageTest-1070498256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b3076d13-4038-46ed-b181-e06ffcaff3cc {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:39 devstack sudo[104309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b3076d13-4038-46ed-b181-e06ffcaff3cc Nov 02 10:22:39 devstack sudo[104309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:39 devstack sudo[104309]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:39 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c629d81b-7df6-41ae-97a5-2b8c853dc4d3 tempest-CreateVolumesFromImageTest-1070498256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b3076d13-4038-46ed-b181-e06ffcaff3cc" returned: 0 in 0.243s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:39 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-c629d81b-7df6-41ae-97a5-2b8c853dc4d3 tempest-CreateVolumesFromImageTest-1070498256 None] Lock "cinder-quobyte-b3076d13-4038-46ed-b181-e06ffcaff3cc" released by "delete_volume" :: held 0.685s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:22:39 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-c629d81b-7df6-41ae-97a5-2b8c853dc4d3 tempest-CreateVolumesFromImageTest-1070498256 None] Created reservations ['06a584a8-cbd4-4f59-a796-39485d1094e0', '1d5aaed7-5a5b-49e7-a66a-4bbc08c7b827', '5db720c4-5519-406d-a0ca-3a071d691516', 'bb041ebc-19fb-4312-87e8-53f850fb802d'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:22:39 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c629d81b-7df6-41ae-97a5-2b8c853dc4d3 tempest-CreateVolumesFromImageTest-1070498256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:22:39 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c629d81b-7df6-41ae-97a5-2b8c853dc4d3 tempest-CreateVolumesFromImageTest-1070498256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:22:39 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c629d81b-7df6-41ae-97a5-2b8c853dc4d3 tempest-CreateVolumesFromImageTest-1070498256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:22:39 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c629d81b-7df6-41ae-97a5-2b8c853dc4d3 tempest-CreateVolumesFromImageTest-1070498256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:22:39 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c629d81b-7df6-41ae-97a5-2b8c853dc4d3 tempest-CreateVolumesFromImageTest-1070498256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:22:39 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c629d81b-7df6-41ae-97a5-2b8c853dc4d3 tempest-CreateVolumesFromImageTest-1070498256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:39 devstack sudo[104312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:22:39 devstack sudo[104312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:40 devstack sudo[104312]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:40 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c629d81b-7df6-41ae-97a5-2b8c853dc4d3 tempest-CreateVolumesFromImageTest-1070498256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.260s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:40 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-c629d81b-7df6-41ae-97a5-2b8c853dc4d3 tempest-CreateVolumesFromImageTest-1070498256 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:22:40 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-c629d81b-7df6-41ae-97a5-2b8c853dc4d3 tempest-CreateVolumesFromImageTest-1070498256 None] Deleted volume successfully. Nov 02 10:22:40 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-c629d81b-7df6-41ae-97a5-2b8c853dc4d3 tempest-CreateVolumesFromImageTest-1070498256 None] Lock "cinder-b3076d13-4038-46ed-b181-e06ffcaff3cc-delete_volume" released by "delete_volume" :: held 1.159s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:22:40 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-ca336670-7f5f-467d-bdaf-1a3af652c74c tempest-CreateVolumesFromImageTest-1070498256 None] Acquiring lock "cinder-c0a3e0f4-a5e2-4b6c-b025-697ab174713d-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:22:40 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-ca336670-7f5f-467d-bdaf-1a3af652c74c tempest-CreateVolumesFromImageTest-1070498256 None] Lock "cinder-c0a3e0f4-a5e2-4b6c-b025-697ab174713d-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:22:40 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-ca336670-7f5f-467d-bdaf-1a3af652c74c tempest-CreateVolumesFromImageTest-1070498256 None] Acquiring lock "cinder-quobyte-c0a3e0f4-a5e2-4b6c-b025-697ab174713d" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:22:40 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-ca336670-7f5f-467d-bdaf-1a3af652c74c tempest-CreateVolumesFromImageTest-1070498256 None] Lock "cinder-quobyte-c0a3e0f4-a5e2-4b6c-b025-697ab174713d" acquired by "delete_volume" :: waited 0.016s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:22:40 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[904063f8-1816-4c85-8e31-80fb394fb4bc]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:22:40 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ca336670-7f5f-467d-bdaf-1a3af652c74c tempest-CreateVolumesFromImageTest-1070498256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-c0a3e0f4-a5e2-4b6c-b025-697ab174713d {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:40 devstack sudo[104315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-c0a3e0f4-a5e2-4b6c-b025-697ab174713d Nov 02 10:22:40 devstack sudo[104315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:40 devstack sudo[104315]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:40 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ca336670-7f5f-467d-bdaf-1a3af652c74c tempest-CreateVolumesFromImageTest-1070498256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-c0a3e0f4-a5e2-4b6c-b025-697ab174713d" returned: 0 in 0.368s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:40 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ca336670-7f5f-467d-bdaf-1a3af652c74c tempest-CreateVolumesFromImageTest-1070498256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-c0a3e0f4-a5e2-4b6c-b025-697ab174713d {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:40 devstack sudo[104320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-c0a3e0f4-a5e2-4b6c-b025-697ab174713d Nov 02 10:22:40 devstack sudo[104320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:40 devstack sudo[104320]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:40 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ca336670-7f5f-467d-bdaf-1a3af652c74c tempest-CreateVolumesFromImageTest-1070498256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-c0a3e0f4-a5e2-4b6c-b025-697ab174713d" returned: 0 in 0.228s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:40 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-ca336670-7f5f-467d-bdaf-1a3af652c74c tempest-CreateVolumesFromImageTest-1070498256 None] Lock "cinder-quobyte-c0a3e0f4-a5e2-4b6c-b025-697ab174713d" released by "delete_volume" :: held 0.639s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:22:40 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-ca336670-7f5f-467d-bdaf-1a3af652c74c tempest-CreateVolumesFromImageTest-1070498256 None] Created reservations ['0c6948a2-d3f9-4e3d-9fc4-92cbc7385627', '4c9992e2-27bd-4d4f-b8e6-99c95dd4034b', '74b996e8-c5a3-4fa4-b54b-1b5ad47b3636', 'e28886d9-b2a9-4d8a-af7d-9cf9cc5647be'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:22:41 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-ca336670-7f5f-467d-bdaf-1a3af652c74c tempest-CreateVolumesFromImageTest-1070498256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:22:41 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-ca336670-7f5f-467d-bdaf-1a3af652c74c tempest-CreateVolumesFromImageTest-1070498256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:22:41 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-ca336670-7f5f-467d-bdaf-1a3af652c74c tempest-CreateVolumesFromImageTest-1070498256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:22:41 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-ca336670-7f5f-467d-bdaf-1a3af652c74c tempest-CreateVolumesFromImageTest-1070498256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:22:41 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-ca336670-7f5f-467d-bdaf-1a3af652c74c tempest-CreateVolumesFromImageTest-1070498256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:22:41 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ca336670-7f5f-467d-bdaf-1a3af652c74c tempest-CreateVolumesFromImageTest-1070498256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:41 devstack sudo[104323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:22:41 devstack sudo[104323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:41 devstack sudo[104323]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:41 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ca336670-7f5f-467d-bdaf-1a3af652c74c tempest-CreateVolumesFromImageTest-1070498256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.240s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:41 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-ca336670-7f5f-467d-bdaf-1a3af652c74c tempest-CreateVolumesFromImageTest-1070498256 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:22:41 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-ca336670-7f5f-467d-bdaf-1a3af652c74c tempest-CreateVolumesFromImageTest-1070498256 None] Deleted volume successfully. Nov 02 10:22:41 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-ca336670-7f5f-467d-bdaf-1a3af652c74c tempest-CreateVolumesFromImageTest-1070498256 None] Lock "cinder-c0a3e0f4-a5e2-4b6c-b025-697ab174713d-delete_volume" released by "delete_volume" :: held 1.076s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:22:44 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-b19f8c7d-c532-4bca-a704-3f5f3226ff23 tempest-CreateVolumesFromSnapshotTest-427214029 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:22:44 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-b19f8c7d-c532-4bca-a704-3f5f3226ff23 tempest-CreateVolumesFromSnapshotTest-427214029 None] Flow 'volume_create_manager' (aa2fa8ab-bfa7-4aab-a7f3-427be6b79702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:22:44 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-b19f8c7d-c532-4bca-a704-3f5f3226ff23 tempest-CreateVolumesFromSnapshotTest-427214029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a053ae2b-c149-4501-bbd8-fccc32aae570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:44 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-b19f8c7d-c532-4bca-a704-3f5f3226ff23 tempest-CreateVolumesFromSnapshotTest-427214029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a053ae2b-c149-4501-bbd8-fccc32aae570) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:22:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-463396295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9d7d030-cefa-4286-b766-eadfa8d93aee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46b4e87a01b34907a17529508487dd63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:22:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:22:44Z,use_quota=True,user_id='28e1bc3af6b4431dae418f3356a7078a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:44 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-b19f8c7d-c532-4bca-a704-3f5f3226ff23 tempest-CreateVolumesFromSnapshotTest-427214029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aedd8068-4e8d-4266-82d4-0ea456c2c0a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:44 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-b19f8c7d-c532-4bca-a704-3f5f3226ff23 tempest-CreateVolumesFromSnapshotTest-427214029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aedd8068-4e8d-4266-82d4-0ea456c2c0a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:44 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-b19f8c7d-c532-4bca-a704-3f5f3226ff23 tempest-CreateVolumesFromSnapshotTest-427214029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53b5f0b8-0fa5-4292-a6c2-faf62a52b94e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:44 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-b19f8c7d-c532-4bca-a704-3f5f3226ff23 tempest-CreateVolumesFromSnapshotTest-427214029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53b5f0b8-0fa5-4292-a6c2-faf62a52b94e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9d7d030-cefa-4286-b766-eadfa8d93aee', 'volume_name': 'volume-c9d7d030-cefa-4286-b766-eadfa8d93aee', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:44 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-b19f8c7d-c532-4bca-a704-3f5f3226ff23 tempest-CreateVolumesFromSnapshotTest-427214029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00ae0b40-c6cd-49ee-8e2d-b3b2f4b7a7e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:44 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-b19f8c7d-c532-4bca-a704-3f5f3226ff23 tempest-CreateVolumesFromSnapshotTest-427214029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00ae0b40-c6cd-49ee-8e2d-b3b2f4b7a7e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:44 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-b19f8c7d-c532-4bca-a704-3f5f3226ff23 tempest-CreateVolumesFromSnapshotTest-427214029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d785cbc-18a1-4fec-9bfd-707066c98234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:44 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-b19f8c7d-c532-4bca-a704-3f5f3226ff23 tempest-CreateVolumesFromSnapshotTest-427214029 None] Volume c9d7d030-cefa-4286-b766-eadfa8d93aee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9d7d030-cefa-4286-b766-eadfa8d93aee', 'volume_size': 1} Nov 02 10:22:44 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-b19f8c7d-c532-4bca-a704-3f5f3226ff23 tempest-CreateVolumesFromSnapshotTest-427214029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:22:44 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-b19f8c7d-c532-4bca-a704-3f5f3226ff23 tempest-CreateVolumesFromSnapshotTest-427214029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:22:44 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-b19f8c7d-c532-4bca-a704-3f5f3226ff23 tempest-CreateVolumesFromSnapshotTest-427214029 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:22:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-463396295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9d7d030-cefa-4286-b766-eadfa8d93aee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46b4e87a01b34907a17529508487dd63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:22:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:22:44Z,use_quota=True,user_id='28e1bc3af6b4431dae418f3356a7078a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:22:44 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-b19f8c7d-c532-4bca-a704-3f5f3226ff23 tempest-CreateVolumesFromSnapshotTest-427214029 None] Creating volume c9d7d030-cefa-4286-b766-eadfa8d93aee {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:22:44 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-b19f8c7d-c532-4bca-a704-3f5f3226ff23 tempest-CreateVolumesFromSnapshotTest-427214029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:22:44 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-b19f8c7d-c532-4bca-a704-3f5f3226ff23 tempest-CreateVolumesFromSnapshotTest-427214029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:22:44 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-b19f8c7d-c532-4bca-a704-3f5f3226ff23 tempest-CreateVolumesFromSnapshotTest-427214029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:22:44 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-b19f8c7d-c532-4bca-a704-3f5f3226ff23 tempest-CreateVolumesFromSnapshotTest-427214029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:22:44 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-b19f8c7d-c532-4bca-a704-3f5f3226ff23 tempest-CreateVolumesFromSnapshotTest-427214029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:22:44 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-b19f8c7d-c532-4bca-a704-3f5f3226ff23 tempest-CreateVolumesFromSnapshotTest-427214029 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:22:44 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-b19f8c7d-c532-4bca-a704-3f5f3226ff23 tempest-CreateVolumesFromSnapshotTest-427214029 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:22:44 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-b19f8c7d-c532-4bca-a704-3f5f3226ff23 tempest-CreateVolumesFromSnapshotTest-427214029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-c9d7d030-cefa-4286-b766-eadfa8d93aee 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:44 devstack sudo[104327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-c9d7d030-cefa-4286-b766-eadfa8d93aee 1073741824 Nov 02 10:22:44 devstack sudo[104327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:44 devstack sudo[104327]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:44 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-b19f8c7d-c532-4bca-a704-3f5f3226ff23 tempest-CreateVolumesFromSnapshotTest-427214029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-c9d7d030-cefa-4286-b766-eadfa8d93aee 1073741824" returned: 0 in 0.417s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:44 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-b19f8c7d-c532-4bca-a704-3f5f3226ff23 tempest-CreateVolumesFromSnapshotTest-427214029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-c9d7d030-cefa-4286-b766-eadfa8d93aee {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:44 devstack sudo[104332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-c9d7d030-cefa-4286-b766-eadfa8d93aee Nov 02 10:22:44 devstack sudo[104332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:44 devstack sudo[104332]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:44 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-b19f8c7d-c532-4bca-a704-3f5f3226ff23 tempest-CreateVolumesFromSnapshotTest-427214029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-c9d7d030-cefa-4286-b766-eadfa8d93aee" returned: 0 in 0.244s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:44 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-b19f8c7d-c532-4bca-a704-3f5f3226ff23 tempest-CreateVolumesFromSnapshotTest-427214029 None] <== create_volume: return (703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:22:44 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-b19f8c7d-c532-4bca-a704-3f5f3226ff23 tempest-CreateVolumesFromSnapshotTest-427214029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.705s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:22:44 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-b19f8c7d-c532-4bca-a704-3f5f3226ff23 tempest-CreateVolumesFromSnapshotTest-427214029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d785cbc-18a1-4fec-9bfd-707066c98234) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9d7d030-cefa-4286-b766-eadfa8d93aee', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:44 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-b19f8c7d-c532-4bca-a704-3f5f3226ff23 tempest-CreateVolumesFromSnapshotTest-427214029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9a9d8af-13d7-4644-9dc2-c85a19cfdc93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:44 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-b19f8c7d-c532-4bca-a704-3f5f3226ff23 tempest-CreateVolumesFromSnapshotTest-427214029 None] Volume volume-c9d7d030-cefa-4286-b766-eadfa8d93aee (c9d7d030-cefa-4286-b766-eadfa8d93aee): created successfully Nov 02 10:22:44 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-b19f8c7d-c532-4bca-a704-3f5f3226ff23 tempest-CreateVolumesFromSnapshotTest-427214029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9a9d8af-13d7-4644-9dc2-c85a19cfdc93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:44 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-b19f8c7d-c532-4bca-a704-3f5f3226ff23 tempest-CreateVolumesFromSnapshotTest-427214029 None] Flow 'volume_create_manager' (aa2fa8ab-bfa7-4aab-a7f3-427be6b79702) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:22:44 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-b19f8c7d-c532-4bca-a704-3f5f3226ff23 tempest-CreateVolumesFromSnapshotTest-427214029 None] Created volume successfully. Nov 02 10:22:45 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-a67e9e77-254b-447a-96ad-91ad1616fbb8 tempest-CreateVolumesFromSnapshotTest-427214029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:22:45 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-a67e9e77-254b-447a-96ad-91ad1616fbb8 tempest-CreateVolumesFromSnapshotTest-427214029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:22:45 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-a67e9e77-254b-447a-96ad-91ad1616fbb8 tempest-CreateVolumesFromSnapshotTest-427214029 None] Creating offline snapshot c0c7b33e-0045-4d29-a59b-21b354b84a7c of volume c9d7d030-cefa-4286-b766-eadfa8d93aee {{(pid=86890) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:22:45 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[904d3855-14d8-4566-9925-74f6454b9e2f]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:22:45 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a67e9e77-254b-447a-96ad-91ad1616fbb8 tempest-CreateVolumesFromSnapshotTest-427214029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-c9d7d030-cefa-4286-b766-eadfa8d93aee {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:45 devstack sudo[104335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-c9d7d030-cefa-4286-b766-eadfa8d93aee Nov 02 10:22:45 devstack sudo[104335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:45 devstack sudo[104335]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:45 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a67e9e77-254b-447a-96ad-91ad1616fbb8 tempest-CreateVolumesFromSnapshotTest-427214029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-c9d7d030-cefa-4286-b766-eadfa8d93aee" returned: 0 in 0.347s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:45 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a67e9e77-254b-447a-96ad-91ad1616fbb8 tempest-CreateVolumesFromSnapshotTest-427214029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-c9d7d030-cefa-4286-b766-eadfa8d93aee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-c9d7d030-cefa-4286-b766-eadfa8d93aee.c0c7b33e-0045-4d29-a59b-21b354b84a7c 1G {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:45 devstack sudo[104340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-c9d7d030-cefa-4286-b766-eadfa8d93aee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-c9d7d030-cefa-4286-b766-eadfa8d93aee.c0c7b33e-0045-4d29-a59b-21b354b84a7c 1G Nov 02 10:22:45 devstack sudo[104340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:46 devstack sudo[104340]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:46 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a67e9e77-254b-447a-96ad-91ad1616fbb8 tempest-CreateVolumesFromSnapshotTest-427214029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-c9d7d030-cefa-4286-b766-eadfa8d93aee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-c9d7d030-cefa-4286-b766-eadfa8d93aee.c0c7b33e-0045-4d29-a59b-21b354b84a7c 1G" returned: 0 in 0.384s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:46 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a67e9e77-254b-447a-96ad-91ad1616fbb8 tempest-CreateVolumesFromSnapshotTest-427214029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9d7d030-cefa-4286-b766-eadfa8d93aee -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-c9d7d030-cefa-4286-b766-eadfa8d93aee.c0c7b33e-0045-4d29-a59b-21b354b84a7c {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:46 devstack sudo[104346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9d7d030-cefa-4286-b766-eadfa8d93aee -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-c9d7d030-cefa-4286-b766-eadfa8d93aee.c0c7b33e-0045-4d29-a59b-21b354b84a7c Nov 02 10:22:46 devstack sudo[104346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:46 devstack sudo[104346]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:46 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a67e9e77-254b-447a-96ad-91ad1616fbb8 tempest-CreateVolumesFromSnapshotTest-427214029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9d7d030-cefa-4286-b766-eadfa8d93aee -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-c9d7d030-cefa-4286-b766-eadfa8d93aee.c0c7b33e-0045-4d29-a59b-21b354b84a7c" returned: 0 in 0.289s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:46 devstack cinder-volume[86890]: WARNING cinder.volume.drivers.remotefs [None req-a67e9e77-254b-447a-96ad-91ad1616fbb8 tempest-CreateVolumesFromSnapshotTest-427214029 None] /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-c9d7d030-cefa-4286-b766-eadfa8d93aee.c0c7b33e-0045-4d29-a59b-21b354b84a7c is being set with open permissions: ugo+rw Nov 02 10:22:46 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a67e9e77-254b-447a-96ad-91ad1616fbb8 tempest-CreateVolumesFromSnapshotTest-427214029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-c9d7d030-cefa-4286-b766-eadfa8d93aee.c0c7b33e-0045-4d29-a59b-21b354b84a7c {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:46 devstack sudo[104351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-c9d7d030-cefa-4286-b766-eadfa8d93aee.c0c7b33e-0045-4d29-a59b-21b354b84a7c Nov 02 10:22:46 devstack sudo[104351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:46 devstack sudo[104351]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:46 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a67e9e77-254b-447a-96ad-91ad1616fbb8 tempest-CreateVolumesFromSnapshotTest-427214029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-c9d7d030-cefa-4286-b766-eadfa8d93aee.c0c7b33e-0045-4d29-a59b-21b354b84a7c" returned: 0 in 0.235s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:46 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a67e9e77-254b-447a-96ad-91ad1616fbb8 tempest-CreateVolumesFromSnapshotTest-427214029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-c9d7d030-cefa-4286-b766-eadfa8d93aee.info {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:46 devstack sudo[104354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-c9d7d030-cefa-4286-b766-eadfa8d93aee.info Nov 02 10:22:46 devstack sudo[104354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:46 devstack sudo[104354]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:46 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a67e9e77-254b-447a-96ad-91ad1616fbb8 tempest-CreateVolumesFromSnapshotTest-427214029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-c9d7d030-cefa-4286-b766-eadfa8d93aee.info" returned: 0 in 0.240s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:46 devstack cinder-volume[86890]: WARNING cinder.volume.drivers.remotefs [None req-a67e9e77-254b-447a-96ad-91ad1616fbb8 tempest-CreateVolumesFromSnapshotTest-427214029 None] /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-c9d7d030-cefa-4286-b766-eadfa8d93aee.info is being set with open permissions: ugo+rw Nov 02 10:22:46 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a67e9e77-254b-447a-96ad-91ad1616fbb8 tempest-CreateVolumesFromSnapshotTest-427214029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-c9d7d030-cefa-4286-b766-eadfa8d93aee.info {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:46 devstack sudo[104357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-c9d7d030-cefa-4286-b766-eadfa8d93aee.info Nov 02 10:22:46 devstack sudo[104357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:47 devstack sudo[104357]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:47 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a67e9e77-254b-447a-96ad-91ad1616fbb8 tempest-CreateVolumesFromSnapshotTest-427214029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-c9d7d030-cefa-4286-b766-eadfa8d93aee.info" returned: 0 in 0.241s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:47 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-a67e9e77-254b-447a-96ad-91ad1616fbb8 tempest-CreateVolumesFromSnapshotTest-427214029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.824s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:22:47 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-a67e9e77-254b-447a-96ad-91ad1616fbb8 tempest-CreateVolumesFromSnapshotTest-427214029 None] Create snapshot completed successfully Nov 02 10:22:47 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fbd64d1-08cd-4fd0-86e8-04c9ad33fcc0 tempest-CreateVolumesFromSnapshotTest-427214029 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:22:47 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-2fbd64d1-08cd-4fd0-86e8-04c9ad33fcc0 tempest-CreateVolumesFromSnapshotTest-427214029 None] Flow 'volume_create_manager' (34e3a8f1-00fe-4a1e-8d33-e220928fc3fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:22:47 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-2fbd64d1-08cd-4fd0-86e8-04c9ad33fcc0 tempest-CreateVolumesFromSnapshotTest-427214029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f161901f-665f-43df-ac71-dd7feed519f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:47 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-2fbd64d1-08cd-4fd0-86e8-04c9ad33fcc0 tempest-CreateVolumesFromSnapshotTest-427214029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f161901f-665f-43df-ac71-dd7feed519f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:22:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-109735354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e3defbe-464f-44f8-bcd2-1587526b29f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46b4e87a01b34907a17529508487dd63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:22:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:22:48Z,use_quota=True,user_id='28e1bc3af6b4431dae418f3356a7078a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:47 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-2fbd64d1-08cd-4fd0-86e8-04c9ad33fcc0 tempest-CreateVolumesFromSnapshotTest-427214029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e62db0a-919f-454a-b274-f89dcc008cf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:47 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-2fbd64d1-08cd-4fd0-86e8-04c9ad33fcc0 tempest-CreateVolumesFromSnapshotTest-427214029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e62db0a-919f-454a-b274-f89dcc008cf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:47 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-2fbd64d1-08cd-4fd0-86e8-04c9ad33fcc0 tempest-CreateVolumesFromSnapshotTest-427214029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91ac09f4-6f61-4b94-ac88-4be36214c17b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:47 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-2fbd64d1-08cd-4fd0-86e8-04c9ad33fcc0 tempest-CreateVolumesFromSnapshotTest-427214029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91ac09f4-6f61-4b94-ac88-4be36214c17b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e3defbe-464f-44f8-bcd2-1587526b29f1', 'volume_name': 'volume-2e3defbe-464f-44f8-bcd2-1587526b29f1', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:47 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-2fbd64d1-08cd-4fd0-86e8-04c9ad33fcc0 tempest-CreateVolumesFromSnapshotTest-427214029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (868655e2-3d8e-4c37-b4fa-f18e72331608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:47 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-2fbd64d1-08cd-4fd0-86e8-04c9ad33fcc0 tempest-CreateVolumesFromSnapshotTest-427214029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (868655e2-3d8e-4c37-b4fa-f18e72331608) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:47 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-2fbd64d1-08cd-4fd0-86e8-04c9ad33fcc0 tempest-CreateVolumesFromSnapshotTest-427214029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7df1481a-dbd4-4034-8b17-83f507b3cd9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:47 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-2fbd64d1-08cd-4fd0-86e8-04c9ad33fcc0 tempest-CreateVolumesFromSnapshotTest-427214029 None] Volume 2e3defbe-464f-44f8-bcd2-1587526b29f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e3defbe-464f-44f8-bcd2-1587526b29f1', 'volume_size': 1} Nov 02 10:22:47 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-2fbd64d1-08cd-4fd0-86e8-04c9ad33fcc0 tempest-CreateVolumesFromSnapshotTest-427214029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:22:47 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-2fbd64d1-08cd-4fd0-86e8-04c9ad33fcc0 tempest-CreateVolumesFromSnapshotTest-427214029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:22:47 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-2fbd64d1-08cd-4fd0-86e8-04c9ad33fcc0 tempest-CreateVolumesFromSnapshotTest-427214029 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:22:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-109735354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e3defbe-464f-44f8-bcd2-1587526b29f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46b4e87a01b34907a17529508487dd63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:22:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:22:48Z,use_quota=True,user_id='28e1bc3af6b4431dae418f3356a7078a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:22:47 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-2fbd64d1-08cd-4fd0-86e8-04c9ad33fcc0 tempest-CreateVolumesFromSnapshotTest-427214029 None] Creating volume 2e3defbe-464f-44f8-bcd2-1587526b29f1 {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:22:47 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-2fbd64d1-08cd-4fd0-86e8-04c9ad33fcc0 tempest-CreateVolumesFromSnapshotTest-427214029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:22:47 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-2fbd64d1-08cd-4fd0-86e8-04c9ad33fcc0 tempest-CreateVolumesFromSnapshotTest-427214029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:22:47 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-2fbd64d1-08cd-4fd0-86e8-04c9ad33fcc0 tempest-CreateVolumesFromSnapshotTest-427214029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:22:47 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-2fbd64d1-08cd-4fd0-86e8-04c9ad33fcc0 tempest-CreateVolumesFromSnapshotTest-427214029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:22:47 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-2fbd64d1-08cd-4fd0-86e8-04c9ad33fcc0 tempest-CreateVolumesFromSnapshotTest-427214029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:22:47 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-2fbd64d1-08cd-4fd0-86e8-04c9ad33fcc0 tempest-CreateVolumesFromSnapshotTest-427214029 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:22:47 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-2fbd64d1-08cd-4fd0-86e8-04c9ad33fcc0 tempest-CreateVolumesFromSnapshotTest-427214029 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:22:47 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-2fbd64d1-08cd-4fd0-86e8-04c9ad33fcc0 tempest-CreateVolumesFromSnapshotTest-427214029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-2e3defbe-464f-44f8-bcd2-1587526b29f1 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:47 devstack sudo[104360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-2e3defbe-464f-44f8-bcd2-1587526b29f1 1073741824 Nov 02 10:22:47 devstack sudo[104360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:48 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-5eb43074-3b03-40fb-ae78-9be2d77d6265 tempest-CreateVolumesFromSnapshotTest-427214029 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:22:48 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-5eb43074-3b03-40fb-ae78-9be2d77d6265 tempest-CreateVolumesFromSnapshotTest-427214029 None] Flow 'volume_create_manager' (94e8583d-37f2-480b-9cb7-7dc326e540ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:22:48 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-5eb43074-3b03-40fb-ae78-9be2d77d6265 tempest-CreateVolumesFromSnapshotTest-427214029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5de0f4f-ab45-487a-a6f7-d81a5294965c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:48 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-5eb43074-3b03-40fb-ae78-9be2d77d6265 tempest-CreateVolumesFromSnapshotTest-427214029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5de0f4f-ab45-487a-a6f7-d81a5294965c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:22:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-68457509',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a78e9d70-e9f5-4bf4-8506-ed43eba3ff09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46b4e87a01b34907a17529508487dd63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:22:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:22:48Z,use_quota=True,user_id='28e1bc3af6b4431dae418f3356a7078a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:48 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-5eb43074-3b03-40fb-ae78-9be2d77d6265 tempest-CreateVolumesFromSnapshotTest-427214029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (652e308e-eb3b-4630-b655-cda94d5f3579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:48 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-5eb43074-3b03-40fb-ae78-9be2d77d6265 tempest-CreateVolumesFromSnapshotTest-427214029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (652e308e-eb3b-4630-b655-cda94d5f3579) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:48 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-5eb43074-3b03-40fb-ae78-9be2d77d6265 tempest-CreateVolumesFromSnapshotTest-427214029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d50d79ba-325b-4da2-9a2d-1e92ac65e355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:48 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-5eb43074-3b03-40fb-ae78-9be2d77d6265 tempest-CreateVolumesFromSnapshotTest-427214029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d50d79ba-325b-4da2-9a2d-1e92ac65e355) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a78e9d70-e9f5-4bf4-8506-ed43eba3ff09', 'volume_name': 'volume-a78e9d70-e9f5-4bf4-8506-ed43eba3ff09', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:48 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-5eb43074-3b03-40fb-ae78-9be2d77d6265 tempest-CreateVolumesFromSnapshotTest-427214029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2c9d5b9-ddf2-4176-aac3-5dd1ba320396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:48 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-5eb43074-3b03-40fb-ae78-9be2d77d6265 tempest-CreateVolumesFromSnapshotTest-427214029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2c9d5b9-ddf2-4176-aac3-5dd1ba320396) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:48 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-5eb43074-3b03-40fb-ae78-9be2d77d6265 tempest-CreateVolumesFromSnapshotTest-427214029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (159af522-e3ad-4b9f-ab96-e1a46bf3f59a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:48 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-5eb43074-3b03-40fb-ae78-9be2d77d6265 tempest-CreateVolumesFromSnapshotTest-427214029 None] Volume a78e9d70-e9f5-4bf4-8506-ed43eba3ff09: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a78e9d70-e9f5-4bf4-8506-ed43eba3ff09', 'volume_size': 1} Nov 02 10:22:48 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-5eb43074-3b03-40fb-ae78-9be2d77d6265 tempest-CreateVolumesFromSnapshotTest-427214029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:22:48 devstack sudo[104360]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:48 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-2fbd64d1-08cd-4fd0-86e8-04c9ad33fcc0 tempest-CreateVolumesFromSnapshotTest-427214029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-2e3defbe-464f-44f8-bcd2-1587526b29f1 1073741824" returned: 0 in 0.539s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:48 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-2fbd64d1-08cd-4fd0-86e8-04c9ad33fcc0 tempest-CreateVolumesFromSnapshotTest-427214029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-2e3defbe-464f-44f8-bcd2-1587526b29f1 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:48 devstack sudo[104365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-2e3defbe-464f-44f8-bcd2-1587526b29f1 Nov 02 10:22:48 devstack sudo[104365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:48 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-614c92f3-2083-49ef-8caa-8b17bf82b5d9 tempest-CreateVolumesFromSnapshotTest-427214029 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:22:48 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-614c92f3-2083-49ef-8caa-8b17bf82b5d9 tempest-CreateVolumesFromSnapshotTest-427214029 None] Flow 'volume_create_manager' (cfd34454-54d7-4741-ab26-14a77bfeaa15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:22:48 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-614c92f3-2083-49ef-8caa-8b17bf82b5d9 tempest-CreateVolumesFromSnapshotTest-427214029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de21265e-a649-4781-b044-9f83d7cf0903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:48 devstack sudo[104365]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:48 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-2fbd64d1-08cd-4fd0-86e8-04c9ad33fcc0 tempest-CreateVolumesFromSnapshotTest-427214029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-2e3defbe-464f-44f8-bcd2-1587526b29f1" returned: 0 in 0.286s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:48 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-2fbd64d1-08cd-4fd0-86e8-04c9ad33fcc0 tempest-CreateVolumesFromSnapshotTest-427214029 None] <== create_volume: return (876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:22:48 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-2fbd64d1-08cd-4fd0-86e8-04c9ad33fcc0 tempest-CreateVolumesFromSnapshotTest-427214029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.878s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:22:48 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-5eb43074-3b03-40fb-ae78-9be2d77d6265 tempest-CreateVolumesFromSnapshotTest-427214029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.442s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:22:48 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-5eb43074-3b03-40fb-ae78-9be2d77d6265 tempest-CreateVolumesFromSnapshotTest-427214029 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:22:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-68457509',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a78e9d70-e9f5-4bf4-8506-ed43eba3ff09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46b4e87a01b34907a17529508487dd63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:22:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:22:48Z,use_quota=True,user_id='28e1bc3af6b4431dae418f3356a7078a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:22:48 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-5eb43074-3b03-40fb-ae78-9be2d77d6265 tempest-CreateVolumesFromSnapshotTest-427214029 None] Creating volume a78e9d70-e9f5-4bf4-8506-ed43eba3ff09 {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:22:48 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-5eb43074-3b03-40fb-ae78-9be2d77d6265 tempest-CreateVolumesFromSnapshotTest-427214029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:22:48 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-5eb43074-3b03-40fb-ae78-9be2d77d6265 tempest-CreateVolumesFromSnapshotTest-427214029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:22:48 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-5eb43074-3b03-40fb-ae78-9be2d77d6265 tempest-CreateVolumesFromSnapshotTest-427214029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:22:48 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-5eb43074-3b03-40fb-ae78-9be2d77d6265 tempest-CreateVolumesFromSnapshotTest-427214029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:22:48 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-5eb43074-3b03-40fb-ae78-9be2d77d6265 tempest-CreateVolumesFromSnapshotTest-427214029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:22:48 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-5eb43074-3b03-40fb-ae78-9be2d77d6265 tempest-CreateVolumesFromSnapshotTest-427214029 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:22:48 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-5eb43074-3b03-40fb-ae78-9be2d77d6265 tempest-CreateVolumesFromSnapshotTest-427214029 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:22:48 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-5eb43074-3b03-40fb-ae78-9be2d77d6265 tempest-CreateVolumesFromSnapshotTest-427214029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-a78e9d70-e9f5-4bf4-8506-ed43eba3ff09 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:48 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-614c92f3-2083-49ef-8caa-8b17bf82b5d9 tempest-CreateVolumesFromSnapshotTest-427214029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de21265e-a649-4781-b044-9f83d7cf0903) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:22:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1069741264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=731ffbb3-79d0-496b-b94f-17dd8db0e517,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46b4e87a01b34907a17529508487dd63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:22:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:22:49Z,use_quota=True,user_id='28e1bc3af6b4431dae418f3356a7078a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:48 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-614c92f3-2083-49ef-8caa-8b17bf82b5d9 tempest-CreateVolumesFromSnapshotTest-427214029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbca7d03-0be6-48c2-a039-0ae73d75f5f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:48 devstack sudo[104368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-a78e9d70-e9f5-4bf4-8506-ed43eba3ff09 1073741824 Nov 02 10:22:48 devstack sudo[104368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:48 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-614c92f3-2083-49ef-8caa-8b17bf82b5d9 tempest-CreateVolumesFromSnapshotTest-427214029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbca7d03-0be6-48c2-a039-0ae73d75f5f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:48 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-614c92f3-2083-49ef-8caa-8b17bf82b5d9 tempest-CreateVolumesFromSnapshotTest-427214029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c91c5882-0490-4c04-ba92-c134c133f2ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:48 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-614c92f3-2083-49ef-8caa-8b17bf82b5d9 tempest-CreateVolumesFromSnapshotTest-427214029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c91c5882-0490-4c04-ba92-c134c133f2ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '731ffbb3-79d0-496b-b94f-17dd8db0e517', 'volume_name': 'volume-731ffbb3-79d0-496b-b94f-17dd8db0e517', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:48 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-614c92f3-2083-49ef-8caa-8b17bf82b5d9 tempest-CreateVolumesFromSnapshotTest-427214029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63669c3b-ecb6-476e-835c-847648de4b51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:48 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-614c92f3-2083-49ef-8caa-8b17bf82b5d9 tempest-CreateVolumesFromSnapshotTest-427214029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63669c3b-ecb6-476e-835c-847648de4b51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:48 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-614c92f3-2083-49ef-8caa-8b17bf82b5d9 tempest-CreateVolumesFromSnapshotTest-427214029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e76500ca-986c-4b3e-97cb-ea0fc8f2111e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:48 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-614c92f3-2083-49ef-8caa-8b17bf82b5d9 tempest-CreateVolumesFromSnapshotTest-427214029 None] Volume 731ffbb3-79d0-496b-b94f-17dd8db0e517: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-731ffbb3-79d0-496b-b94f-17dd8db0e517', 'volume_size': 1} Nov 02 10:22:48 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-614c92f3-2083-49ef-8caa-8b17bf82b5d9 tempest-CreateVolumesFromSnapshotTest-427214029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:22:48 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-2fbd64d1-08cd-4fd0-86e8-04c9ad33fcc0 tempest-CreateVolumesFromSnapshotTest-427214029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7df1481a-dbd4-4034-8b17-83f507b3cd9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e3defbe-464f-44f8-bcd2-1587526b29f1', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:48 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-2fbd64d1-08cd-4fd0-86e8-04c9ad33fcc0 tempest-CreateVolumesFromSnapshotTest-427214029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96d91168-ddfa-407a-9d28-e7585fa59db2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:48 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-2fbd64d1-08cd-4fd0-86e8-04c9ad33fcc0 tempest-CreateVolumesFromSnapshotTest-427214029 None] Volume volume-2e3defbe-464f-44f8-bcd2-1587526b29f1 (2e3defbe-464f-44f8-bcd2-1587526b29f1): created successfully Nov 02 10:22:48 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-2fbd64d1-08cd-4fd0-86e8-04c9ad33fcc0 tempest-CreateVolumesFromSnapshotTest-427214029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96d91168-ddfa-407a-9d28-e7585fa59db2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:48 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-2fbd64d1-08cd-4fd0-86e8-04c9ad33fcc0 tempest-CreateVolumesFromSnapshotTest-427214029 None] Flow 'volume_create_manager' (34e3a8f1-00fe-4a1e-8d33-e220928fc3fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:22:48 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-2fbd64d1-08cd-4fd0-86e8-04c9ad33fcc0 tempest-CreateVolumesFromSnapshotTest-427214029 None] Created volume successfully. Nov 02 10:22:49 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-af18b3b9-01c9-4c61-899e-f04790b620ff tempest-CreateVolumesFromSnapshotTest-427214029 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:22:49 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-af18b3b9-01c9-4c61-899e-f04790b620ff tempest-CreateVolumesFromSnapshotTest-427214029 None] Flow 'volume_create_manager' (ad0e97b2-272c-4fc3-84f8-494719ebf049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:22:49 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-af18b3b9-01c9-4c61-899e-f04790b620ff tempest-CreateVolumesFromSnapshotTest-427214029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcbe1636-0377-4d93-9533-27664450bd10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:49 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-af18b3b9-01c9-4c61-899e-f04790b620ff tempest-CreateVolumesFromSnapshotTest-427214029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcbe1636-0377-4d93-9533-27664450bd10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:22:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-364428622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af89e364-8dd7-43b7-85a0-bf758da22d84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46b4e87a01b34907a17529508487dd63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:22:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:22:49Z,use_quota=True,user_id='28e1bc3af6b4431dae418f3356a7078a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:49 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-af18b3b9-01c9-4c61-899e-f04790b620ff tempest-CreateVolumesFromSnapshotTest-427214029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (015e8cef-caec-4385-b220-65db0d0c5074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:49 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-af18b3b9-01c9-4c61-899e-f04790b620ff tempest-CreateVolumesFromSnapshotTest-427214029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (015e8cef-caec-4385-b220-65db0d0c5074) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:49 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-af18b3b9-01c9-4c61-899e-f04790b620ff tempest-CreateVolumesFromSnapshotTest-427214029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67c041c4-a15f-491a-a0c4-30863e81ce09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:49 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-af18b3b9-01c9-4c61-899e-f04790b620ff tempest-CreateVolumesFromSnapshotTest-427214029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67c041c4-a15f-491a-a0c4-30863e81ce09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af89e364-8dd7-43b7-85a0-bf758da22d84', 'volume_name': 'volume-af89e364-8dd7-43b7-85a0-bf758da22d84', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:49 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-af18b3b9-01c9-4c61-899e-f04790b620ff tempest-CreateVolumesFromSnapshotTest-427214029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (665d9d08-23c3-4ed7-b8ca-d81c49c0cca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:49 devstack sudo[104368]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:49 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-af18b3b9-01c9-4c61-899e-f04790b620ff tempest-CreateVolumesFromSnapshotTest-427214029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (665d9d08-23c3-4ed7-b8ca-d81c49c0cca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:49 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-af18b3b9-01c9-4c61-899e-f04790b620ff tempest-CreateVolumesFromSnapshotTest-427214029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc0242d3-04f8-4fa8-a3ad-799c016b147a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:49 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-af18b3b9-01c9-4c61-899e-f04790b620ff tempest-CreateVolumesFromSnapshotTest-427214029 None] Volume af89e364-8dd7-43b7-85a0-bf758da22d84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af89e364-8dd7-43b7-85a0-bf758da22d84', 'volume_size': 1} Nov 02 10:22:49 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-af18b3b9-01c9-4c61-899e-f04790b620ff tempest-CreateVolumesFromSnapshotTest-427214029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:22:49 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-5eb43074-3b03-40fb-ae78-9be2d77d6265 tempest-CreateVolumesFromSnapshotTest-427214029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-a78e9d70-e9f5-4bf4-8506-ed43eba3ff09 1073741824" returned: 0 in 0.535s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:49 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-5eb43074-3b03-40fb-ae78-9be2d77d6265 tempest-CreateVolumesFromSnapshotTest-427214029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-a78e9d70-e9f5-4bf4-8506-ed43eba3ff09 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:49 devstack sudo[104374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-a78e9d70-e9f5-4bf4-8506-ed43eba3ff09 Nov 02 10:22:49 devstack sudo[104374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:49 devstack sudo[104374]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:49 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-5eb43074-3b03-40fb-ae78-9be2d77d6265 tempest-CreateVolumesFromSnapshotTest-427214029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-a78e9d70-e9f5-4bf4-8506-ed43eba3ff09" returned: 0 in 0.297s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:49 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-5eb43074-3b03-40fb-ae78-9be2d77d6265 tempest-CreateVolumesFromSnapshotTest-427214029 None] <== create_volume: return (876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:22:49 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-5eb43074-3b03-40fb-ae78-9be2d77d6265 tempest-CreateVolumesFromSnapshotTest-427214029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.880s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:22:49 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-614c92f3-2083-49ef-8caa-8b17bf82b5d9 tempest-CreateVolumesFromSnapshotTest-427214029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.820s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:22:49 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-614c92f3-2083-49ef-8caa-8b17bf82b5d9 tempest-CreateVolumesFromSnapshotTest-427214029 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:22:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1069741264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=731ffbb3-79d0-496b-b94f-17dd8db0e517,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46b4e87a01b34907a17529508487dd63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:22:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:22:49Z,use_quota=True,user_id='28e1bc3af6b4431dae418f3356a7078a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:22:49 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-614c92f3-2083-49ef-8caa-8b17bf82b5d9 tempest-CreateVolumesFromSnapshotTest-427214029 None] Creating volume 731ffbb3-79d0-496b-b94f-17dd8db0e517 {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:22:49 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-614c92f3-2083-49ef-8caa-8b17bf82b5d9 tempest-CreateVolumesFromSnapshotTest-427214029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:22:49 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-614c92f3-2083-49ef-8caa-8b17bf82b5d9 tempest-CreateVolumesFromSnapshotTest-427214029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:22:49 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-614c92f3-2083-49ef-8caa-8b17bf82b5d9 tempest-CreateVolumesFromSnapshotTest-427214029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:22:49 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-614c92f3-2083-49ef-8caa-8b17bf82b5d9 tempest-CreateVolumesFromSnapshotTest-427214029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:22:49 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-614c92f3-2083-49ef-8caa-8b17bf82b5d9 tempest-CreateVolumesFromSnapshotTest-427214029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:22:49 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-614c92f3-2083-49ef-8caa-8b17bf82b5d9 tempest-CreateVolumesFromSnapshotTest-427214029 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:22:49 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-614c92f3-2083-49ef-8caa-8b17bf82b5d9 tempest-CreateVolumesFromSnapshotTest-427214029 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:22:49 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-614c92f3-2083-49ef-8caa-8b17bf82b5d9 tempest-CreateVolumesFromSnapshotTest-427214029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-731ffbb3-79d0-496b-b94f-17dd8db0e517 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:49 devstack sudo[104377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-731ffbb3-79d0-496b-b94f-17dd8db0e517 1073741824 Nov 02 10:22:49 devstack sudo[104377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:49 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-5eb43074-3b03-40fb-ae78-9be2d77d6265 tempest-CreateVolumesFromSnapshotTest-427214029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (159af522-e3ad-4b9f-ab96-e1a46bf3f59a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a78e9d70-e9f5-4bf4-8506-ed43eba3ff09', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:49 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-5eb43074-3b03-40fb-ae78-9be2d77d6265 tempest-CreateVolumesFromSnapshotTest-427214029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (938dae10-6545-4d24-9da8-b040c241cb22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:49 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-5eb43074-3b03-40fb-ae78-9be2d77d6265 tempest-CreateVolumesFromSnapshotTest-427214029 None] Volume volume-a78e9d70-e9f5-4bf4-8506-ed43eba3ff09 (a78e9d70-e9f5-4bf4-8506-ed43eba3ff09): created successfully Nov 02 10:22:49 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-5eb43074-3b03-40fb-ae78-9be2d77d6265 tempest-CreateVolumesFromSnapshotTest-427214029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (938dae10-6545-4d24-9da8-b040c241cb22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:49 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-5eb43074-3b03-40fb-ae78-9be2d77d6265 tempest-CreateVolumesFromSnapshotTest-427214029 None] Flow 'volume_create_manager' (94e8583d-37f2-480b-9cb7-7dc326e540ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:22:49 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-27c39d68-0e0d-416e-ae12-075bdf2c9158 tempest-CreateVolumesFromSnapshotTest-427214029 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:22:49 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-27c39d68-0e0d-416e-ae12-075bdf2c9158 tempest-CreateVolumesFromSnapshotTest-427214029 None] Flow 'volume_create_manager' (90cae788-fe1b-4bb6-9de2-aa8f3b0f2a39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:22:49 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-27c39d68-0e0d-416e-ae12-075bdf2c9158 tempest-CreateVolumesFromSnapshotTest-427214029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e75ca291-0ea1-4bb3-93c4-a4fd4a931a28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:49 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-5eb43074-3b03-40fb-ae78-9be2d77d6265 tempest-CreateVolumesFromSnapshotTest-427214029 None] Created volume successfully. Nov 02 10:22:49 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-27c39d68-0e0d-416e-ae12-075bdf2c9158 tempest-CreateVolumesFromSnapshotTest-427214029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e75ca291-0ea1-4bb3-93c4-a4fd4a931a28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:22:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-664909371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1520340-283b-4fa5-88f8-b4239871f1e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46b4e87a01b34907a17529508487dd63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:22:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:22:50Z,use_quota=True,user_id='28e1bc3af6b4431dae418f3356a7078a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:49 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-27c39d68-0e0d-416e-ae12-075bdf2c9158 tempest-CreateVolumesFromSnapshotTest-427214029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82ee6304-84ad-4761-b2bc-24c0bcb1cb7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:49 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-27c39d68-0e0d-416e-ae12-075bdf2c9158 tempest-CreateVolumesFromSnapshotTest-427214029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82ee6304-84ad-4761-b2bc-24c0bcb1cb7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:49 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-27c39d68-0e0d-416e-ae12-075bdf2c9158 tempest-CreateVolumesFromSnapshotTest-427214029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e8383ba-ae42-4147-8502-8babfd2cbb1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:49 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-27c39d68-0e0d-416e-ae12-075bdf2c9158 tempest-CreateVolumesFromSnapshotTest-427214029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e8383ba-ae42-4147-8502-8babfd2cbb1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1520340-283b-4fa5-88f8-b4239871f1e0', 'volume_name': 'volume-e1520340-283b-4fa5-88f8-b4239871f1e0', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:49 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-27c39d68-0e0d-416e-ae12-075bdf2c9158 tempest-CreateVolumesFromSnapshotTest-427214029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f19823c-661f-43db-aa3e-64419a836f95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:49 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-27c39d68-0e0d-416e-ae12-075bdf2c9158 tempest-CreateVolumesFromSnapshotTest-427214029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f19823c-661f-43db-aa3e-64419a836f95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:49 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-27c39d68-0e0d-416e-ae12-075bdf2c9158 tempest-CreateVolumesFromSnapshotTest-427214029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d4b192a-448e-4fa3-bef7-818b94aa5387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:49 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-27c39d68-0e0d-416e-ae12-075bdf2c9158 tempest-CreateVolumesFromSnapshotTest-427214029 None] Volume e1520340-283b-4fa5-88f8-b4239871f1e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1520340-283b-4fa5-88f8-b4239871f1e0', 'volume_size': 1} Nov 02 10:22:49 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-27c39d68-0e0d-416e-ae12-075bdf2c9158 tempest-CreateVolumesFromSnapshotTest-427214029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:22:50 devstack sudo[104377]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:50 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-614c92f3-2083-49ef-8caa-8b17bf82b5d9 tempest-CreateVolumesFromSnapshotTest-427214029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-731ffbb3-79d0-496b-b94f-17dd8db0e517 1073741824" returned: 0 in 0.443s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:50 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-614c92f3-2083-49ef-8caa-8b17bf82b5d9 tempest-CreateVolumesFromSnapshotTest-427214029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-731ffbb3-79d0-496b-b94f-17dd8db0e517 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:50 devstack sudo[104383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-731ffbb3-79d0-496b-b94f-17dd8db0e517 Nov 02 10:22:50 devstack sudo[104383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:50 devstack sudo[104383]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:50 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-614c92f3-2083-49ef-8caa-8b17bf82b5d9 tempest-CreateVolumesFromSnapshotTest-427214029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-731ffbb3-79d0-496b-b94f-17dd8db0e517" returned: 0 in 0.290s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:50 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-614c92f3-2083-49ef-8caa-8b17bf82b5d9 tempest-CreateVolumesFromSnapshotTest-427214029 None] <== create_volume: return (777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:22:50 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-614c92f3-2083-49ef-8caa-8b17bf82b5d9 tempest-CreateVolumesFromSnapshotTest-427214029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.781s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:22:50 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-af18b3b9-01c9-4c61-899e-f04790b620ff tempest-CreateVolumesFromSnapshotTest-427214029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.131s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:22:50 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-af18b3b9-01c9-4c61-899e-f04790b620ff tempest-CreateVolumesFromSnapshotTest-427214029 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:22:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-364428622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af89e364-8dd7-43b7-85a0-bf758da22d84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46b4e87a01b34907a17529508487dd63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:22:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:22:49Z,use_quota=True,user_id='28e1bc3af6b4431dae418f3356a7078a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:22:50 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-af18b3b9-01c9-4c61-899e-f04790b620ff tempest-CreateVolumesFromSnapshotTest-427214029 None] Creating volume af89e364-8dd7-43b7-85a0-bf758da22d84 {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:22:50 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-af18b3b9-01c9-4c61-899e-f04790b620ff tempest-CreateVolumesFromSnapshotTest-427214029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:22:50 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-af18b3b9-01c9-4c61-899e-f04790b620ff tempest-CreateVolumesFromSnapshotTest-427214029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:22:50 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-af18b3b9-01c9-4c61-899e-f04790b620ff tempest-CreateVolumesFromSnapshotTest-427214029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:22:50 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-af18b3b9-01c9-4c61-899e-f04790b620ff tempest-CreateVolumesFromSnapshotTest-427214029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:22:50 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-af18b3b9-01c9-4c61-899e-f04790b620ff tempest-CreateVolumesFromSnapshotTest-427214029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:22:50 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-af18b3b9-01c9-4c61-899e-f04790b620ff tempest-CreateVolumesFromSnapshotTest-427214029 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:22:50 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-af18b3b9-01c9-4c61-899e-f04790b620ff tempest-CreateVolumesFromSnapshotTest-427214029 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:22:50 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-af18b3b9-01c9-4c61-899e-f04790b620ff tempest-CreateVolumesFromSnapshotTest-427214029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-af89e364-8dd7-43b7-85a0-bf758da22d84 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:50 devstack sudo[104386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-af89e364-8dd7-43b7-85a0-bf758da22d84 1073741824 Nov 02 10:22:50 devstack sudo[104386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:50 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-614c92f3-2083-49ef-8caa-8b17bf82b5d9 tempest-CreateVolumesFromSnapshotTest-427214029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e76500ca-986c-4b3e-97cb-ea0fc8f2111e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-731ffbb3-79d0-496b-b94f-17dd8db0e517', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:50 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-614c92f3-2083-49ef-8caa-8b17bf82b5d9 tempest-CreateVolumesFromSnapshotTest-427214029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8072ecc1-279e-4fb0-b62c-6db2f626bc2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:50 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-614c92f3-2083-49ef-8caa-8b17bf82b5d9 tempest-CreateVolumesFromSnapshotTest-427214029 None] Volume volume-731ffbb3-79d0-496b-b94f-17dd8db0e517 (731ffbb3-79d0-496b-b94f-17dd8db0e517): created successfully Nov 02 10:22:50 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-614c92f3-2083-49ef-8caa-8b17bf82b5d9 tempest-CreateVolumesFromSnapshotTest-427214029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8072ecc1-279e-4fb0-b62c-6db2f626bc2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:50 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-614c92f3-2083-49ef-8caa-8b17bf82b5d9 tempest-CreateVolumesFromSnapshotTest-427214029 None] Flow 'volume_create_manager' (cfd34454-54d7-4741-ab26-14a77bfeaa15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:22:50 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-614c92f3-2083-49ef-8caa-8b17bf82b5d9 tempest-CreateVolumesFromSnapshotTest-427214029 None] Created volume successfully. Nov 02 10:22:50 devstack sudo[104386]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:50 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-af18b3b9-01c9-4c61-899e-f04790b620ff tempest-CreateVolumesFromSnapshotTest-427214029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-af89e364-8dd7-43b7-85a0-bf758da22d84 1073741824" returned: 0 in 0.449s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:51 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-af18b3b9-01c9-4c61-899e-f04790b620ff tempest-CreateVolumesFromSnapshotTest-427214029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-af89e364-8dd7-43b7-85a0-bf758da22d84 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:51 devstack sudo[104392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-af89e364-8dd7-43b7-85a0-bf758da22d84 Nov 02 10:22:51 devstack sudo[104392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:51 devstack sudo[104392]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:51 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-af18b3b9-01c9-4c61-899e-f04790b620ff tempest-CreateVolumesFromSnapshotTest-427214029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-af89e364-8dd7-43b7-85a0-bf758da22d84" returned: 0 in 0.249s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:51 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-af18b3b9-01c9-4c61-899e-f04790b620ff tempest-CreateVolumesFromSnapshotTest-427214029 None] <== create_volume: return (743ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:22:51 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-af18b3b9-01c9-4c61-899e-f04790b620ff tempest-CreateVolumesFromSnapshotTest-427214029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.747s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:22:51 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-27c39d68-0e0d-416e-ae12-075bdf2c9158 tempest-CreateVolumesFromSnapshotTest-427214029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.331s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:22:51 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-27c39d68-0e0d-416e-ae12-075bdf2c9158 tempest-CreateVolumesFromSnapshotTest-427214029 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:22:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-664909371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1520340-283b-4fa5-88f8-b4239871f1e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46b4e87a01b34907a17529508487dd63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:22:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:22:50Z,use_quota=True,user_id='28e1bc3af6b4431dae418f3356a7078a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:22:51 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-27c39d68-0e0d-416e-ae12-075bdf2c9158 tempest-CreateVolumesFromSnapshotTest-427214029 None] Creating volume e1520340-283b-4fa5-88f8-b4239871f1e0 {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:22:51 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-27c39d68-0e0d-416e-ae12-075bdf2c9158 tempest-CreateVolumesFromSnapshotTest-427214029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:22:51 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-27c39d68-0e0d-416e-ae12-075bdf2c9158 tempest-CreateVolumesFromSnapshotTest-427214029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:22:51 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-27c39d68-0e0d-416e-ae12-075bdf2c9158 tempest-CreateVolumesFromSnapshotTest-427214029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:22:51 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-27c39d68-0e0d-416e-ae12-075bdf2c9158 tempest-CreateVolumesFromSnapshotTest-427214029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:22:51 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-27c39d68-0e0d-416e-ae12-075bdf2c9158 tempest-CreateVolumesFromSnapshotTest-427214029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:22:51 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-27c39d68-0e0d-416e-ae12-075bdf2c9158 tempest-CreateVolumesFromSnapshotTest-427214029 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:22:51 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-27c39d68-0e0d-416e-ae12-075bdf2c9158 tempest-CreateVolumesFromSnapshotTest-427214029 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:22:51 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-27c39d68-0e0d-416e-ae12-075bdf2c9158 tempest-CreateVolumesFromSnapshotTest-427214029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e1520340-283b-4fa5-88f8-b4239871f1e0 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:51 devstack sudo[104395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e1520340-283b-4fa5-88f8-b4239871f1e0 1073741824 Nov 02 10:22:51 devstack sudo[104395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:51 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-af18b3b9-01c9-4c61-899e-f04790b620ff tempest-CreateVolumesFromSnapshotTest-427214029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc0242d3-04f8-4fa8-a3ad-799c016b147a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af89e364-8dd7-43b7-85a0-bf758da22d84', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:51 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-af18b3b9-01c9-4c61-899e-f04790b620ff tempest-CreateVolumesFromSnapshotTest-427214029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50e56d2c-35b4-4e50-915f-9b04d4123a3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:51 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-af18b3b9-01c9-4c61-899e-f04790b620ff tempest-CreateVolumesFromSnapshotTest-427214029 None] Volume volume-af89e364-8dd7-43b7-85a0-bf758da22d84 (af89e364-8dd7-43b7-85a0-bf758da22d84): created successfully Nov 02 10:22:51 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-af18b3b9-01c9-4c61-899e-f04790b620ff tempest-CreateVolumesFromSnapshotTest-427214029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50e56d2c-35b4-4e50-915f-9b04d4123a3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:51 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-af18b3b9-01c9-4c61-899e-f04790b620ff tempest-CreateVolumesFromSnapshotTest-427214029 None] Flow 'volume_create_manager' (ad0e97b2-272c-4fc3-84f8-494719ebf049) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:22:51 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-af18b3b9-01c9-4c61-899e-f04790b620ff tempest-CreateVolumesFromSnapshotTest-427214029 None] Created volume successfully. Nov 02 10:22:51 devstack sudo[104395]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:51 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-27c39d68-0e0d-416e-ae12-075bdf2c9158 tempest-CreateVolumesFromSnapshotTest-427214029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e1520340-283b-4fa5-88f8-b4239871f1e0 1073741824" returned: 0 in 0.439s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:51 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-27c39d68-0e0d-416e-ae12-075bdf2c9158 tempest-CreateVolumesFromSnapshotTest-427214029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e1520340-283b-4fa5-88f8-b4239871f1e0 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:51 devstack sudo[104400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e1520340-283b-4fa5-88f8-b4239871f1e0 Nov 02 10:22:51 devstack sudo[104400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:51 devstack sudo[104400]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:51 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-27c39d68-0e0d-416e-ae12-075bdf2c9158 tempest-CreateVolumesFromSnapshotTest-427214029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e1520340-283b-4fa5-88f8-b4239871f1e0" returned: 0 in 0.250s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:52 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-27c39d68-0e0d-416e-ae12-075bdf2c9158 tempest-CreateVolumesFromSnapshotTest-427214029 None] <== create_volume: return (733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:22:52 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-27c39d68-0e0d-416e-ae12-075bdf2c9158 tempest-CreateVolumesFromSnapshotTest-427214029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.737s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:22:52 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-27c39d68-0e0d-416e-ae12-075bdf2c9158 tempest-CreateVolumesFromSnapshotTest-427214029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d4b192a-448e-4fa3-bef7-818b94aa5387) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1520340-283b-4fa5-88f8-b4239871f1e0', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:52 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-27c39d68-0e0d-416e-ae12-075bdf2c9158 tempest-CreateVolumesFromSnapshotTest-427214029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93a1e866-0601-458a-a7ce-8ab8655df148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:52 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-27c39d68-0e0d-416e-ae12-075bdf2c9158 tempest-CreateVolumesFromSnapshotTest-427214029 None] Volume volume-e1520340-283b-4fa5-88f8-b4239871f1e0 (e1520340-283b-4fa5-88f8-b4239871f1e0): created successfully Nov 02 10:22:52 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-27c39d68-0e0d-416e-ae12-075bdf2c9158 tempest-CreateVolumesFromSnapshotTest-427214029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93a1e866-0601-458a-a7ce-8ab8655df148) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:52 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-27c39d68-0e0d-416e-ae12-075bdf2c9158 tempest-CreateVolumesFromSnapshotTest-427214029 None] Flow 'volume_create_manager' (90cae788-fe1b-4bb6-9de2-aa8f3b0f2a39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:22:52 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-27c39d68-0e0d-416e-ae12-075bdf2c9158 tempest-CreateVolumesFromSnapshotTest-427214029 None] Created volume successfully. Nov 02 10:22:53 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-4aece304-0f53-4144-8b9e-adc04f1daaaa tempest-CreateVolumesFromSnapshotTest-427214029 None] Acquiring lock "cinder-e1520340-283b-4fa5-88f8-b4239871f1e0-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:22:53 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-4aece304-0f53-4144-8b9e-adc04f1daaaa tempest-CreateVolumesFromSnapshotTest-427214029 None] Lock "cinder-e1520340-283b-4fa5-88f8-b4239871f1e0-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:22:53 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-4aece304-0f53-4144-8b9e-adc04f1daaaa tempest-CreateVolumesFromSnapshotTest-427214029 None] Acquiring lock "cinder-quobyte-e1520340-283b-4fa5-88f8-b4239871f1e0" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:22:53 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-4aece304-0f53-4144-8b9e-adc04f1daaaa tempest-CreateVolumesFromSnapshotTest-427214029 None] Lock "cinder-quobyte-e1520340-283b-4fa5-88f8-b4239871f1e0" acquired by "delete_volume" :: waited 0.018s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:22:53 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[71dffcf8-0a99-4af6-9782-f2f2eac80f56]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:22:53 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-4aece304-0f53-4144-8b9e-adc04f1daaaa tempest-CreateVolumesFromSnapshotTest-427214029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e1520340-283b-4fa5-88f8-b4239871f1e0 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:53 devstack sudo[104403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e1520340-283b-4fa5-88f8-b4239871f1e0 Nov 02 10:22:53 devstack sudo[104403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:53 devstack sudo[104403]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:53 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-4aece304-0f53-4144-8b9e-adc04f1daaaa tempest-CreateVolumesFromSnapshotTest-427214029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e1520340-283b-4fa5-88f8-b4239871f1e0" returned: 0 in 0.409s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:53 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-4aece304-0f53-4144-8b9e-adc04f1daaaa tempest-CreateVolumesFromSnapshotTest-427214029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e1520340-283b-4fa5-88f8-b4239871f1e0 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:53 devstack sudo[104408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e1520340-283b-4fa5-88f8-b4239871f1e0 Nov 02 10:22:53 devstack sudo[104408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:53 devstack sudo[104408]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:53 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-4aece304-0f53-4144-8b9e-adc04f1daaaa tempest-CreateVolumesFromSnapshotTest-427214029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e1520340-283b-4fa5-88f8-b4239871f1e0" returned: 0 in 0.262s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:53 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-4aece304-0f53-4144-8b9e-adc04f1daaaa tempest-CreateVolumesFromSnapshotTest-427214029 None] Lock "cinder-quobyte-e1520340-283b-4fa5-88f8-b4239871f1e0" released by "delete_volume" :: held 0.709s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:22:54 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-4aece304-0f53-4144-8b9e-adc04f1daaaa tempest-CreateVolumesFromSnapshotTest-427214029 None] Created reservations ['53a468bb-22a7-4c80-809b-9d66b0a61c86', '7eee1085-3469-4561-a9b5-755453e92d68', 'a99073bb-e0c9-4f8b-a07c-189b9c239562', 'afd797ef-d791-467b-803b-33276d962ff0'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:22:54 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-4aece304-0f53-4144-8b9e-adc04f1daaaa tempest-CreateVolumesFromSnapshotTest-427214029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:22:54 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-4aece304-0f53-4144-8b9e-adc04f1daaaa tempest-CreateVolumesFromSnapshotTest-427214029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:22:54 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-4aece304-0f53-4144-8b9e-adc04f1daaaa tempest-CreateVolumesFromSnapshotTest-427214029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:22:54 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-4aece304-0f53-4144-8b9e-adc04f1daaaa tempest-CreateVolumesFromSnapshotTest-427214029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:22:54 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-4aece304-0f53-4144-8b9e-adc04f1daaaa tempest-CreateVolumesFromSnapshotTest-427214029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:22:54 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-4aece304-0f53-4144-8b9e-adc04f1daaaa tempest-CreateVolumesFromSnapshotTest-427214029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:54 devstack sudo[104412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:22:54 devstack sudo[104412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:54 devstack sudo[104412]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:54 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-2a1db05e-7749-4cff-a2d7-4b4fb3bd1dcc tempest-CreateVolumesFromSnapshotTest-427214029 None] Acquiring lock "cinder-af89e364-8dd7-43b7-85a0-bf758da22d84-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:22:54 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-4aece304-0f53-4144-8b9e-adc04f1daaaa tempest-CreateVolumesFromSnapshotTest-427214029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.267s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:54 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-4aece304-0f53-4144-8b9e-adc04f1daaaa tempest-CreateVolumesFromSnapshotTest-427214029 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:22:54 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-4aece304-0f53-4144-8b9e-adc04f1daaaa tempest-CreateVolumesFromSnapshotTest-427214029 None] Deleted volume successfully. Nov 02 10:22:54 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-2a1db05e-7749-4cff-a2d7-4b4fb3bd1dcc tempest-CreateVolumesFromSnapshotTest-427214029 None] Lock "cinder-af89e364-8dd7-43b7-85a0-bf758da22d84-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:22:54 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-4aece304-0f53-4144-8b9e-adc04f1daaaa tempest-CreateVolumesFromSnapshotTest-427214029 None] Lock "cinder-e1520340-283b-4fa5-88f8-b4239871f1e0-delete_volume" released by "delete_volume" :: held 1.206s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:22:54 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-2a1db05e-7749-4cff-a2d7-4b4fb3bd1dcc tempest-CreateVolumesFromSnapshotTest-427214029 None] Acquiring lock "cinder-quobyte-af89e364-8dd7-43b7-85a0-bf758da22d84" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:22:54 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-2a1db05e-7749-4cff-a2d7-4b4fb3bd1dcc tempest-CreateVolumesFromSnapshotTest-427214029 None] Lock "cinder-quobyte-af89e364-8dd7-43b7-85a0-bf758da22d84" acquired by "delete_volume" :: waited 0.014s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:22:54 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[0da87963-469b-452c-9649-0ce1c3b2bb8f]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:22:54 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-2a1db05e-7749-4cff-a2d7-4b4fb3bd1dcc tempest-CreateVolumesFromSnapshotTest-427214029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-af89e364-8dd7-43b7-85a0-bf758da22d84 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:54 devstack sudo[104415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-af89e364-8dd7-43b7-85a0-bf758da22d84 Nov 02 10:22:54 devstack sudo[104415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:54 devstack sudo[104415]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:54 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-2a1db05e-7749-4cff-a2d7-4b4fb3bd1dcc tempest-CreateVolumesFromSnapshotTest-427214029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-af89e364-8dd7-43b7-85a0-bf758da22d84" returned: 0 in 0.375s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:54 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-2a1db05e-7749-4cff-a2d7-4b4fb3bd1dcc tempest-CreateVolumesFromSnapshotTest-427214029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-af89e364-8dd7-43b7-85a0-bf758da22d84 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:54 devstack sudo[104420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-af89e364-8dd7-43b7-85a0-bf758da22d84 Nov 02 10:22:54 devstack sudo[104420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:55 devstack sudo[104420]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:55 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-2a1db05e-7749-4cff-a2d7-4b4fb3bd1dcc tempest-CreateVolumesFromSnapshotTest-427214029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-af89e364-8dd7-43b7-85a0-bf758da22d84" returned: 0 in 0.252s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:55 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-2a1db05e-7749-4cff-a2d7-4b4fb3bd1dcc tempest-CreateVolumesFromSnapshotTest-427214029 None] Lock "cinder-quobyte-af89e364-8dd7-43b7-85a0-bf758da22d84" released by "delete_volume" :: held 0.669s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:22:55 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-2a1db05e-7749-4cff-a2d7-4b4fb3bd1dcc tempest-CreateVolumesFromSnapshotTest-427214029 None] Created reservations ['e4ee8946-1b25-4784-9d6b-b5778ebec9b3', '6e488e6a-3ea2-47bc-9ca2-fd2a8a28fe11', '5b5db976-7878-439f-ac40-5ee5eaa58b48', '3ca9f83b-51a7-439a-b28f-a0c7bac57117'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:22:55 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-2a1db05e-7749-4cff-a2d7-4b4fb3bd1dcc tempest-CreateVolumesFromSnapshotTest-427214029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:22:55 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-2a1db05e-7749-4cff-a2d7-4b4fb3bd1dcc tempest-CreateVolumesFromSnapshotTest-427214029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:22:55 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-2a1db05e-7749-4cff-a2d7-4b4fb3bd1dcc tempest-CreateVolumesFromSnapshotTest-427214029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:22:55 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-2a1db05e-7749-4cff-a2d7-4b4fb3bd1dcc tempest-CreateVolumesFromSnapshotTest-427214029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:22:55 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-2a1db05e-7749-4cff-a2d7-4b4fb3bd1dcc tempest-CreateVolumesFromSnapshotTest-427214029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:22:55 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-2a1db05e-7749-4cff-a2d7-4b4fb3bd1dcc tempest-CreateVolumesFromSnapshotTest-427214029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:55 devstack sudo[104423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:22:55 devstack sudo[104423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:55 devstack sudo[104423]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:55 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-2a1db05e-7749-4cff-a2d7-4b4fb3bd1dcc tempest-CreateVolumesFromSnapshotTest-427214029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.262s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:55 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-2a1db05e-7749-4cff-a2d7-4b4fb3bd1dcc tempest-CreateVolumesFromSnapshotTest-427214029 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:22:55 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-2a1db05e-7749-4cff-a2d7-4b4fb3bd1dcc tempest-CreateVolumesFromSnapshotTest-427214029 None] Deleted volume successfully. Nov 02 10:22:55 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-2a1db05e-7749-4cff-a2d7-4b4fb3bd1dcc tempest-CreateVolumesFromSnapshotTest-427214029 None] Lock "cinder-af89e364-8dd7-43b7-85a0-bf758da22d84-delete_volume" released by "delete_volume" :: held 1.138s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:22:55 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-a79b43a5-908c-4357-8443-6f50ee1acc8c tempest-CreateVolumesFromSnapshotTest-427214029 None] Acquiring lock "cinder-731ffbb3-79d0-496b-b94f-17dd8db0e517-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:22:55 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-a79b43a5-908c-4357-8443-6f50ee1acc8c tempest-CreateVolumesFromSnapshotTest-427214029 None] Lock "cinder-731ffbb3-79d0-496b-b94f-17dd8db0e517-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:22:55 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-a79b43a5-908c-4357-8443-6f50ee1acc8c tempest-CreateVolumesFromSnapshotTest-427214029 None] Acquiring lock "cinder-quobyte-731ffbb3-79d0-496b-b94f-17dd8db0e517" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:22:55 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-a79b43a5-908c-4357-8443-6f50ee1acc8c tempest-CreateVolumesFromSnapshotTest-427214029 None] Lock "cinder-quobyte-731ffbb3-79d0-496b-b94f-17dd8db0e517" acquired by "delete_volume" :: waited 0.014s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:22:55 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[712ee18c-1628-4d85-af8c-913004363e91]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:22:55 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a79b43a5-908c-4357-8443-6f50ee1acc8c tempest-CreateVolumesFromSnapshotTest-427214029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-731ffbb3-79d0-496b-b94f-17dd8db0e517 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:55 devstack sudo[104426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-731ffbb3-79d0-496b-b94f-17dd8db0e517 Nov 02 10:22:55 devstack sudo[104426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:56 devstack sudo[104426]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:56 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a79b43a5-908c-4357-8443-6f50ee1acc8c tempest-CreateVolumesFromSnapshotTest-427214029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-731ffbb3-79d0-496b-b94f-17dd8db0e517" returned: 0 in 0.382s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:56 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a79b43a5-908c-4357-8443-6f50ee1acc8c tempest-CreateVolumesFromSnapshotTest-427214029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-731ffbb3-79d0-496b-b94f-17dd8db0e517 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:56 devstack sudo[104431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-731ffbb3-79d0-496b-b94f-17dd8db0e517 Nov 02 10:22:56 devstack sudo[104431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:56 devstack sudo[104431]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:56 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a79b43a5-908c-4357-8443-6f50ee1acc8c tempest-CreateVolumesFromSnapshotTest-427214029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-731ffbb3-79d0-496b-b94f-17dd8db0e517" returned: 0 in 0.256s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:56 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-a79b43a5-908c-4357-8443-6f50ee1acc8c tempest-CreateVolumesFromSnapshotTest-427214029 None] Lock "cinder-quobyte-731ffbb3-79d0-496b-b94f-17dd8db0e517" released by "delete_volume" :: held 0.683s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:22:56 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-a79b43a5-908c-4357-8443-6f50ee1acc8c tempest-CreateVolumesFromSnapshotTest-427214029 None] Created reservations ['c3fdb7d8-7936-4342-a400-c6f99a867291', 'e6c44264-3b43-45f1-a2f7-5648f2e29368', '4b3bc9a5-5607-434c-8b34-e65c3f09e652', '51c63ece-11f1-4e31-8816-dc93e2244f20'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:22:56 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-a79b43a5-908c-4357-8443-6f50ee1acc8c tempest-CreateVolumesFromSnapshotTest-427214029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:22:56 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-a79b43a5-908c-4357-8443-6f50ee1acc8c tempest-CreateVolumesFromSnapshotTest-427214029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:22:56 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-a79b43a5-908c-4357-8443-6f50ee1acc8c tempest-CreateVolumesFromSnapshotTest-427214029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:22:56 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-a79b43a5-908c-4357-8443-6f50ee1acc8c tempest-CreateVolumesFromSnapshotTest-427214029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:22:56 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-a79b43a5-908c-4357-8443-6f50ee1acc8c tempest-CreateVolumesFromSnapshotTest-427214029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:22:56 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a79b43a5-908c-4357-8443-6f50ee1acc8c tempest-CreateVolumesFromSnapshotTest-427214029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:56 devstack sudo[104434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:22:56 devstack sudo[104434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:56 devstack sudo[104434]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:56 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a79b43a5-908c-4357-8443-6f50ee1acc8c tempest-CreateVolumesFromSnapshotTest-427214029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.247s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:56 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-a79b43a5-908c-4357-8443-6f50ee1acc8c tempest-CreateVolumesFromSnapshotTest-427214029 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:22:56 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-a79b43a5-908c-4357-8443-6f50ee1acc8c tempest-CreateVolumesFromSnapshotTest-427214029 None] Deleted volume successfully. Nov 02 10:22:56 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-a79b43a5-908c-4357-8443-6f50ee1acc8c tempest-CreateVolumesFromSnapshotTest-427214029 None] Lock "cinder-731ffbb3-79d0-496b-b94f-17dd8db0e517-delete_volume" released by "delete_volume" :: held 1.167s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:22:56 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-2ab9c8b1-7ed4-436c-9a81-0acdb443633a tempest-CreateVolumesFromSnapshotTest-427214029 None] Acquiring lock "cinder-a78e9d70-e9f5-4bf4-8506-ed43eba3ff09-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:22:56 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-2ab9c8b1-7ed4-436c-9a81-0acdb443633a tempest-CreateVolumesFromSnapshotTest-427214029 None] Lock "cinder-a78e9d70-e9f5-4bf4-8506-ed43eba3ff09-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:22:56 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-2ab9c8b1-7ed4-436c-9a81-0acdb443633a tempest-CreateVolumesFromSnapshotTest-427214029 None] Acquiring lock "cinder-quobyte-a78e9d70-e9f5-4bf4-8506-ed43eba3ff09" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:22:56 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-2ab9c8b1-7ed4-436c-9a81-0acdb443633a tempest-CreateVolumesFromSnapshotTest-427214029 None] Lock "cinder-quobyte-a78e9d70-e9f5-4bf4-8506-ed43eba3ff09" acquired by "delete_volume" :: waited 0.015s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:22:56 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[43ec761c-2388-4999-9999-0552ca01d43a]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:22:56 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-2ab9c8b1-7ed4-436c-9a81-0acdb443633a tempest-CreateVolumesFromSnapshotTest-427214029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-a78e9d70-e9f5-4bf4-8506-ed43eba3ff09 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:56 devstack sudo[104437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-a78e9d70-e9f5-4bf4-8506-ed43eba3ff09 Nov 02 10:22:56 devstack sudo[104437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:57 devstack sudo[104437]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:57 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-2ab9c8b1-7ed4-436c-9a81-0acdb443633a tempest-CreateVolumesFromSnapshotTest-427214029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-a78e9d70-e9f5-4bf4-8506-ed43eba3ff09" returned: 0 in 0.349s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:57 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-2ab9c8b1-7ed4-436c-9a81-0acdb443633a tempest-CreateVolumesFromSnapshotTest-427214029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-a78e9d70-e9f5-4bf4-8506-ed43eba3ff09 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:57 devstack sudo[104442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-a78e9d70-e9f5-4bf4-8506-ed43eba3ff09 Nov 02 10:22:57 devstack sudo[104442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:57 devstack sudo[104442]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:57 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-2ab9c8b1-7ed4-436c-9a81-0acdb443633a tempest-CreateVolumesFromSnapshotTest-427214029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-a78e9d70-e9f5-4bf4-8506-ed43eba3ff09" returned: 0 in 0.255s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:57 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-2ab9c8b1-7ed4-436c-9a81-0acdb443633a tempest-CreateVolumesFromSnapshotTest-427214029 None] Lock "cinder-quobyte-a78e9d70-e9f5-4bf4-8506-ed43eba3ff09" released by "delete_volume" :: held 0.647s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:22:57 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-2ab9c8b1-7ed4-436c-9a81-0acdb443633a tempest-CreateVolumesFromSnapshotTest-427214029 None] Created reservations ['b204dfcc-125d-4086-a778-c98d2b137958', '44b365c8-76ef-4d1c-9d6e-675342f09c24', '8218e380-81d1-4018-b7cf-2cd9d684899d', 'ffc6c202-e9cc-4590-a98b-26e03f3c6672'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:22:57 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-2ab9c8b1-7ed4-436c-9a81-0acdb443633a tempest-CreateVolumesFromSnapshotTest-427214029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:22:57 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-2ab9c8b1-7ed4-436c-9a81-0acdb443633a tempest-CreateVolumesFromSnapshotTest-427214029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:22:57 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-2ab9c8b1-7ed4-436c-9a81-0acdb443633a tempest-CreateVolumesFromSnapshotTest-427214029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:22:57 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-2ab9c8b1-7ed4-436c-9a81-0acdb443633a tempest-CreateVolumesFromSnapshotTest-427214029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:22:57 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-2ab9c8b1-7ed4-436c-9a81-0acdb443633a tempest-CreateVolumesFromSnapshotTest-427214029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:22:57 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-2ab9c8b1-7ed4-436c-9a81-0acdb443633a tempest-CreateVolumesFromSnapshotTest-427214029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:57 devstack sudo[104445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:22:57 devstack sudo[104445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:57 devstack sudo[104445]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:57 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-2ab9c8b1-7ed4-436c-9a81-0acdb443633a tempest-CreateVolumesFromSnapshotTest-427214029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.250s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:57 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-2ab9c8b1-7ed4-436c-9a81-0acdb443633a tempest-CreateVolumesFromSnapshotTest-427214029 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:22:57 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-2ab9c8b1-7ed4-436c-9a81-0acdb443633a tempest-CreateVolumesFromSnapshotTest-427214029 None] Deleted volume successfully. Nov 02 10:22:57 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-2ab9c8b1-7ed4-436c-9a81-0acdb443633a tempest-CreateVolumesFromSnapshotTest-427214029 None] Lock "cinder-a78e9d70-e9f5-4bf4-8506-ed43eba3ff09-delete_volume" released by "delete_volume" :: held 1.094s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:22:57 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-336ab97d-ddf1-4449-8e16-3af9a951f519 tempest-CreateVolumesFromSnapshotTest-427214029 None] Acquiring lock "cinder-2e3defbe-464f-44f8-bcd2-1587526b29f1-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:22:57 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-336ab97d-ddf1-4449-8e16-3af9a951f519 tempest-CreateVolumesFromSnapshotTest-427214029 None] Lock "cinder-2e3defbe-464f-44f8-bcd2-1587526b29f1-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:22:57 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-336ab97d-ddf1-4449-8e16-3af9a951f519 tempest-CreateVolumesFromSnapshotTest-427214029 None] Acquiring lock "cinder-quobyte-2e3defbe-464f-44f8-bcd2-1587526b29f1" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:22:57 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-336ab97d-ddf1-4449-8e16-3af9a951f519 tempest-CreateVolumesFromSnapshotTest-427214029 None] Lock "cinder-quobyte-2e3defbe-464f-44f8-bcd2-1587526b29f1" acquired by "delete_volume" :: waited 0.018s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:22:57 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e3a34a8-155c-4f29-8fd4-1b977afd3636]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:22:57 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-336ab97d-ddf1-4449-8e16-3af9a951f519 tempest-CreateVolumesFromSnapshotTest-427214029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-2e3defbe-464f-44f8-bcd2-1587526b29f1 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:58 devstack sudo[104448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-2e3defbe-464f-44f8-bcd2-1587526b29f1 Nov 02 10:22:58 devstack sudo[104448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:58 devstack sudo[104448]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:58 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-336ab97d-ddf1-4449-8e16-3af9a951f519 tempest-CreateVolumesFromSnapshotTest-427214029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-2e3defbe-464f-44f8-bcd2-1587526b29f1" returned: 0 in 0.353s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:58 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-336ab97d-ddf1-4449-8e16-3af9a951f519 tempest-CreateVolumesFromSnapshotTest-427214029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-2e3defbe-464f-44f8-bcd2-1587526b29f1 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:58 devstack sudo[104453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-2e3defbe-464f-44f8-bcd2-1587526b29f1 Nov 02 10:22:58 devstack sudo[104453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:58 devstack sudo[104453]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:58 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-336ab97d-ddf1-4449-8e16-3af9a951f519 tempest-CreateVolumesFromSnapshotTest-427214029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-2e3defbe-464f-44f8-bcd2-1587526b29f1" returned: 0 in 0.243s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:58 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-336ab97d-ddf1-4449-8e16-3af9a951f519 tempest-CreateVolumesFromSnapshotTest-427214029 None] Lock "cinder-quobyte-2e3defbe-464f-44f8-bcd2-1587526b29f1" released by "delete_volume" :: held 0.636s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:22:58 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-336ab97d-ddf1-4449-8e16-3af9a951f519 tempest-CreateVolumesFromSnapshotTest-427214029 None] Created reservations ['cf44948d-c1d4-4ec1-93c7-65cd15aa1304', 'd4b165cf-62f5-44ac-93f5-9d33131febd7', 'd5dbae3a-a997-4f4a-825a-828a9c52e915', '9349aa88-3c15-4aff-a0c4-b6f3ce10e42d'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:22:58 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-336ab97d-ddf1-4449-8e16-3af9a951f519 tempest-CreateVolumesFromSnapshotTest-427214029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:22:58 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-336ab97d-ddf1-4449-8e16-3af9a951f519 tempest-CreateVolumesFromSnapshotTest-427214029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:22:58 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-336ab97d-ddf1-4449-8e16-3af9a951f519 tempest-CreateVolumesFromSnapshotTest-427214029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:22:58 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-336ab97d-ddf1-4449-8e16-3af9a951f519 tempest-CreateVolumesFromSnapshotTest-427214029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:22:58 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-336ab97d-ddf1-4449-8e16-3af9a951f519 tempest-CreateVolumesFromSnapshotTest-427214029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:22:58 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-336ab97d-ddf1-4449-8e16-3af9a951f519 tempest-CreateVolumesFromSnapshotTest-427214029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:58 devstack sudo[104456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:22:58 devstack sudo[104456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:58 devstack sudo[104456]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:58 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-336ab97d-ddf1-4449-8e16-3af9a951f519 tempest-CreateVolumesFromSnapshotTest-427214029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.230s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:58 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-336ab97d-ddf1-4449-8e16-3af9a951f519 tempest-CreateVolumesFromSnapshotTest-427214029 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:22:58 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-336ab97d-ddf1-4449-8e16-3af9a951f519 tempest-CreateVolumesFromSnapshotTest-427214029 None] Deleted volume successfully. Nov 02 10:22:58 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-336ab97d-ddf1-4449-8e16-3af9a951f519 tempest-CreateVolumesFromSnapshotTest-427214029 None] Lock "cinder-2e3defbe-464f-44f8-bcd2-1587526b29f1-delete_volume" released by "delete_volume" :: held 1.077s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:22:59 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-4722cbe5-2757-4702-bdf4-f761c6046f08 tempest-CreateVolumesFromSnapshotTest-427214029 None] Acquiring lock "cinder-c0c7b33e-0045-4d29-a59b-21b354b84a7c-delete_snapshot" by "delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:22:59 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-4722cbe5-2757-4702-bdf4-f761c6046f08 tempest-CreateVolumesFromSnapshotTest-427214029 None] Lock "cinder-c0c7b33e-0045-4d29-a59b-21b354b84a7c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:22:59 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-4722cbe5-2757-4702-bdf4-f761c6046f08 tempest-CreateVolumesFromSnapshotTest-427214029 None] Acquiring lock "cinder-quobyte-c9d7d030-cefa-4286-b766-eadfa8d93aee" by "delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:22:59 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-4722cbe5-2757-4702-bdf4-f761c6046f08 tempest-CreateVolumesFromSnapshotTest-427214029 None] Lock "cinder-quobyte-c9d7d030-cefa-4286-b766-eadfa8d93aee" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:22:59 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-4722cbe5-2757-4702-bdf4-f761c6046f08 tempest-CreateVolumesFromSnapshotTest-427214029 None] Acquiring lock "cinder-quobyte-c0c7b33e-0045-4d29-a59b-21b354b84a7c" by "_delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:22:59 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-4722cbe5-2757-4702-bdf4-f761c6046f08 tempest-CreateVolumesFromSnapshotTest-427214029 None] Lock "cinder-quobyte-c0c7b33e-0045-4d29-a59b-21b354b84a7c" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:22:59 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-4722cbe5-2757-4702-bdf4-f761c6046f08 tempest-CreateVolumesFromSnapshotTest-427214029 None] Deleting offline snapshot c0c7b33e-0045-4d29-a59b-21b354b84a7c of volume c9d7d030-cefa-4286-b766-eadfa8d93aee {{(pid=86890) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:22:59 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-4722cbe5-2757-4702-bdf4-f761c6046f08 tempest-CreateVolumesFromSnapshotTest-427214029 None] snapshot_file for this snap is: volume-c9d7d030-cefa-4286-b766-eadfa8d93aee.c0c7b33e-0045-4d29-a59b-21b354b84a7c {{(pid=86890) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:22:59 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1fc6186-a528-4920-8548-e35183c4929d]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:22:59 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-4722cbe5-2757-4702-bdf4-f761c6046f08 tempest-CreateVolumesFromSnapshotTest-427214029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-c9d7d030-cefa-4286-b766-eadfa8d93aee.c0c7b33e-0045-4d29-a59b-21b354b84a7c {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:59 devstack sudo[104459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-c9d7d030-cefa-4286-b766-eadfa8d93aee.c0c7b33e-0045-4d29-a59b-21b354b84a7c Nov 02 10:22:59 devstack sudo[104459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:59 devstack sudo[104459]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:59 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-4722cbe5-2757-4702-bdf4-f761c6046f08 tempest-CreateVolumesFromSnapshotTest-427214029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-c9d7d030-cefa-4286-b766-eadfa8d93aee.c0c7b33e-0045-4d29-a59b-21b354b84a7c" returned: 0 in 0.348s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:59 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-4722cbe5-2757-4702-bdf4-f761c6046f08 tempest-CreateVolumesFromSnapshotTest-427214029 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c9d7d030-cefa-4286-b766-eadfa8d93aee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86890) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:22:59 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b791de7-2332-42cd-a13d-8c921c6aa73a]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:22:59 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-4722cbe5-2757-4702-bdf4-f761c6046f08 tempest-CreateVolumesFromSnapshotTest-427214029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-c9d7d030-cefa-4286-b766-eadfa8d93aee {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:59 devstack sudo[104464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-c9d7d030-cefa-4286-b766-eadfa8d93aee Nov 02 10:22:59 devstack sudo[104464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:59 devstack sudo[104464]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:59 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-4722cbe5-2757-4702-bdf4-f761c6046f08 tempest-CreateVolumesFromSnapshotTest-427214029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-c9d7d030-cefa-4286-b766-eadfa8d93aee" returned: 0 in 0.343s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:59 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-4722cbe5-2757-4702-bdf4-f761c6046f08 tempest-CreateVolumesFromSnapshotTest-427214029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-c9d7d030-cefa-4286-b766-eadfa8d93aee.c0c7b33e-0045-4d29-a59b-21b354b84a7c {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:59 devstack sudo[104469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-c9d7d030-cefa-4286-b766-eadfa8d93aee.c0c7b33e-0045-4d29-a59b-21b354b84a7c Nov 02 10:22:59 devstack sudo[104469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:00 devstack sudo[104469]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:00 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-4722cbe5-2757-4702-bdf4-f761c6046f08 tempest-CreateVolumesFromSnapshotTest-427214029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-c9d7d030-cefa-4286-b766-eadfa8d93aee.c0c7b33e-0045-4d29-a59b-21b354b84a7c" returned: 0 in 0.333s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:00 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-4722cbe5-2757-4702-bdf4-f761c6046f08 tempest-CreateVolumesFromSnapshotTest-427214029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-c9d7d030-cefa-4286-b766-eadfa8d93aee.c0c7b33e-0045-4d29-a59b-21b354b84a7c {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:00 devstack sudo[104475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-c9d7d030-cefa-4286-b766-eadfa8d93aee.c0c7b33e-0045-4d29-a59b-21b354b84a7c Nov 02 10:23:00 devstack sudo[104475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:00 devstack sudo[104475]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:00 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-4722cbe5-2757-4702-bdf4-f761c6046f08 tempest-CreateVolumesFromSnapshotTest-427214029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-c9d7d030-cefa-4286-b766-eadfa8d93aee.c0c7b33e-0045-4d29-a59b-21b354b84a7c" returned: 0 in 0.235s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:00 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-4722cbe5-2757-4702-bdf4-f761c6046f08 tempest-CreateVolumesFromSnapshotTest-427214029 None] Lock "cinder-quobyte-c0c7b33e-0045-4d29-a59b-21b354b84a7c" released by "_delete_snapshot" :: held 1.361s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:23:00 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-4722cbe5-2757-4702-bdf4-f761c6046f08 tempest-CreateVolumesFromSnapshotTest-427214029 None] Lock "cinder-quobyte-c9d7d030-cefa-4286-b766-eadfa8d93aee" released by "delete_snapshot" :: held 1.387s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:23:00 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-4722cbe5-2757-4702-bdf4-f761c6046f08 tempest-CreateVolumesFromSnapshotTest-427214029 None] Created reservations ['e2f4b406-8023-45a5-8cef-57cca148fe3e', 'f2c2ac56-6e58-43ca-ab47-98e747e48798', '2ddbe484-879f-429a-8c02-408d26cc25ca', 'ed486122-f423-40cf-a8a4-740039d1795f'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:23:00 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-4722cbe5-2757-4702-bdf4-f761c6046f08 tempest-CreateVolumesFromSnapshotTest-427214029 None] Delete snapshot completed successfully. Nov 02 10:23:00 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-4722cbe5-2757-4702-bdf4-f761c6046f08 tempest-CreateVolumesFromSnapshotTest-427214029 None] Lock "cinder-c0c7b33e-0045-4d29-a59b-21b354b84a7c-delete_snapshot" released by "delete_snapshot" :: held 1.522s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:23:01 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-951818bd-5a76-458a-96a7-b55135b1b0fc tempest-CreateVolumesFromSnapshotTest-427214029 None] Acquiring lock "cinder-c9d7d030-cefa-4286-b766-eadfa8d93aee-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:23:01 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-951818bd-5a76-458a-96a7-b55135b1b0fc tempest-CreateVolumesFromSnapshotTest-427214029 None] Lock "cinder-c9d7d030-cefa-4286-b766-eadfa8d93aee-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:23:01 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-951818bd-5a76-458a-96a7-b55135b1b0fc tempest-CreateVolumesFromSnapshotTest-427214029 None] Acquiring lock "cinder-quobyte-c9d7d030-cefa-4286-b766-eadfa8d93aee" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:23:01 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-951818bd-5a76-458a-96a7-b55135b1b0fc tempest-CreateVolumesFromSnapshotTest-427214029 None] Lock "cinder-quobyte-c9d7d030-cefa-4286-b766-eadfa8d93aee" acquired by "delete_volume" :: waited 0.020s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:23:01 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[19664957-34b2-4ad3-a8e0-6a1a240cb4cf]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:23:01 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-951818bd-5a76-458a-96a7-b55135b1b0fc tempest-CreateVolumesFromSnapshotTest-427214029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-c9d7d030-cefa-4286-b766-eadfa8d93aee {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:01 devstack sudo[104478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-c9d7d030-cefa-4286-b766-eadfa8d93aee Nov 02 10:23:01 devstack sudo[104478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:01 devstack sudo[104478]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:01 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-951818bd-5a76-458a-96a7-b55135b1b0fc tempest-CreateVolumesFromSnapshotTest-427214029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-c9d7d030-cefa-4286-b766-eadfa8d93aee" returned: 0 in 0.352s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:01 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-951818bd-5a76-458a-96a7-b55135b1b0fc tempest-CreateVolumesFromSnapshotTest-427214029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-c9d7d030-cefa-4286-b766-eadfa8d93aee {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:01 devstack sudo[104483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-c9d7d030-cefa-4286-b766-eadfa8d93aee Nov 02 10:23:01 devstack sudo[104483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:01 devstack sudo[104483]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:01 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-951818bd-5a76-458a-96a7-b55135b1b0fc tempest-CreateVolumesFromSnapshotTest-427214029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-c9d7d030-cefa-4286-b766-eadfa8d93aee" returned: 0 in 0.245s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:01 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-951818bd-5a76-458a-96a7-b55135b1b0fc tempest-CreateVolumesFromSnapshotTest-427214029 None] Lock "cinder-quobyte-c9d7d030-cefa-4286-b766-eadfa8d93aee" released by "delete_volume" :: held 0.655s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:23:01 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-951818bd-5a76-458a-96a7-b55135b1b0fc tempest-CreateVolumesFromSnapshotTest-427214029 None] Created reservations ['3b110648-d3fe-4855-8d4f-34e105d93234', '83d7bcf5-44ec-4fc6-ab2b-9fbfaf685f1f', 'efa8a144-1458-49bb-90b7-07135a4a5bdc', 'd94e4ee3-6c3e-4a7d-ac8f-c769fe1c5821'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:23:02 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-951818bd-5a76-458a-96a7-b55135b1b0fc tempest-CreateVolumesFromSnapshotTest-427214029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:23:02 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-951818bd-5a76-458a-96a7-b55135b1b0fc tempest-CreateVolumesFromSnapshotTest-427214029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:23:02 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-951818bd-5a76-458a-96a7-b55135b1b0fc tempest-CreateVolumesFromSnapshotTest-427214029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:23:02 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-951818bd-5a76-458a-96a7-b55135b1b0fc tempest-CreateVolumesFromSnapshotTest-427214029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:23:02 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-951818bd-5a76-458a-96a7-b55135b1b0fc tempest-CreateVolumesFromSnapshotTest-427214029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:23:02 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-951818bd-5a76-458a-96a7-b55135b1b0fc tempest-CreateVolumesFromSnapshotTest-427214029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:02 devstack sudo[104486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:23:02 devstack sudo[104486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:02 devstack sudo[104486]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:02 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-951818bd-5a76-458a-96a7-b55135b1b0fc tempest-CreateVolumesFromSnapshotTest-427214029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.273s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:02 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-951818bd-5a76-458a-96a7-b55135b1b0fc tempest-CreateVolumesFromSnapshotTest-427214029 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:23:02 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-951818bd-5a76-458a-96a7-b55135b1b0fc tempest-CreateVolumesFromSnapshotTest-427214029 None] Deleted volume successfully. Nov 02 10:23:02 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-951818bd-5a76-458a-96a7-b55135b1b0fc tempest-CreateVolumesFromSnapshotTest-427214029 None] Lock "cinder-c9d7d030-cefa-4286-b766-eadfa8d93aee-delete_volume" released by "delete_volume" :: held 1.158s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:23:09 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-6358a799-6e98-4c50-a4fc-e12dc7b9fae5 tempest-ProjectReaderTests-1786041329 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:23:09 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-6358a799-6e98-4c50-a4fc-e12dc7b9fae5 tempest-ProjectReaderTests-1786041329 None] Flow 'volume_create_manager' (e0609a61-782e-4386-8a98-05a0003bf389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:23:09 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-6358a799-6e98-4c50-a4fc-e12dc7b9fae5 tempest-ProjectReaderTests-1786041329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (222005e3-ff0e-4421-872a-8ea60dcc9963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:09 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-6358a799-6e98-4c50-a4fc-e12dc7b9fae5 tempest-ProjectReaderTests-1786041329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (222005e3-ff0e-4421-872a-8ea60dcc9963) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:23:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-209600297',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1cdc704-5622-48fc-a873-3e950dc2076a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f95a8c5d36654c55b5befd9f9e0b5e3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:23:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:23:10Z,use_quota=True,user_id='20ba7347b12b4ece927570f2d2bf9fcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:09 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-6358a799-6e98-4c50-a4fc-e12dc7b9fae5 tempest-ProjectReaderTests-1786041329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a95a476f-8184-4427-a10d-80127f592d83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:09 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-6358a799-6e98-4c50-a4fc-e12dc7b9fae5 tempest-ProjectReaderTests-1786041329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a95a476f-8184-4427-a10d-80127f592d83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:09 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-6358a799-6e98-4c50-a4fc-e12dc7b9fae5 tempest-ProjectReaderTests-1786041329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fa0309b-b677-404b-a8a5-5bc82f0140b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:09 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-6358a799-6e98-4c50-a4fc-e12dc7b9fae5 tempest-ProjectReaderTests-1786041329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fa0309b-b677-404b-a8a5-5bc82f0140b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1cdc704-5622-48fc-a873-3e950dc2076a', 'volume_name': 'volume-d1cdc704-5622-48fc-a873-3e950dc2076a', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:09 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-6358a799-6e98-4c50-a4fc-e12dc7b9fae5 tempest-ProjectReaderTests-1786041329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21857263-6cc2-4aa6-80ca-981c342c94fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:09 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-6358a799-6e98-4c50-a4fc-e12dc7b9fae5 tempest-ProjectReaderTests-1786041329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21857263-6cc2-4aa6-80ca-981c342c94fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:09 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-6358a799-6e98-4c50-a4fc-e12dc7b9fae5 tempest-ProjectReaderTests-1786041329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65896ccb-d884-4d1a-82fb-738c86739e8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:09 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-6358a799-6e98-4c50-a4fc-e12dc7b9fae5 tempest-ProjectReaderTests-1786041329 None] Volume d1cdc704-5622-48fc-a873-3e950dc2076a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1cdc704-5622-48fc-a873-3e950dc2076a', 'volume_size': 1} Nov 02 10:23:09 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-6358a799-6e98-4c50-a4fc-e12dc7b9fae5 tempest-ProjectReaderTests-1786041329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:23:09 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-6358a799-6e98-4c50-a4fc-e12dc7b9fae5 tempest-ProjectReaderTests-1786041329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:23:09 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-6358a799-6e98-4c50-a4fc-e12dc7b9fae5 tempest-ProjectReaderTests-1786041329 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:23:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-209600297',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1cdc704-5622-48fc-a873-3e950dc2076a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f95a8c5d36654c55b5befd9f9e0b5e3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:23:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:23:10Z,use_quota=True,user_id='20ba7347b12b4ece927570f2d2bf9fcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:23:09 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-6358a799-6e98-4c50-a4fc-e12dc7b9fae5 tempest-ProjectReaderTests-1786041329 None] Creating volume d1cdc704-5622-48fc-a873-3e950dc2076a {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:23:09 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-6358a799-6e98-4c50-a4fc-e12dc7b9fae5 tempest-ProjectReaderTests-1786041329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:23:09 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-6358a799-6e98-4c50-a4fc-e12dc7b9fae5 tempest-ProjectReaderTests-1786041329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:23:09 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-6358a799-6e98-4c50-a4fc-e12dc7b9fae5 tempest-ProjectReaderTests-1786041329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:23:09 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-6358a799-6e98-4c50-a4fc-e12dc7b9fae5 tempest-ProjectReaderTests-1786041329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:23:09 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-6358a799-6e98-4c50-a4fc-e12dc7b9fae5 tempest-ProjectReaderTests-1786041329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:23:09 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-6358a799-6e98-4c50-a4fc-e12dc7b9fae5 tempest-ProjectReaderTests-1786041329 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:23:09 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-6358a799-6e98-4c50-a4fc-e12dc7b9fae5 tempest-ProjectReaderTests-1786041329 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:23:09 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6358a799-6e98-4c50-a4fc-e12dc7b9fae5 tempest-ProjectReaderTests-1786041329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-d1cdc704-5622-48fc-a873-3e950dc2076a 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:09 devstack sudo[104491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-d1cdc704-5622-48fc-a873-3e950dc2076a 1073741824 Nov 02 10:23:09 devstack sudo[104491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:10 devstack sudo[104491]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:10 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6358a799-6e98-4c50-a4fc-e12dc7b9fae5 tempest-ProjectReaderTests-1786041329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-d1cdc704-5622-48fc-a873-3e950dc2076a 1073741824" returned: 0 in 0.401s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:10 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6358a799-6e98-4c50-a4fc-e12dc7b9fae5 tempest-ProjectReaderTests-1786041329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-d1cdc704-5622-48fc-a873-3e950dc2076a {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:10 devstack sudo[104497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-d1cdc704-5622-48fc-a873-3e950dc2076a Nov 02 10:23:10 devstack sudo[104497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:10 devstack sudo[104497]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:10 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6358a799-6e98-4c50-a4fc-e12dc7b9fae5 tempest-ProjectReaderTests-1786041329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-d1cdc704-5622-48fc-a873-3e950dc2076a" returned: 0 in 0.236s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:10 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-6358a799-6e98-4c50-a4fc-e12dc7b9fae5 tempest-ProjectReaderTests-1786041329 None] <== create_volume: return (689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:23:10 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-6358a799-6e98-4c50-a4fc-e12dc7b9fae5 tempest-ProjectReaderTests-1786041329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.691s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:23:10 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-6358a799-6e98-4c50-a4fc-e12dc7b9fae5 tempest-ProjectReaderTests-1786041329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65896ccb-d884-4d1a-82fb-738c86739e8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1cdc704-5622-48fc-a873-3e950dc2076a', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:10 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-6358a799-6e98-4c50-a4fc-e12dc7b9fae5 tempest-ProjectReaderTests-1786041329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efb18593-0708-4536-980c-848a0ad1a02c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:10 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-6358a799-6e98-4c50-a4fc-e12dc7b9fae5 tempest-ProjectReaderTests-1786041329 None] Volume volume-d1cdc704-5622-48fc-a873-3e950dc2076a (d1cdc704-5622-48fc-a873-3e950dc2076a): created successfully Nov 02 10:23:10 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-6358a799-6e98-4c50-a4fc-e12dc7b9fae5 tempest-ProjectReaderTests-1786041329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efb18593-0708-4536-980c-848a0ad1a02c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:10 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-6358a799-6e98-4c50-a4fc-e12dc7b9fae5 tempest-ProjectReaderTests-1786041329 None] Flow 'volume_create_manager' (e0609a61-782e-4386-8a98-05a0003bf389) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:23:10 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-6358a799-6e98-4c50-a4fc-e12dc7b9fae5 tempest-ProjectReaderTests-1786041329 None] Created volume successfully. Nov 02 10:23:10 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-088abadc-198e-430c-b063-e26667086c8d tempest-ProjectReaderTests-1786041329 None] Acquiring lock "cinder-d1cdc704-5622-48fc-a873-3e950dc2076a-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:23:10 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-088abadc-198e-430c-b063-e26667086c8d tempest-ProjectReaderTests-1786041329 None] Lock "cinder-d1cdc704-5622-48fc-a873-3e950dc2076a-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:23:11 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-088abadc-198e-430c-b063-e26667086c8d tempest-ProjectReaderTests-1786041329 None] Acquiring lock "cinder-quobyte-d1cdc704-5622-48fc-a873-3e950dc2076a" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:23:11 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-088abadc-198e-430c-b063-e26667086c8d tempest-ProjectReaderTests-1786041329 None] Lock "cinder-quobyte-d1cdc704-5622-48fc-a873-3e950dc2076a" acquired by "delete_volume" :: waited 0.012s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:23:11 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7a90de0-8de4-4d19-a1b6-63574edb1af1]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:23:11 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-088abadc-198e-430c-b063-e26667086c8d tempest-ProjectReaderTests-1786041329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-d1cdc704-5622-48fc-a873-3e950dc2076a {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:11 devstack sudo[104502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-d1cdc704-5622-48fc-a873-3e950dc2076a Nov 02 10:23:11 devstack sudo[104502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:11 devstack sudo[104502]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:11 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-088abadc-198e-430c-b063-e26667086c8d tempest-ProjectReaderTests-1786041329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-d1cdc704-5622-48fc-a873-3e950dc2076a" returned: 0 in 0.353s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:11 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-088abadc-198e-430c-b063-e26667086c8d tempest-ProjectReaderTests-1786041329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-d1cdc704-5622-48fc-a873-3e950dc2076a {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:11 devstack sudo[104507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-d1cdc704-5622-48fc-a873-3e950dc2076a Nov 02 10:23:11 devstack sudo[104507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:11 devstack sudo[104507]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:11 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-088abadc-198e-430c-b063-e26667086c8d tempest-ProjectReaderTests-1786041329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-d1cdc704-5622-48fc-a873-3e950dc2076a" returned: 0 in 0.250s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:11 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-088abadc-198e-430c-b063-e26667086c8d tempest-ProjectReaderTests-1786041329 None] Lock "cinder-quobyte-d1cdc704-5622-48fc-a873-3e950dc2076a" released by "delete_volume" :: held 0.643s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:23:11 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-088abadc-198e-430c-b063-e26667086c8d tempest-ProjectReaderTests-1786041329 None] Created reservations ['9b29c1a8-2aaa-4127-9eb6-c5b4c2433b9b', '8a1eff79-4d1f-40fc-8ba3-53180a6d1286', '89944578-0b53-4809-b4db-c8ed2f1eb5e7', '6348a816-89f7-4841-b40e-cbbd54ba7d4b'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:23:11 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-088abadc-198e-430c-b063-e26667086c8d tempest-ProjectReaderTests-1786041329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:23:11 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-088abadc-198e-430c-b063-e26667086c8d tempest-ProjectReaderTests-1786041329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:23:11 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-088abadc-198e-430c-b063-e26667086c8d tempest-ProjectReaderTests-1786041329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:23:11 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-088abadc-198e-430c-b063-e26667086c8d tempest-ProjectReaderTests-1786041329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:23:11 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-088abadc-198e-430c-b063-e26667086c8d tempest-ProjectReaderTests-1786041329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:23:11 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-088abadc-198e-430c-b063-e26667086c8d tempest-ProjectReaderTests-1786041329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:11 devstack sudo[104510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:23:11 devstack sudo[104510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:12 devstack sudo[104510]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:12 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-088abadc-198e-430c-b063-e26667086c8d tempest-ProjectReaderTests-1786041329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.237s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:12 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-088abadc-198e-430c-b063-e26667086c8d tempest-ProjectReaderTests-1786041329 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:23:12 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-088abadc-198e-430c-b063-e26667086c8d tempest-ProjectReaderTests-1786041329 None] Deleted volume successfully. Nov 02 10:23:12 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-088abadc-198e-430c-b063-e26667086c8d tempest-ProjectReaderTests-1786041329 None] Lock "cinder-d1cdc704-5622-48fc-a873-3e950dc2076a-delete_volume" released by "delete_volume" :: held 1.083s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:23:12 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e3f2678-816f-4aea-babd-21905e09b549 tempest-ProjectReaderTests-1786041329 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:23:12 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-9e3f2678-816f-4aea-babd-21905e09b549 tempest-ProjectReaderTests-1786041329 None] Flow 'volume_create_manager' (8ee61bae-3809-4188-bf56-bd54a2350a55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:23:12 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-9e3f2678-816f-4aea-babd-21905e09b549 tempest-ProjectReaderTests-1786041329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1f08ae7-b4d9-4a9b-a4fb-067166af5e1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:12 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-9e3f2678-816f-4aea-babd-21905e09b549 tempest-ProjectReaderTests-1786041329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1f08ae7-b4d9-4a9b-a4fb-067166af5e1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:23:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-823196786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2868e1a3-1308-4895-a36c-99a52ea1a645,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f95a8c5d36654c55b5befd9f9e0b5e3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:23:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:23:12Z,use_quota=True,user_id='20ba7347b12b4ece927570f2d2bf9fcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:12 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-9e3f2678-816f-4aea-babd-21905e09b549 tempest-ProjectReaderTests-1786041329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c77266d2-812a-42a7-b5ce-604506edf8fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:12 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-9e3f2678-816f-4aea-babd-21905e09b549 tempest-ProjectReaderTests-1786041329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c77266d2-812a-42a7-b5ce-604506edf8fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:12 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-9e3f2678-816f-4aea-babd-21905e09b549 tempest-ProjectReaderTests-1786041329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7a889ec-4b06-4f33-9098-e00e527605e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:12 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-9e3f2678-816f-4aea-babd-21905e09b549 tempest-ProjectReaderTests-1786041329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7a889ec-4b06-4f33-9098-e00e527605e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2868e1a3-1308-4895-a36c-99a52ea1a645', 'volume_name': 'volume-2868e1a3-1308-4895-a36c-99a52ea1a645', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:12 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-9e3f2678-816f-4aea-babd-21905e09b549 tempest-ProjectReaderTests-1786041329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cccda3b-290e-4ca9-aef8-39cf066d64b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:12 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-9e3f2678-816f-4aea-babd-21905e09b549 tempest-ProjectReaderTests-1786041329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cccda3b-290e-4ca9-aef8-39cf066d64b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:12 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-9e3f2678-816f-4aea-babd-21905e09b549 tempest-ProjectReaderTests-1786041329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91331bbe-194e-4ea8-a091-0d440438ee35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:12 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-9e3f2678-816f-4aea-babd-21905e09b549 tempest-ProjectReaderTests-1786041329 None] Volume 2868e1a3-1308-4895-a36c-99a52ea1a645: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2868e1a3-1308-4895-a36c-99a52ea1a645', 'volume_size': 1} Nov 02 10:23:12 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-9e3f2678-816f-4aea-babd-21905e09b549 tempest-ProjectReaderTests-1786041329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:23:12 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-9e3f2678-816f-4aea-babd-21905e09b549 tempest-ProjectReaderTests-1786041329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:23:12 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-9e3f2678-816f-4aea-babd-21905e09b549 tempest-ProjectReaderTests-1786041329 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:23:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-823196786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2868e1a3-1308-4895-a36c-99a52ea1a645,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f95a8c5d36654c55b5befd9f9e0b5e3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:23:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:23:12Z,use_quota=True,user_id='20ba7347b12b4ece927570f2d2bf9fcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:23:12 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-9e3f2678-816f-4aea-babd-21905e09b549 tempest-ProjectReaderTests-1786041329 None] Creating volume 2868e1a3-1308-4895-a36c-99a52ea1a645 {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:23:12 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-9e3f2678-816f-4aea-babd-21905e09b549 tempest-ProjectReaderTests-1786041329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:23:12 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-9e3f2678-816f-4aea-babd-21905e09b549 tempest-ProjectReaderTests-1786041329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:23:12 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-9e3f2678-816f-4aea-babd-21905e09b549 tempest-ProjectReaderTests-1786041329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:23:12 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-9e3f2678-816f-4aea-babd-21905e09b549 tempest-ProjectReaderTests-1786041329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:23:12 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-9e3f2678-816f-4aea-babd-21905e09b549 tempest-ProjectReaderTests-1786041329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:23:12 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-9e3f2678-816f-4aea-babd-21905e09b549 tempest-ProjectReaderTests-1786041329 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:23:12 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-9e3f2678-816f-4aea-babd-21905e09b549 tempest-ProjectReaderTests-1786041329 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:23:12 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-9e3f2678-816f-4aea-babd-21905e09b549 tempest-ProjectReaderTests-1786041329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-2868e1a3-1308-4895-a36c-99a52ea1a645 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:12 devstack sudo[104513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-2868e1a3-1308-4895-a36c-99a52ea1a645 1073741824 Nov 02 10:23:12 devstack sudo[104513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:13 devstack sudo[104513]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:13 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-9e3f2678-816f-4aea-babd-21905e09b549 tempest-ProjectReaderTests-1786041329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-2868e1a3-1308-4895-a36c-99a52ea1a645 1073741824" returned: 0 in 0.413s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:13 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-9e3f2678-816f-4aea-babd-21905e09b549 tempest-ProjectReaderTests-1786041329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-2868e1a3-1308-4895-a36c-99a52ea1a645 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:13 devstack sudo[104518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-2868e1a3-1308-4895-a36c-99a52ea1a645 Nov 02 10:23:13 devstack sudo[104518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:13 devstack sudo[104518]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:13 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-9e3f2678-816f-4aea-babd-21905e09b549 tempest-ProjectReaderTests-1786041329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-2868e1a3-1308-4895-a36c-99a52ea1a645" returned: 0 in 0.253s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:13 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-9e3f2678-816f-4aea-babd-21905e09b549 tempest-ProjectReaderTests-1786041329 None] <== create_volume: return (714ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:23:13 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-9e3f2678-816f-4aea-babd-21905e09b549 tempest-ProjectReaderTests-1786041329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.717s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:23:13 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-9e3f2678-816f-4aea-babd-21905e09b549 tempest-ProjectReaderTests-1786041329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91331bbe-194e-4ea8-a091-0d440438ee35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2868e1a3-1308-4895-a36c-99a52ea1a645', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:13 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-9e3f2678-816f-4aea-babd-21905e09b549 tempest-ProjectReaderTests-1786041329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00bee3c9-96d3-482e-992e-5c6e4932543b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:13 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-9e3f2678-816f-4aea-babd-21905e09b549 tempest-ProjectReaderTests-1786041329 None] Volume volume-2868e1a3-1308-4895-a36c-99a52ea1a645 (2868e1a3-1308-4895-a36c-99a52ea1a645): created successfully Nov 02 10:23:13 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-9e3f2678-816f-4aea-babd-21905e09b549 tempest-ProjectReaderTests-1786041329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00bee3c9-96d3-482e-992e-5c6e4932543b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:13 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-9e3f2678-816f-4aea-babd-21905e09b549 tempest-ProjectReaderTests-1786041329 None] Flow 'volume_create_manager' (8ee61bae-3809-4188-bf56-bd54a2350a55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:23:13 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-9e3f2678-816f-4aea-babd-21905e09b549 tempest-ProjectReaderTests-1786041329 None] Created volume successfully. Nov 02 10:23:13 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-dc01b349-74b3-4d4a-8bae-dba988ae2664 tempest-ProjectReaderTests-1786041329 None] Acquiring lock "cinder-2868e1a3-1308-4895-a36c-99a52ea1a645-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:23:13 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-dc01b349-74b3-4d4a-8bae-dba988ae2664 tempest-ProjectReaderTests-1786041329 None] Lock "cinder-2868e1a3-1308-4895-a36c-99a52ea1a645-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:23:13 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-dc01b349-74b3-4d4a-8bae-dba988ae2664 tempest-ProjectReaderTests-1786041329 None] Acquiring lock "cinder-quobyte-2868e1a3-1308-4895-a36c-99a52ea1a645" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:23:13 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-dc01b349-74b3-4d4a-8bae-dba988ae2664 tempest-ProjectReaderTests-1786041329 None] Lock "cinder-quobyte-2868e1a3-1308-4895-a36c-99a52ea1a645" acquired by "delete_volume" :: waited 0.016s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:23:13 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[07626be4-9ee0-42e9-8d3d-cbd069d867c3]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:23:13 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-dc01b349-74b3-4d4a-8bae-dba988ae2664 tempest-ProjectReaderTests-1786041329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-2868e1a3-1308-4895-a36c-99a52ea1a645 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:13 devstack sudo[104521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-2868e1a3-1308-4895-a36c-99a52ea1a645 Nov 02 10:23:13 devstack sudo[104521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:14 devstack sudo[104521]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:14 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-dc01b349-74b3-4d4a-8bae-dba988ae2664 tempest-ProjectReaderTests-1786041329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-2868e1a3-1308-4895-a36c-99a52ea1a645" returned: 0 in 0.348s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:14 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-dc01b349-74b3-4d4a-8bae-dba988ae2664 tempest-ProjectReaderTests-1786041329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-2868e1a3-1308-4895-a36c-99a52ea1a645 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:14 devstack sudo[104528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-2868e1a3-1308-4895-a36c-99a52ea1a645 Nov 02 10:23:14 devstack sudo[104528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:14 devstack sudo[104528]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:14 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-dc01b349-74b3-4d4a-8bae-dba988ae2664 tempest-ProjectReaderTests-1786041329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-2868e1a3-1308-4895-a36c-99a52ea1a645" returned: 0 in 0.239s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:14 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-dc01b349-74b3-4d4a-8bae-dba988ae2664 tempest-ProjectReaderTests-1786041329 None] Lock "cinder-quobyte-2868e1a3-1308-4895-a36c-99a52ea1a645" released by "delete_volume" :: held 0.625s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:23:14 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-dc01b349-74b3-4d4a-8bae-dba988ae2664 tempest-ProjectReaderTests-1786041329 None] Created reservations ['e686ee66-73fc-4f8b-a499-fdd4d1b5a280', 'b66cf1af-9c8c-4675-a27a-b5966f94a2db', 'f5554142-f309-47f3-ab66-980137b7fdce', '3768e633-483f-42e6-89b0-491e2886bbe8'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:23:14 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-dc01b349-74b3-4d4a-8bae-dba988ae2664 tempest-ProjectReaderTests-1786041329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:23:14 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-dc01b349-74b3-4d4a-8bae-dba988ae2664 tempest-ProjectReaderTests-1786041329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:23:14 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-dc01b349-74b3-4d4a-8bae-dba988ae2664 tempest-ProjectReaderTests-1786041329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:23:14 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-dc01b349-74b3-4d4a-8bae-dba988ae2664 tempest-ProjectReaderTests-1786041329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:23:14 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-dc01b349-74b3-4d4a-8bae-dba988ae2664 tempest-ProjectReaderTests-1786041329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:23:14 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-dc01b349-74b3-4d4a-8bae-dba988ae2664 tempest-ProjectReaderTests-1786041329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:14 devstack sudo[104531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:23:14 devstack sudo[104531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:14 devstack sudo[104531]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:14 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-dc01b349-74b3-4d4a-8bae-dba988ae2664 tempest-ProjectReaderTests-1786041329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.261s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:14 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-dc01b349-74b3-4d4a-8bae-dba988ae2664 tempest-ProjectReaderTests-1786041329 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:23:14 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-dc01b349-74b3-4d4a-8bae-dba988ae2664 tempest-ProjectReaderTests-1786041329 None] Deleted volume successfully. Nov 02 10:23:14 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-dc01b349-74b3-4d4a-8bae-dba988ae2664 tempest-ProjectReaderTests-1786041329 None] Lock "cinder-2868e1a3-1308-4895-a36c-99a52ea1a645-delete_volume" released by "delete_volume" :: held 1.114s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:23:15 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7ad8ca9-f18b-4da8-81e9-75701f731a27 tempest-ProjectReaderTests-1786041329 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:23:15 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-b7ad8ca9-f18b-4da8-81e9-75701f731a27 tempest-ProjectReaderTests-1786041329 None] Flow 'volume_create_manager' (d958523b-14c8-41b7-bc7e-d695010022e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:23:15 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-b7ad8ca9-f18b-4da8-81e9-75701f731a27 tempest-ProjectReaderTests-1786041329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b56ac5f7-b429-4b9a-ac45-d6dc28c62269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:15 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-b7ad8ca9-f18b-4da8-81e9-75701f731a27 tempest-ProjectReaderTests-1786041329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b56ac5f7-b429-4b9a-ac45-d6dc28c62269) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:23:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-988975438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4207ac02-8b60-47bb-b4f1-4472a893271d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f95a8c5d36654c55b5befd9f9e0b5e3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:23:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:23:15Z,use_quota=True,user_id='20ba7347b12b4ece927570f2d2bf9fcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:15 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-b7ad8ca9-f18b-4da8-81e9-75701f731a27 tempest-ProjectReaderTests-1786041329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74a9dd12-9e64-4795-8061-67e81c707e05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:15 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-b7ad8ca9-f18b-4da8-81e9-75701f731a27 tempest-ProjectReaderTests-1786041329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74a9dd12-9e64-4795-8061-67e81c707e05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:15 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-b7ad8ca9-f18b-4da8-81e9-75701f731a27 tempest-ProjectReaderTests-1786041329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60d3e1cb-e216-4c9d-8a53-eb524d9c8f11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:15 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-b7ad8ca9-f18b-4da8-81e9-75701f731a27 tempest-ProjectReaderTests-1786041329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60d3e1cb-e216-4c9d-8a53-eb524d9c8f11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4207ac02-8b60-47bb-b4f1-4472a893271d', 'volume_name': 'volume-4207ac02-8b60-47bb-b4f1-4472a893271d', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:15 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-b7ad8ca9-f18b-4da8-81e9-75701f731a27 tempest-ProjectReaderTests-1786041329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe92a3fc-28ea-4358-a3f8-fecc0872ed26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:15 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-b7ad8ca9-f18b-4da8-81e9-75701f731a27 tempest-ProjectReaderTests-1786041329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe92a3fc-28ea-4358-a3f8-fecc0872ed26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:15 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-b7ad8ca9-f18b-4da8-81e9-75701f731a27 tempest-ProjectReaderTests-1786041329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6b15980-0b7f-4d8f-be07-7ce23dcac808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:15 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-b7ad8ca9-f18b-4da8-81e9-75701f731a27 tempest-ProjectReaderTests-1786041329 None] Volume 4207ac02-8b60-47bb-b4f1-4472a893271d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4207ac02-8b60-47bb-b4f1-4472a893271d', 'volume_size': 1} Nov 02 10:23:15 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-b7ad8ca9-f18b-4da8-81e9-75701f731a27 tempest-ProjectReaderTests-1786041329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:23:15 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-b7ad8ca9-f18b-4da8-81e9-75701f731a27 tempest-ProjectReaderTests-1786041329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:23:15 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-b7ad8ca9-f18b-4da8-81e9-75701f731a27 tempest-ProjectReaderTests-1786041329 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:23:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-988975438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4207ac02-8b60-47bb-b4f1-4472a893271d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f95a8c5d36654c55b5befd9f9e0b5e3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:23:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:23:15Z,use_quota=True,user_id='20ba7347b12b4ece927570f2d2bf9fcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:23:15 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-b7ad8ca9-f18b-4da8-81e9-75701f731a27 tempest-ProjectReaderTests-1786041329 None] Creating volume 4207ac02-8b60-47bb-b4f1-4472a893271d {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:23:15 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-b7ad8ca9-f18b-4da8-81e9-75701f731a27 tempest-ProjectReaderTests-1786041329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:23:15 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-b7ad8ca9-f18b-4da8-81e9-75701f731a27 tempest-ProjectReaderTests-1786041329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:23:15 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-b7ad8ca9-f18b-4da8-81e9-75701f731a27 tempest-ProjectReaderTests-1786041329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:23:15 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-b7ad8ca9-f18b-4da8-81e9-75701f731a27 tempest-ProjectReaderTests-1786041329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:23:15 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-b7ad8ca9-f18b-4da8-81e9-75701f731a27 tempest-ProjectReaderTests-1786041329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:23:15 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-b7ad8ca9-f18b-4da8-81e9-75701f731a27 tempest-ProjectReaderTests-1786041329 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:23:15 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-b7ad8ca9-f18b-4da8-81e9-75701f731a27 tempest-ProjectReaderTests-1786041329 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:23:15 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-b7ad8ca9-f18b-4da8-81e9-75701f731a27 tempest-ProjectReaderTests-1786041329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-4207ac02-8b60-47bb-b4f1-4472a893271d 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:15 devstack sudo[104534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-4207ac02-8b60-47bb-b4f1-4472a893271d 1073741824 Nov 02 10:23:15 devstack sudo[104534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:15 devstack sudo[104534]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:15 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-b7ad8ca9-f18b-4da8-81e9-75701f731a27 tempest-ProjectReaderTests-1786041329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-4207ac02-8b60-47bb-b4f1-4472a893271d 1073741824" returned: 0 in 0.424s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:15 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-b7ad8ca9-f18b-4da8-81e9-75701f731a27 tempest-ProjectReaderTests-1786041329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-4207ac02-8b60-47bb-b4f1-4472a893271d {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:15 devstack sudo[104540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-4207ac02-8b60-47bb-b4f1-4472a893271d Nov 02 10:23:15 devstack sudo[104540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:15 devstack sudo[104540]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:15 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-b7ad8ca9-f18b-4da8-81e9-75701f731a27 tempest-ProjectReaderTests-1786041329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-4207ac02-8b60-47bb-b4f1-4472a893271d" returned: 0 in 0.238s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:15 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-b7ad8ca9-f18b-4da8-81e9-75701f731a27 tempest-ProjectReaderTests-1786041329 None] <== create_volume: return (702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:23:15 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-b7ad8ca9-f18b-4da8-81e9-75701f731a27 tempest-ProjectReaderTests-1786041329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.705s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:23:15 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-b7ad8ca9-f18b-4da8-81e9-75701f731a27 tempest-ProjectReaderTests-1786041329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6b15980-0b7f-4d8f-be07-7ce23dcac808) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4207ac02-8b60-47bb-b4f1-4472a893271d', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:16 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-b7ad8ca9-f18b-4da8-81e9-75701f731a27 tempest-ProjectReaderTests-1786041329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70ed1240-faf1-411d-8838-09f325f1c9a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:16 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-b7ad8ca9-f18b-4da8-81e9-75701f731a27 tempest-ProjectReaderTests-1786041329 None] Volume volume-4207ac02-8b60-47bb-b4f1-4472a893271d (4207ac02-8b60-47bb-b4f1-4472a893271d): created successfully Nov 02 10:23:16 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-b7ad8ca9-f18b-4da8-81e9-75701f731a27 tempest-ProjectReaderTests-1786041329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70ed1240-faf1-411d-8838-09f325f1c9a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:16 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-b7ad8ca9-f18b-4da8-81e9-75701f731a27 tempest-ProjectReaderTests-1786041329 None] Flow 'volume_create_manager' (d958523b-14c8-41b7-bc7e-d695010022e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:23:16 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-b7ad8ca9-f18b-4da8-81e9-75701f731a27 tempest-ProjectReaderTests-1786041329 None] Created volume successfully. Nov 02 10:23:16 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-3c9172ff-40c1-4dfc-8fb7-ee7961765190 tempest-ProjectReaderTests-1786041329 None] Acquiring lock "cinder-4207ac02-8b60-47bb-b4f1-4472a893271d-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:23:16 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-3c9172ff-40c1-4dfc-8fb7-ee7961765190 tempest-ProjectReaderTests-1786041329 None] Lock "cinder-4207ac02-8b60-47bb-b4f1-4472a893271d-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:23:16 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-3c9172ff-40c1-4dfc-8fb7-ee7961765190 tempest-ProjectReaderTests-1786041329 None] Acquiring lock "cinder-quobyte-4207ac02-8b60-47bb-b4f1-4472a893271d" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:23:16 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-3c9172ff-40c1-4dfc-8fb7-ee7961765190 tempest-ProjectReaderTests-1786041329 None] Lock "cinder-quobyte-4207ac02-8b60-47bb-b4f1-4472a893271d" acquired by "delete_volume" :: waited 0.019s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:23:16 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[259c5cd4-e795-4b21-a969-9727c735a4d8]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:23:16 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-3c9172ff-40c1-4dfc-8fb7-ee7961765190 tempest-ProjectReaderTests-1786041329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-4207ac02-8b60-47bb-b4f1-4472a893271d {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:16 devstack sudo[104543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-4207ac02-8b60-47bb-b4f1-4472a893271d Nov 02 10:23:16 devstack sudo[104543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:16 devstack sudo[104543]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:16 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-3c9172ff-40c1-4dfc-8fb7-ee7961765190 tempest-ProjectReaderTests-1786041329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-4207ac02-8b60-47bb-b4f1-4472a893271d" returned: 0 in 0.353s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:16 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-3c9172ff-40c1-4dfc-8fb7-ee7961765190 tempest-ProjectReaderTests-1786041329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-4207ac02-8b60-47bb-b4f1-4472a893271d {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:16 devstack sudo[104556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-4207ac02-8b60-47bb-b4f1-4472a893271d Nov 02 10:23:16 devstack sudo[104556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:16 devstack sudo[104556]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:17 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-3c9172ff-40c1-4dfc-8fb7-ee7961765190 tempest-ProjectReaderTests-1786041329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-4207ac02-8b60-47bb-b4f1-4472a893271d" returned: 0 in 0.238s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:17 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-3c9172ff-40c1-4dfc-8fb7-ee7961765190 tempest-ProjectReaderTests-1786041329 None] Lock "cinder-quobyte-4207ac02-8b60-47bb-b4f1-4472a893271d" released by "delete_volume" :: held 0.634s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:23:17 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-3c9172ff-40c1-4dfc-8fb7-ee7961765190 tempest-ProjectReaderTests-1786041329 None] Created reservations ['3b4bcd6d-fc8d-40e5-a262-1b5238cb8f3c', '0c734ae2-c84c-4368-8545-f7392935bf2e', '7c7f1094-29a7-479e-af6c-a89d4edd9156', 'fb9cde92-8f56-4a07-996c-78f726c77beb'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:23:17 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-3c9172ff-40c1-4dfc-8fb7-ee7961765190 tempest-ProjectReaderTests-1786041329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:23:17 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-3c9172ff-40c1-4dfc-8fb7-ee7961765190 tempest-ProjectReaderTests-1786041329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:23:17 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-3c9172ff-40c1-4dfc-8fb7-ee7961765190 tempest-ProjectReaderTests-1786041329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:23:17 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-3c9172ff-40c1-4dfc-8fb7-ee7961765190 tempest-ProjectReaderTests-1786041329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:23:17 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-3c9172ff-40c1-4dfc-8fb7-ee7961765190 tempest-ProjectReaderTests-1786041329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:23:17 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-3c9172ff-40c1-4dfc-8fb7-ee7961765190 tempest-ProjectReaderTests-1786041329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:17 devstack sudo[104559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:23:17 devstack sudo[104559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:17 devstack sudo[104559]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:17 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-3c9172ff-40c1-4dfc-8fb7-ee7961765190 tempest-ProjectReaderTests-1786041329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.249s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:17 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-3c9172ff-40c1-4dfc-8fb7-ee7961765190 tempest-ProjectReaderTests-1786041329 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:23:17 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-3c9172ff-40c1-4dfc-8fb7-ee7961765190 tempest-ProjectReaderTests-1786041329 None] Deleted volume successfully. Nov 02 10:23:17 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-3c9172ff-40c1-4dfc-8fb7-ee7961765190 tempest-ProjectReaderTests-1786041329 None] Lock "cinder-4207ac02-8b60-47bb-b4f1-4472a893271d-delete_volume" released by "delete_volume" :: held 1.104s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:23:17 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f287d0c-45d1-4587-9db0-b9c9d9558cc9 tempest-ProjectReaderTests-1786041329 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:23:17 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-1f287d0c-45d1-4587-9db0-b9c9d9558cc9 tempest-ProjectReaderTests-1786041329 None] Flow 'volume_create_manager' (0287c746-0862-4ff2-abe4-cc9b2fc121ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:23:17 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-1f287d0c-45d1-4587-9db0-b9c9d9558cc9 tempest-ProjectReaderTests-1786041329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec542d84-e0fa-4075-a6bb-aad17c2cc831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:17 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-1f287d0c-45d1-4587-9db0-b9c9d9558cc9 tempest-ProjectReaderTests-1786041329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec542d84-e0fa-4075-a6bb-aad17c2cc831) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:23:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1794294067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04dc5cf2-f50d-4768-b6dc-1334215e2504,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f95a8c5d36654c55b5befd9f9e0b5e3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:23:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:23:18Z,use_quota=True,user_id='20ba7347b12b4ece927570f2d2bf9fcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:17 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-1f287d0c-45d1-4587-9db0-b9c9d9558cc9 tempest-ProjectReaderTests-1786041329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71733e4a-892b-417d-8c73-77c0cb65ce80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:17 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-1f287d0c-45d1-4587-9db0-b9c9d9558cc9 tempest-ProjectReaderTests-1786041329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71733e4a-892b-417d-8c73-77c0cb65ce80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:17 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-1f287d0c-45d1-4587-9db0-b9c9d9558cc9 tempest-ProjectReaderTests-1786041329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2443466e-3874-4a3b-bd67-7f7fab5f7f3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:17 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-1f287d0c-45d1-4587-9db0-b9c9d9558cc9 tempest-ProjectReaderTests-1786041329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2443466e-3874-4a3b-bd67-7f7fab5f7f3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04dc5cf2-f50d-4768-b6dc-1334215e2504', 'volume_name': 'volume-04dc5cf2-f50d-4768-b6dc-1334215e2504', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:17 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-1f287d0c-45d1-4587-9db0-b9c9d9558cc9 tempest-ProjectReaderTests-1786041329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6a6bf6e-9b1d-460b-b776-3423f7303b2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:17 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-1f287d0c-45d1-4587-9db0-b9c9d9558cc9 tempest-ProjectReaderTests-1786041329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6a6bf6e-9b1d-460b-b776-3423f7303b2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:17 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-1f287d0c-45d1-4587-9db0-b9c9d9558cc9 tempest-ProjectReaderTests-1786041329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8969870b-97da-40f2-a156-67f0297acb0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:17 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-1f287d0c-45d1-4587-9db0-b9c9d9558cc9 tempest-ProjectReaderTests-1786041329 None] Volume 04dc5cf2-f50d-4768-b6dc-1334215e2504: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04dc5cf2-f50d-4768-b6dc-1334215e2504', 'volume_size': 1} Nov 02 10:23:17 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-1f287d0c-45d1-4587-9db0-b9c9d9558cc9 tempest-ProjectReaderTests-1786041329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:23:17 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-1f287d0c-45d1-4587-9db0-b9c9d9558cc9 tempest-ProjectReaderTests-1786041329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:23:17 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-1f287d0c-45d1-4587-9db0-b9c9d9558cc9 tempest-ProjectReaderTests-1786041329 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:23:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1794294067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04dc5cf2-f50d-4768-b6dc-1334215e2504,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f95a8c5d36654c55b5befd9f9e0b5e3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:23:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:23:18Z,use_quota=True,user_id='20ba7347b12b4ece927570f2d2bf9fcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:23:17 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-1f287d0c-45d1-4587-9db0-b9c9d9558cc9 tempest-ProjectReaderTests-1786041329 None] Creating volume 04dc5cf2-f50d-4768-b6dc-1334215e2504 {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:23:17 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-1f287d0c-45d1-4587-9db0-b9c9d9558cc9 tempest-ProjectReaderTests-1786041329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:23:17 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-1f287d0c-45d1-4587-9db0-b9c9d9558cc9 tempest-ProjectReaderTests-1786041329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:23:17 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-1f287d0c-45d1-4587-9db0-b9c9d9558cc9 tempest-ProjectReaderTests-1786041329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:23:17 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-1f287d0c-45d1-4587-9db0-b9c9d9558cc9 tempest-ProjectReaderTests-1786041329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:23:17 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-1f287d0c-45d1-4587-9db0-b9c9d9558cc9 tempest-ProjectReaderTests-1786041329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:23:17 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-1f287d0c-45d1-4587-9db0-b9c9d9558cc9 tempest-ProjectReaderTests-1786041329 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:23:17 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-1f287d0c-45d1-4587-9db0-b9c9d9558cc9 tempest-ProjectReaderTests-1786041329 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:23:17 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-1f287d0c-45d1-4587-9db0-b9c9d9558cc9 tempest-ProjectReaderTests-1786041329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-04dc5cf2-f50d-4768-b6dc-1334215e2504 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:17 devstack sudo[104562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-04dc5cf2-f50d-4768-b6dc-1334215e2504 1073741824 Nov 02 10:23:17 devstack sudo[104562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:18 devstack sudo[104562]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:18 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-1f287d0c-45d1-4587-9db0-b9c9d9558cc9 tempest-ProjectReaderTests-1786041329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-04dc5cf2-f50d-4768-b6dc-1334215e2504 1073741824" returned: 0 in 0.435s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:18 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-1f287d0c-45d1-4587-9db0-b9c9d9558cc9 tempest-ProjectReaderTests-1786041329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-04dc5cf2-f50d-4768-b6dc-1334215e2504 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:18 devstack sudo[104569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-04dc5cf2-f50d-4768-b6dc-1334215e2504 Nov 02 10:23:18 devstack sudo[104569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:18 devstack sudo[104569]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:18 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-1f287d0c-45d1-4587-9db0-b9c9d9558cc9 tempest-ProjectReaderTests-1786041329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-04dc5cf2-f50d-4768-b6dc-1334215e2504" returned: 0 in 0.240s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:18 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-1f287d0c-45d1-4587-9db0-b9c9d9558cc9 tempest-ProjectReaderTests-1786041329 None] <== create_volume: return (715ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:23:18 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-1f287d0c-45d1-4587-9db0-b9c9d9558cc9 tempest-ProjectReaderTests-1786041329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.718s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:23:18 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-1f287d0c-45d1-4587-9db0-b9c9d9558cc9 tempest-ProjectReaderTests-1786041329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8969870b-97da-40f2-a156-67f0297acb0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04dc5cf2-f50d-4768-b6dc-1334215e2504', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:18 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-1f287d0c-45d1-4587-9db0-b9c9d9558cc9 tempest-ProjectReaderTests-1786041329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbdf70b6-de3d-4e2d-866f-eecf6c52a864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:18 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-1f287d0c-45d1-4587-9db0-b9c9d9558cc9 tempest-ProjectReaderTests-1786041329 None] Volume volume-04dc5cf2-f50d-4768-b6dc-1334215e2504 (04dc5cf2-f50d-4768-b6dc-1334215e2504): created successfully Nov 02 10:23:18 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-1f287d0c-45d1-4587-9db0-b9c9d9558cc9 tempest-ProjectReaderTests-1786041329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbdf70b6-de3d-4e2d-866f-eecf6c52a864) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:18 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-1f287d0c-45d1-4587-9db0-b9c9d9558cc9 tempest-ProjectReaderTests-1786041329 None] Flow 'volume_create_manager' (0287c746-0862-4ff2-abe4-cc9b2fc121ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:23:18 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-1f287d0c-45d1-4587-9db0-b9c9d9558cc9 tempest-ProjectReaderTests-1786041329 None] Created volume successfully. Nov 02 10:23:18 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-1ac016ec-1c7d-4c8d-8a71-c2173cda5394 tempest-ProjectReaderTests-1786041329 None] Acquiring lock "cinder-04dc5cf2-f50d-4768-b6dc-1334215e2504-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:23:18 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-1ac016ec-1c7d-4c8d-8a71-c2173cda5394 tempest-ProjectReaderTests-1786041329 None] Lock "cinder-04dc5cf2-f50d-4768-b6dc-1334215e2504-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:23:18 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-1ac016ec-1c7d-4c8d-8a71-c2173cda5394 tempest-ProjectReaderTests-1786041329 None] Acquiring lock "cinder-quobyte-04dc5cf2-f50d-4768-b6dc-1334215e2504" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:23:18 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-1ac016ec-1c7d-4c8d-8a71-c2173cda5394 tempest-ProjectReaderTests-1786041329 None] Lock "cinder-quobyte-04dc5cf2-f50d-4768-b6dc-1334215e2504" acquired by "delete_volume" :: waited 0.012s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:23:19 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c1a5d59-06d8-4ce4-bd93-6bf2045c077b]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:23:19 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-1ac016ec-1c7d-4c8d-8a71-c2173cda5394 tempest-ProjectReaderTests-1786041329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-04dc5cf2-f50d-4768-b6dc-1334215e2504 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:19 devstack sudo[104572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-04dc5cf2-f50d-4768-b6dc-1334215e2504 Nov 02 10:23:19 devstack sudo[104572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:19 devstack sudo[104572]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:19 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-1ac016ec-1c7d-4c8d-8a71-c2173cda5394 tempest-ProjectReaderTests-1786041329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-04dc5cf2-f50d-4768-b6dc-1334215e2504" returned: 0 in 0.354s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:19 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-1ac016ec-1c7d-4c8d-8a71-c2173cda5394 tempest-ProjectReaderTests-1786041329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-04dc5cf2-f50d-4768-b6dc-1334215e2504 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:19 devstack sudo[104577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-04dc5cf2-f50d-4768-b6dc-1334215e2504 Nov 02 10:23:19 devstack sudo[104577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:19 devstack sudo[104577]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:19 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-1ac016ec-1c7d-4c8d-8a71-c2173cda5394 tempest-ProjectReaderTests-1786041329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-04dc5cf2-f50d-4768-b6dc-1334215e2504" returned: 0 in 0.236s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:19 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-1ac016ec-1c7d-4c8d-8a71-c2173cda5394 tempest-ProjectReaderTests-1786041329 None] Lock "cinder-quobyte-04dc5cf2-f50d-4768-b6dc-1334215e2504" released by "delete_volume" :: held 0.629s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:23:19 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-1ac016ec-1c7d-4c8d-8a71-c2173cda5394 tempest-ProjectReaderTests-1786041329 None] Created reservations ['c4e74d03-71a8-485a-a0e9-8bb652204e59', '16dc51c5-a8f5-4505-8881-b549945ff851', 'f028777d-c7f7-4004-8e34-bbb2cc2a4937', '1295b50f-478e-44f6-aa34-51b194b9a9db'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:23:19 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-1ac016ec-1c7d-4c8d-8a71-c2173cda5394 tempest-ProjectReaderTests-1786041329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:23:19 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-1ac016ec-1c7d-4c8d-8a71-c2173cda5394 tempest-ProjectReaderTests-1786041329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:23:19 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-1ac016ec-1c7d-4c8d-8a71-c2173cda5394 tempest-ProjectReaderTests-1786041329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:23:19 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-1ac016ec-1c7d-4c8d-8a71-c2173cda5394 tempest-ProjectReaderTests-1786041329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:23:19 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-1ac016ec-1c7d-4c8d-8a71-c2173cda5394 tempest-ProjectReaderTests-1786041329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:23:19 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-1ac016ec-1c7d-4c8d-8a71-c2173cda5394 tempest-ProjectReaderTests-1786041329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:19 devstack sudo[104592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:23:19 devstack sudo[104592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:19 devstack sudo[104592]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:19 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-1ac016ec-1c7d-4c8d-8a71-c2173cda5394 tempest-ProjectReaderTests-1786041329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.251s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:19 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-1ac016ec-1c7d-4c8d-8a71-c2173cda5394 tempest-ProjectReaderTests-1786041329 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:23:19 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-1ac016ec-1c7d-4c8d-8a71-c2173cda5394 tempest-ProjectReaderTests-1786041329 None] Deleted volume successfully. Nov 02 10:23:20 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-1ac016ec-1c7d-4c8d-8a71-c2173cda5394 tempest-ProjectReaderTests-1786041329 None] Lock "cinder-04dc5cf2-f50d-4768-b6dc-1334215e2504-delete_volume" released by "delete_volume" :: held 1.082s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:23:29 devstack cinder-volume[86890]: DEBUG dbcounter [-] [86890] Writing DB stats cinder:UPDATE=178,cinder:SELECT=117,cinder:INSERT=42,cinder:DELETE=14 {{(pid=86890) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:23:30 devstack cinder-volume[86890]: DEBUG dbcounter [-] [86890] Writing DB stats cinder:SELECT=112,cinder:UPDATE=167,cinder:INSERT=38,cinder:DELETE=17 {{(pid=86890) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:23:32 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-c04c46d5-1a46-4e67-8c9e-d2c71c198147 tempest-CreateVolumesFromImageTest-1563659042 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:23:32 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c04c46d5-1a46-4e67-8c9e-d2c71c198147 tempest-CreateVolumesFromImageTest-1563659042 None] Flow 'volume_create_manager' (84bca40e-496a-44ae-ab1c-35ed9d79b60e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:23:32 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c04c46d5-1a46-4e67-8c9e-d2c71c198147 tempest-CreateVolumesFromImageTest-1563659042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a6a3710-0915-473c-9617-caa87039c5d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:32 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c04c46d5-1a46-4e67-8c9e-d2c71c198147 tempest-CreateVolumesFromImageTest-1563659042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a6a3710-0915-473c-9617-caa87039c5d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:23:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1989824518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5121a00f-2f51-425f-9cc0-fbf2e15ea14f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c19a8d5eaf0743fcb02ac30853647551',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:23:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:23:32Z,use_quota=True,user_id='81ea4f5b49a9417ebc416b0b6b672f9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:32 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c04c46d5-1a46-4e67-8c9e-d2c71c198147 tempest-CreateVolumesFromImageTest-1563659042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b51304f-15b5-45f0-9a45-924387fd24e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:32 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c04c46d5-1a46-4e67-8c9e-d2c71c198147 tempest-CreateVolumesFromImageTest-1563659042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b51304f-15b5-45f0-9a45-924387fd24e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:32 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c04c46d5-1a46-4e67-8c9e-d2c71c198147 tempest-CreateVolumesFromImageTest-1563659042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ceed1392-6cfa-4b87-81d0-e68136177bb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:32 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c04c46d5-1a46-4e67-8c9e-d2c71c198147 tempest-CreateVolumesFromImageTest-1563659042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ceed1392-6cfa-4b87-81d0-e68136177bb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5121a00f-2f51-425f-9cc0-fbf2e15ea14f', 'volume_name': 'volume-5121a00f-2f51-425f-9cc0-fbf2e15ea14f', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:32 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c04c46d5-1a46-4e67-8c9e-d2c71c198147 tempest-CreateVolumesFromImageTest-1563659042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7e0a1f2-7fd9-44a3-a95d-f544eb649765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:32 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c04c46d5-1a46-4e67-8c9e-d2c71c198147 tempest-CreateVolumesFromImageTest-1563659042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7e0a1f2-7fd9-44a3-a95d-f544eb649765) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:32 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c04c46d5-1a46-4e67-8c9e-d2c71c198147 tempest-CreateVolumesFromImageTest-1563659042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b43b8bf4-43f7-4033-aa4c-cbcb191c569c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:32 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-c04c46d5-1a46-4e67-8c9e-d2c71c198147 tempest-CreateVolumesFromImageTest-1563659042 None] Volume 5121a00f-2f51-425f-9cc0-fbf2e15ea14f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5121a00f-2f51-425f-9cc0-fbf2e15ea14f', 'volume_size': 1} Nov 02 10:23:32 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c04c46d5-1a46-4e67-8c9e-d2c71c198147 tempest-CreateVolumesFromImageTest-1563659042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:23:32 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c04c46d5-1a46-4e67-8c9e-d2c71c198147 tempest-CreateVolumesFromImageTest-1563659042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:23:32 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c04c46d5-1a46-4e67-8c9e-d2c71c198147 tempest-CreateVolumesFromImageTest-1563659042 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:23:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1989824518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5121a00f-2f51-425f-9cc0-fbf2e15ea14f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c19a8d5eaf0743fcb02ac30853647551',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:23:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:23:32Z,use_quota=True,user_id='81ea4f5b49a9417ebc416b0b6b672f9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:23:32 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-c04c46d5-1a46-4e67-8c9e-d2c71c198147 tempest-CreateVolumesFromImageTest-1563659042 None] Creating volume 5121a00f-2f51-425f-9cc0-fbf2e15ea14f {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:23:32 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c04c46d5-1a46-4e67-8c9e-d2c71c198147 tempest-CreateVolumesFromImageTest-1563659042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:23:32 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c04c46d5-1a46-4e67-8c9e-d2c71c198147 tempest-CreateVolumesFromImageTest-1563659042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:23:32 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c04c46d5-1a46-4e67-8c9e-d2c71c198147 tempest-CreateVolumesFromImageTest-1563659042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:23:32 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c04c46d5-1a46-4e67-8c9e-d2c71c198147 tempest-CreateVolumesFromImageTest-1563659042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:23:32 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c04c46d5-1a46-4e67-8c9e-d2c71c198147 tempest-CreateVolumesFromImageTest-1563659042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:23:32 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c04c46d5-1a46-4e67-8c9e-d2c71c198147 tempest-CreateVolumesFromImageTest-1563659042 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:23:32 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-c04c46d5-1a46-4e67-8c9e-d2c71c198147 tempest-CreateVolumesFromImageTest-1563659042 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:23:32 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c04c46d5-1a46-4e67-8c9e-d2c71c198147 tempest-CreateVolumesFromImageTest-1563659042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-5121a00f-2f51-425f-9cc0-fbf2e15ea14f 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:32 devstack sudo[104660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-5121a00f-2f51-425f-9cc0-fbf2e15ea14f 1073741824 Nov 02 10:23:32 devstack sudo[104660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:32 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-560b931f-cd00-4d14-a3a6-23f258267634 tempest-VolumeDependencyTests-724561728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:23:32 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-560b931f-cd00-4d14-a3a6-23f258267634 tempest-VolumeDependencyTests-724561728 None] Flow 'volume_create_manager' (65fa9146-9c53-4057-bb90-4b9def95f268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:23:32 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-560b931f-cd00-4d14-a3a6-23f258267634 tempest-VolumeDependencyTests-724561728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b323bc47-4543-401b-9ed7-ab7e17019acc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:32 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-560b931f-cd00-4d14-a3a6-23f258267634 tempest-VolumeDependencyTests-724561728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b323bc47-4543-401b-9ed7-ab7e17019acc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:23:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-121877094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b65175c9-bbdc-4eb8-b06d-15953654223e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f71543519d98466a90b42fd2459a6fef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:23:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:23:33Z,use_quota=True,user_id='4c9843acb10b46879f5a589aea244ec3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:32 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-560b931f-cd00-4d14-a3a6-23f258267634 tempest-VolumeDependencyTests-724561728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3be1e143-2760-464c-bb63-4e80ed8903e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:32 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-560b931f-cd00-4d14-a3a6-23f258267634 tempest-VolumeDependencyTests-724561728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3be1e143-2760-464c-bb63-4e80ed8903e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:32 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-560b931f-cd00-4d14-a3a6-23f258267634 tempest-VolumeDependencyTests-724561728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f6e5079-e6d5-4a16-9d73-b36811ce29be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:32 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-560b931f-cd00-4d14-a3a6-23f258267634 tempest-VolumeDependencyTests-724561728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f6e5079-e6d5-4a16-9d73-b36811ce29be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b65175c9-bbdc-4eb8-b06d-15953654223e', 'volume_name': 'volume-b65175c9-bbdc-4eb8-b06d-15953654223e', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:32 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-560b931f-cd00-4d14-a3a6-23f258267634 tempest-VolumeDependencyTests-724561728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2c11c2a-b1f2-44b0-92b0-975831679825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:32 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-560b931f-cd00-4d14-a3a6-23f258267634 tempest-VolumeDependencyTests-724561728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2c11c2a-b1f2-44b0-92b0-975831679825) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:32 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-560b931f-cd00-4d14-a3a6-23f258267634 tempest-VolumeDependencyTests-724561728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed1d1a13-cad3-4311-8446-63b7fcaf92a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:32 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-560b931f-cd00-4d14-a3a6-23f258267634 tempest-VolumeDependencyTests-724561728 None] Volume b65175c9-bbdc-4eb8-b06d-15953654223e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b65175c9-bbdc-4eb8-b06d-15953654223e', 'volume_size': 1} Nov 02 10:23:32 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-560b931f-cd00-4d14-a3a6-23f258267634 tempest-VolumeDependencyTests-724561728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:23:32 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-906d9275-d126-4fd2-8760-38eb53fe8019 tempest-CreateVolumesFromImageTest-1563659042 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:23:33 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-906d9275-d126-4fd2-8760-38eb53fe8019 tempest-CreateVolumesFromImageTest-1563659042 None] Flow 'volume_create_manager' (6b4a31a9-d2ec-4add-b31c-ca452f8683ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:23:33 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-906d9275-d126-4fd2-8760-38eb53fe8019 tempest-CreateVolumesFromImageTest-1563659042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71d54655-70a7-4a8b-810a-38fce1c26573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:33 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-906d9275-d126-4fd2-8760-38eb53fe8019 tempest-CreateVolumesFromImageTest-1563659042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71d54655-70a7-4a8b-810a-38fce1c26573) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:23:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-445201603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17d6781a-724b-49d1-92f6-bdd460f57393,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c19a8d5eaf0743fcb02ac30853647551',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:23:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:23:33Z,use_quota=True,user_id='81ea4f5b49a9417ebc416b0b6b672f9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:33 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-906d9275-d126-4fd2-8760-38eb53fe8019 tempest-CreateVolumesFromImageTest-1563659042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83098e4a-fa82-4258-816d-7e0bc905b193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:33 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-906d9275-d126-4fd2-8760-38eb53fe8019 tempest-CreateVolumesFromImageTest-1563659042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83098e4a-fa82-4258-816d-7e0bc905b193) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:33 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-906d9275-d126-4fd2-8760-38eb53fe8019 tempest-CreateVolumesFromImageTest-1563659042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06895490-5c61-4c7e-bfa6-610000207ebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:33 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-906d9275-d126-4fd2-8760-38eb53fe8019 tempest-CreateVolumesFromImageTest-1563659042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06895490-5c61-4c7e-bfa6-610000207ebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17d6781a-724b-49d1-92f6-bdd460f57393', 'volume_name': 'volume-17d6781a-724b-49d1-92f6-bdd460f57393', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:33 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-906d9275-d126-4fd2-8760-38eb53fe8019 tempest-CreateVolumesFromImageTest-1563659042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ad4e502-2aaa-474c-bac8-b3fc42bdb3d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:33 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-906d9275-d126-4fd2-8760-38eb53fe8019 tempest-CreateVolumesFromImageTest-1563659042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ad4e502-2aaa-474c-bac8-b3fc42bdb3d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:33 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-906d9275-d126-4fd2-8760-38eb53fe8019 tempest-CreateVolumesFromImageTest-1563659042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0046bf45-3887-4b0e-a792-ca4868c26e5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:33 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-906d9275-d126-4fd2-8760-38eb53fe8019 tempest-CreateVolumesFromImageTest-1563659042 None] Volume 17d6781a-724b-49d1-92f6-bdd460f57393: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17d6781a-724b-49d1-92f6-bdd460f57393', 'volume_size': 1} Nov 02 10:23:33 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-906d9275-d126-4fd2-8760-38eb53fe8019 tempest-CreateVolumesFromImageTest-1563659042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:23:33 devstack sudo[104660]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:33 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c04c46d5-1a46-4e67-8c9e-d2c71c198147 tempest-CreateVolumesFromImageTest-1563659042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-5121a00f-2f51-425f-9cc0-fbf2e15ea14f 1073741824" returned: 0 in 0.686s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:33 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c04c46d5-1a46-4e67-8c9e-d2c71c198147 tempest-CreateVolumesFromImageTest-1563659042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-5121a00f-2f51-425f-9cc0-fbf2e15ea14f {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:33 devstack sudo[104666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-5121a00f-2f51-425f-9cc0-fbf2e15ea14f Nov 02 10:23:33 devstack sudo[104666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:33 devstack sudo[104666]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:33 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c04c46d5-1a46-4e67-8c9e-d2c71c198147 tempest-CreateVolumesFromImageTest-1563659042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-5121a00f-2f51-425f-9cc0-fbf2e15ea14f" returned: 0 in 0.313s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:33 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c04c46d5-1a46-4e67-8c9e-d2c71c198147 tempest-CreateVolumesFromImageTest-1563659042 None] <== create_volume: return (1059ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:23:33 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c04c46d5-1a46-4e67-8c9e-d2c71c198147 tempest-CreateVolumesFromImageTest-1563659042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.062s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:23:33 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-560b931f-cd00-4d14-a3a6-23f258267634 tempest-VolumeDependencyTests-724561728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.755s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:23:33 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-560b931f-cd00-4d14-a3a6-23f258267634 tempest-VolumeDependencyTests-724561728 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:23:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-121877094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b65175c9-bbdc-4eb8-b06d-15953654223e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f71543519d98466a90b42fd2459a6fef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:23:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:23:33Z,use_quota=True,user_id='4c9843acb10b46879f5a589aea244ec3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:23:33 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-560b931f-cd00-4d14-a3a6-23f258267634 tempest-VolumeDependencyTests-724561728 None] Creating volume b65175c9-bbdc-4eb8-b06d-15953654223e {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:23:33 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-560b931f-cd00-4d14-a3a6-23f258267634 tempest-VolumeDependencyTests-724561728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:23:33 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-560b931f-cd00-4d14-a3a6-23f258267634 tempest-VolumeDependencyTests-724561728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:23:33 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-560b931f-cd00-4d14-a3a6-23f258267634 tempest-VolumeDependencyTests-724561728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:23:33 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-560b931f-cd00-4d14-a3a6-23f258267634 tempest-VolumeDependencyTests-724561728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:23:33 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-560b931f-cd00-4d14-a3a6-23f258267634 tempest-VolumeDependencyTests-724561728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:23:33 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-560b931f-cd00-4d14-a3a6-23f258267634 tempest-VolumeDependencyTests-724561728 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:23:33 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-560b931f-cd00-4d14-a3a6-23f258267634 tempest-VolumeDependencyTests-724561728 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:23:33 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-560b931f-cd00-4d14-a3a6-23f258267634 tempest-VolumeDependencyTests-724561728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b65175c9-bbdc-4eb8-b06d-15953654223e 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:33 devstack sudo[104671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b65175c9-bbdc-4eb8-b06d-15953654223e 1073741824 Nov 02 10:23:33 devstack sudo[104671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:33 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c04c46d5-1a46-4e67-8c9e-d2c71c198147 tempest-CreateVolumesFromImageTest-1563659042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b43b8bf4-43f7-4033-aa4c-cbcb191c569c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5121a00f-2f51-425f-9cc0-fbf2e15ea14f', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:33 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c04c46d5-1a46-4e67-8c9e-d2c71c198147 tempest-CreateVolumesFromImageTest-1563659042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23ad4051-10c3-4b3b-9eb1-96e218db34fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:33 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-c04c46d5-1a46-4e67-8c9e-d2c71c198147 tempest-CreateVolumesFromImageTest-1563659042 None] Volume volume-5121a00f-2f51-425f-9cc0-fbf2e15ea14f (5121a00f-2f51-425f-9cc0-fbf2e15ea14f): created successfully Nov 02 10:23:33 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c04c46d5-1a46-4e67-8c9e-d2c71c198147 tempest-CreateVolumesFromImageTest-1563659042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23ad4051-10c3-4b3b-9eb1-96e218db34fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:33 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c04c46d5-1a46-4e67-8c9e-d2c71c198147 tempest-CreateVolumesFromImageTest-1563659042 None] Flow 'volume_create_manager' (84bca40e-496a-44ae-ab1c-35ed9d79b60e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:23:33 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-477dbc4b-8699-4838-8039-c3f8218b6d7e tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:23:33 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-477dbc4b-8699-4838-8039-c3f8218b6d7e tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Flow 'volume_create_manager' (1103b96c-a4fc-4961-a1b6-de15bf6dbbdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:23:33 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-477dbc4b-8699-4838-8039-c3f8218b6d7e tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25403984-bd36-43ad-abdb-4c35f5542b2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:34 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-c04c46d5-1a46-4e67-8c9e-d2c71c198147 tempest-CreateVolumesFromImageTest-1563659042 None] Created volume successfully. Nov 02 10:23:34 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-477dbc4b-8699-4838-8039-c3f8218b6d7e tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25403984-bd36-43ad-abdb-4c35f5542b2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:23:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1222306745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3748392e-5863-423c-aa48-e0035ca708fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7039fc3033ef42f1b67b7dfce204cbc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:23:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:23:34Z,use_quota=True,user_id='f341757e3c03499ea020c56af95474e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:34 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-477dbc4b-8699-4838-8039-c3f8218b6d7e tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (199278a7-8ee1-4e10-89ff-6b0187a91cf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:34 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-477dbc4b-8699-4838-8039-c3f8218b6d7e tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (199278a7-8ee1-4e10-89ff-6b0187a91cf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:34 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-477dbc4b-8699-4838-8039-c3f8218b6d7e tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88326c3e-e9ce-4ef9-adda-7cf28022eeed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:34 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-477dbc4b-8699-4838-8039-c3f8218b6d7e tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88326c3e-e9ce-4ef9-adda-7cf28022eeed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3748392e-5863-423c-aa48-e0035ca708fd', 'volume_name': 'volume-3748392e-5863-423c-aa48-e0035ca708fd', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:34 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-477dbc4b-8699-4838-8039-c3f8218b6d7e tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4259e73b-110e-457e-a2f5-de64acaa8be5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:34 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-477dbc4b-8699-4838-8039-c3f8218b6d7e tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4259e73b-110e-457e-a2f5-de64acaa8be5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:34 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-477dbc4b-8699-4838-8039-c3f8218b6d7e tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (505cd9bb-d015-4f76-98a7-4576bb879ff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:34 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-477dbc4b-8699-4838-8039-c3f8218b6d7e tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Volume 3748392e-5863-423c-aa48-e0035ca708fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3748392e-5863-423c-aa48-e0035ca708fd', 'volume_size': 1} Nov 02 10:23:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-477dbc4b-8699-4838-8039-c3f8218b6d7e tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:23:34 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-4dbae9ae-3751-41f9-bbd9-c08db01d3c08 tempest-CreateVolumesFromImageTest-1563659042 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:23:34 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-4dbae9ae-3751-41f9-bbd9-c08db01d3c08 tempest-CreateVolumesFromImageTest-1563659042 None] Flow 'volume_create_manager' (5426d34e-80e0-4739-91b8-3027512b123f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:23:34 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-4dbae9ae-3751-41f9-bbd9-c08db01d3c08 tempest-CreateVolumesFromImageTest-1563659042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36c45ae8-6567-40e0-829f-0216dc880ac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:34 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-4dbae9ae-3751-41f9-bbd9-c08db01d3c08 tempest-CreateVolumesFromImageTest-1563659042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36c45ae8-6567-40e0-829f-0216dc880ac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:23:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-621293445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6557c861-94c5-4e49-9b24-3e7146a5b11f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c19a8d5eaf0743fcb02ac30853647551',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:23:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:23:34Z,use_quota=True,user_id='81ea4f5b49a9417ebc416b0b6b672f9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:34 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-4dbae9ae-3751-41f9-bbd9-c08db01d3c08 tempest-CreateVolumesFromImageTest-1563659042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (387343b7-50c9-40e8-a950-83dd532238e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:34 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-4dbae9ae-3751-41f9-bbd9-c08db01d3c08 tempest-CreateVolumesFromImageTest-1563659042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (387343b7-50c9-40e8-a950-83dd532238e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:34 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-4dbae9ae-3751-41f9-bbd9-c08db01d3c08 tempest-CreateVolumesFromImageTest-1563659042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b90e7aa-ed87-46f2-9a3d-781fa5b6abf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:34 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-4dbae9ae-3751-41f9-bbd9-c08db01d3c08 tempest-CreateVolumesFromImageTest-1563659042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b90e7aa-ed87-46f2-9a3d-781fa5b6abf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6557c861-94c5-4e49-9b24-3e7146a5b11f', 'volume_name': 'volume-6557c861-94c5-4e49-9b24-3e7146a5b11f', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:34 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-4dbae9ae-3751-41f9-bbd9-c08db01d3c08 tempest-CreateVolumesFromImageTest-1563659042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a20bb10-fd1f-425a-9609-f812a2493e49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:34 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-4dbae9ae-3751-41f9-bbd9-c08db01d3c08 tempest-CreateVolumesFromImageTest-1563659042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a20bb10-fd1f-425a-9609-f812a2493e49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:34 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-4dbae9ae-3751-41f9-bbd9-c08db01d3c08 tempest-CreateVolumesFromImageTest-1563659042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (741035fa-691a-4402-9ff1-01fe8f240f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:34 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-4dbae9ae-3751-41f9-bbd9-c08db01d3c08 tempest-CreateVolumesFromImageTest-1563659042 None] Volume 6557c861-94c5-4e49-9b24-3e7146a5b11f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6557c861-94c5-4e49-9b24-3e7146a5b11f', 'volume_size': 1} Nov 02 10:23:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-4dbae9ae-3751-41f9-bbd9-c08db01d3c08 tempest-CreateVolumesFromImageTest-1563659042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:23:34 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-dad466e9-ee1e-4448-a2e0-3492584e3163 tempest-CreateVolumesFromImageTest-1563659042 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:23:34 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-dad466e9-ee1e-4448-a2e0-3492584e3163 tempest-CreateVolumesFromImageTest-1563659042 None] Flow 'volume_create_manager' (987d65e2-bf24-4976-b523-4c6a488d16e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:23:34 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-dad466e9-ee1e-4448-a2e0-3492584e3163 tempest-CreateVolumesFromImageTest-1563659042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (967c4662-be08-4dad-b8d5-d0e97241cc68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:34 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-dad466e9-ee1e-4448-a2e0-3492584e3163 tempest-CreateVolumesFromImageTest-1563659042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (967c4662-be08-4dad-b8d5-d0e97241cc68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:23:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-941492963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=835a32c2-c910-4a7d-9197-7fbaef2100b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c19a8d5eaf0743fcb02ac30853647551',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:23:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:23:34Z,use_quota=True,user_id='81ea4f5b49a9417ebc416b0b6b672f9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:34 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-dad466e9-ee1e-4448-a2e0-3492584e3163 tempest-CreateVolumesFromImageTest-1563659042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cb269a8-5ca1-4998-b41a-571bb64238e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:34 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-dad466e9-ee1e-4448-a2e0-3492584e3163 tempest-CreateVolumesFromImageTest-1563659042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cb269a8-5ca1-4998-b41a-571bb64238e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:34 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-dad466e9-ee1e-4448-a2e0-3492584e3163 tempest-CreateVolumesFromImageTest-1563659042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0078d83-a9e0-4f5f-ae00-454cea5ec40b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:34 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-dad466e9-ee1e-4448-a2e0-3492584e3163 tempest-CreateVolumesFromImageTest-1563659042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0078d83-a9e0-4f5f-ae00-454cea5ec40b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '835a32c2-c910-4a7d-9197-7fbaef2100b5', 'volume_name': 'volume-835a32c2-c910-4a7d-9197-7fbaef2100b5', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:34 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-dad466e9-ee1e-4448-a2e0-3492584e3163 tempest-CreateVolumesFromImageTest-1563659042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (643f0c2a-6c4c-4af4-b309-74764cba07d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:34 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-dad466e9-ee1e-4448-a2e0-3492584e3163 tempest-CreateVolumesFromImageTest-1563659042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (643f0c2a-6c4c-4af4-b309-74764cba07d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:34 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-dad466e9-ee1e-4448-a2e0-3492584e3163 tempest-CreateVolumesFromImageTest-1563659042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e118e35-4091-4f36-bfc6-f241158b6fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:34 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-dad466e9-ee1e-4448-a2e0-3492584e3163 tempest-CreateVolumesFromImageTest-1563659042 None] Volume 835a32c2-c910-4a7d-9197-7fbaef2100b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-835a32c2-c910-4a7d-9197-7fbaef2100b5', 'volume_size': 1} Nov 02 10:23:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-dad466e9-ee1e-4448-a2e0-3492584e3163 tempest-CreateVolumesFromImageTest-1563659042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:23:34 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc1b9781-86db-4cca-8e92-df51c4b21a67 tempest-CreateVolumesFromImageTest-1563659042 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:23:34 devstack sudo[104671]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:34 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-cc1b9781-86db-4cca-8e92-df51c4b21a67 tempest-CreateVolumesFromImageTest-1563659042 None] Flow 'volume_create_manager' (84ec8192-e3ca-4016-9ed6-8422a30a7df2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:23:34 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-cc1b9781-86db-4cca-8e92-df51c4b21a67 tempest-CreateVolumesFromImageTest-1563659042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff28edda-2d86-4f11-8199-9a5bf5f78d4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-560b931f-cd00-4d14-a3a6-23f258267634 tempest-VolumeDependencyTests-724561728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b65175c9-bbdc-4eb8-b06d-15953654223e 1073741824" returned: 0 in 0.714s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:34 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-cc1b9781-86db-4cca-8e92-df51c4b21a67 tempest-CreateVolumesFromImageTest-1563659042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff28edda-2d86-4f11-8199-9a5bf5f78d4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:23:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1768570460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c5ba789-93e1-42dc-8f3f-c67c5ca677ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c19a8d5eaf0743fcb02ac30853647551',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:23:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:23:34Z,use_quota=True,user_id='81ea4f5b49a9417ebc416b0b6b672f9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:34 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-cc1b9781-86db-4cca-8e92-df51c4b21a67 tempest-CreateVolumesFromImageTest-1563659042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83765767-16cd-4a9f-943e-a1b1a90f1f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:34 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-cc1b9781-86db-4cca-8e92-df51c4b21a67 tempest-CreateVolumesFromImageTest-1563659042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83765767-16cd-4a9f-943e-a1b1a90f1f8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:34 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-cc1b9781-86db-4cca-8e92-df51c4b21a67 tempest-CreateVolumesFromImageTest-1563659042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bfb385e-70d0-4026-b553-fec62c9336e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:34 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-cc1b9781-86db-4cca-8e92-df51c4b21a67 tempest-CreateVolumesFromImageTest-1563659042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bfb385e-70d0-4026-b553-fec62c9336e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c5ba789-93e1-42dc-8f3f-c67c5ca677ee', 'volume_name': 'volume-5c5ba789-93e1-42dc-8f3f-c67c5ca677ee', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:34 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-cc1b9781-86db-4cca-8e92-df51c4b21a67 tempest-CreateVolumesFromImageTest-1563659042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddeede6b-1b6e-48e2-b2fd-652edf1c71b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:34 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-cc1b9781-86db-4cca-8e92-df51c4b21a67 tempest-CreateVolumesFromImageTest-1563659042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddeede6b-1b6e-48e2-b2fd-652edf1c71b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:34 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-cc1b9781-86db-4cca-8e92-df51c4b21a67 tempest-CreateVolumesFromImageTest-1563659042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (740ca061-f44a-4c2c-8726-725b324ee03f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:34 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-cc1b9781-86db-4cca-8e92-df51c4b21a67 tempest-CreateVolumesFromImageTest-1563659042 None] Volume 5c5ba789-93e1-42dc-8f3f-c67c5ca677ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c5ba789-93e1-42dc-8f3f-c67c5ca677ee', 'volume_size': 1} Nov 02 10:23:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-cc1b9781-86db-4cca-8e92-df51c4b21a67 tempest-CreateVolumesFromImageTest-1563659042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:23:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-560b931f-cd00-4d14-a3a6-23f258267634 tempest-VolumeDependencyTests-724561728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b65175c9-bbdc-4eb8-b06d-15953654223e {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:34 devstack sudo[104678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b65175c9-bbdc-4eb8-b06d-15953654223e Nov 02 10:23:34 devstack sudo[104678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:34 devstack sudo[104678]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-560b931f-cd00-4d14-a3a6-23f258267634 tempest-VolumeDependencyTests-724561728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b65175c9-bbdc-4eb8-b06d-15953654223e" returned: 0 in 0.294s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:34 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-560b931f-cd00-4d14-a3a6-23f258267634 tempest-VolumeDependencyTests-724561728 None] <== create_volume: return (1142ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:23:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-560b931f-cd00-4d14-a3a6-23f258267634 tempest-VolumeDependencyTests-724561728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.150s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:23:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-906d9275-d126-4fd2-8760-38eb53fe8019 tempest-CreateVolumesFromImageTest-1563659042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.732s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:23:34 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-906d9275-d126-4fd2-8760-38eb53fe8019 tempest-CreateVolumesFromImageTest-1563659042 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:23:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-445201603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17d6781a-724b-49d1-92f6-bdd460f57393,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c19a8d5eaf0743fcb02ac30853647551',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:23:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:23:33Z,use_quota=True,user_id='81ea4f5b49a9417ebc416b0b6b672f9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:23:34 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-906d9275-d126-4fd2-8760-38eb53fe8019 tempest-CreateVolumesFromImageTest-1563659042 None] Creating volume 17d6781a-724b-49d1-92f6-bdd460f57393 {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:23:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-906d9275-d126-4fd2-8760-38eb53fe8019 tempest-CreateVolumesFromImageTest-1563659042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:23:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-906d9275-d126-4fd2-8760-38eb53fe8019 tempest-CreateVolumesFromImageTest-1563659042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:23:34 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-906d9275-d126-4fd2-8760-38eb53fe8019 tempest-CreateVolumesFromImageTest-1563659042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:23:34 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-906d9275-d126-4fd2-8760-38eb53fe8019 tempest-CreateVolumesFromImageTest-1563659042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:23:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-906d9275-d126-4fd2-8760-38eb53fe8019 tempest-CreateVolumesFromImageTest-1563659042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:23:34 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-906d9275-d126-4fd2-8760-38eb53fe8019 tempest-CreateVolumesFromImageTest-1563659042 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:23:34 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-906d9275-d126-4fd2-8760-38eb53fe8019 tempest-CreateVolumesFromImageTest-1563659042 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:23:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-906d9275-d126-4fd2-8760-38eb53fe8019 tempest-CreateVolumesFromImageTest-1563659042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-17d6781a-724b-49d1-92f6-bdd460f57393 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:34 devstack cinder-volume[86890]: DEBUG oslo_service.periodic_task [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86890) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:23:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:23:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:23:34 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:23:34 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:23:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:23:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:34 devstack sudo[104681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-17d6781a-724b-49d1-92f6-bdd460f57393 1073741824 Nov 02 10:23:34 devstack sudo[104681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:34 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-560b931f-cd00-4d14-a3a6-23f258267634 tempest-VolumeDependencyTests-724561728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed1d1a13-cad3-4311-8446-63b7fcaf92a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b65175c9-bbdc-4eb8-b06d-15953654223e', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:34 devstack sudo[104682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:23:34 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-560b931f-cd00-4d14-a3a6-23f258267634 tempest-VolumeDependencyTests-724561728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18123b6a-b07c-4270-a741-3ff1399fd1a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:34 devstack sudo[104682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:34 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-560b931f-cd00-4d14-a3a6-23f258267634 tempest-VolumeDependencyTests-724561728 None] Volume volume-b65175c9-bbdc-4eb8-b06d-15953654223e (b65175c9-bbdc-4eb8-b06d-15953654223e): created successfully Nov 02 10:23:34 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-560b931f-cd00-4d14-a3a6-23f258267634 tempest-VolumeDependencyTests-724561728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18123b6a-b07c-4270-a741-3ff1399fd1a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:34 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-560b931f-cd00-4d14-a3a6-23f258267634 tempest-VolumeDependencyTests-724561728 None] Flow 'volume_create_manager' (65fa9146-9c53-4057-bb90-4b9def95f268) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:23:34 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-560b931f-cd00-4d14-a3a6-23f258267634 tempest-VolumeDependencyTests-724561728 None] Created volume successfully. Nov 02 10:23:35 devstack sudo[104682]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:35 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.263s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:35 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:23:35 devstack cinder-volume[86890]: DEBUG oslo_service.periodic_task [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Running periodic task VolumeManager._thread_info {{(pid=86890) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:23:35 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] thread count: 29 {{(pid=86890) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:23:35 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] thread info: [<_MainThread(MainThread, started 133913319395456)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86890) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:23:35 devstack sudo[104681]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:35 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-906d9275-d126-4fd2-8760-38eb53fe8019 tempest-CreateVolumesFromImageTest-1563659042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-17d6781a-724b-49d1-92f6-bdd460f57393 1073741824" returned: 0 in 0.543s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:35 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-906d9275-d126-4fd2-8760-38eb53fe8019 tempest-CreateVolumesFromImageTest-1563659042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-17d6781a-724b-49d1-92f6-bdd460f57393 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:35 devstack sudo[104690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-17d6781a-724b-49d1-92f6-bdd460f57393 Nov 02 10:23:35 devstack sudo[104690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:35 devstack sudo[104690]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:35 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-906d9275-d126-4fd2-8760-38eb53fe8019 tempest-CreateVolumesFromImageTest-1563659042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-17d6781a-724b-49d1-92f6-bdd460f57393" returned: 0 in 0.263s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:35 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-906d9275-d126-4fd2-8760-38eb53fe8019 tempest-CreateVolumesFromImageTest-1563659042 None] <== create_volume: return (860ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:23:35 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-906d9275-d126-4fd2-8760-38eb53fe8019 tempest-CreateVolumesFromImageTest-1563659042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.863s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:23:35 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-477dbc4b-8699-4838-8039-c3f8218b6d7e tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.589s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:23:35 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-477dbc4b-8699-4838-8039-c3f8218b6d7e tempest-CreateVolumesFromSourceVolumeTest-466506559 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:23:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1222306745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3748392e-5863-423c-aa48-e0035ca708fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7039fc3033ef42f1b67b7dfce204cbc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:23:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:23:34Z,use_quota=True,user_id='f341757e3c03499ea020c56af95474e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:23:35 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-477dbc4b-8699-4838-8039-c3f8218b6d7e tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Creating volume 3748392e-5863-423c-aa48-e0035ca708fd {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:23:35 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-477dbc4b-8699-4838-8039-c3f8218b6d7e tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:23:35 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-477dbc4b-8699-4838-8039-c3f8218b6d7e tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:23:35 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-477dbc4b-8699-4838-8039-c3f8218b6d7e tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:23:35 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-477dbc4b-8699-4838-8039-c3f8218b6d7e tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:23:35 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-477dbc4b-8699-4838-8039-c3f8218b6d7e tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:23:35 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-477dbc4b-8699-4838-8039-c3f8218b6d7e tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:23:35 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-477dbc4b-8699-4838-8039-c3f8218b6d7e tempest-CreateVolumesFromSourceVolumeTest-466506559 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:23:35 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-477dbc4b-8699-4838-8039-c3f8218b6d7e tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3748392e-5863-423c-aa48-e0035ca708fd 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:35 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-906d9275-d126-4fd2-8760-38eb53fe8019 tempest-CreateVolumesFromImageTest-1563659042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0046bf45-3887-4b0e-a792-ca4868c26e5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17d6781a-724b-49d1-92f6-bdd460f57393', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:35 devstack sudo[104693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3748392e-5863-423c-aa48-e0035ca708fd 1073741824 Nov 02 10:23:35 devstack sudo[104693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:35 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-906d9275-d126-4fd2-8760-38eb53fe8019 tempest-CreateVolumesFromImageTest-1563659042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ab3b5e3-317b-47e2-b786-ee162cdef117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:35 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-906d9275-d126-4fd2-8760-38eb53fe8019 tempest-CreateVolumesFromImageTest-1563659042 None] Volume volume-17d6781a-724b-49d1-92f6-bdd460f57393 (17d6781a-724b-49d1-92f6-bdd460f57393): created successfully Nov 02 10:23:35 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-906d9275-d126-4fd2-8760-38eb53fe8019 tempest-CreateVolumesFromImageTest-1563659042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ab3b5e3-317b-47e2-b786-ee162cdef117) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:35 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-906d9275-d126-4fd2-8760-38eb53fe8019 tempest-CreateVolumesFromImageTest-1563659042 None] Flow 'volume_create_manager' (6b4a31a9-d2ec-4add-b31c-ca452f8683ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:23:35 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-906d9275-d126-4fd2-8760-38eb53fe8019 tempest-CreateVolumesFromImageTest-1563659042 None] Created volume successfully. Nov 02 10:23:36 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-cb56e50f-a8d7-47c6-8309-8fb0d1f7f4a5 tempest-VolumeDependencyTests-724561728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:23:36 devstack sudo[104693]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:36 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-477dbc4b-8699-4838-8039-c3f8218b6d7e tempest-CreateVolumesFromSourceVolumeTest-466506559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3748392e-5863-423c-aa48-e0035ca708fd 1073741824" returned: 0 in 0.550s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:36 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-477dbc4b-8699-4838-8039-c3f8218b6d7e tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3748392e-5863-423c-aa48-e0035ca708fd {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:36 devstack sudo[104699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3748392e-5863-423c-aa48-e0035ca708fd Nov 02 10:23:36 devstack sudo[104699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:36 devstack sudo[104699]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:36 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-477dbc4b-8699-4838-8039-c3f8218b6d7e tempest-CreateVolumesFromSourceVolumeTest-466506559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3748392e-5863-423c-aa48-e0035ca708fd" returned: 0 in 0.245s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:36 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-477dbc4b-8699-4838-8039-c3f8218b6d7e tempest-CreateVolumesFromSourceVolumeTest-466506559 None] <== create_volume: return (849ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:23:36 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-477dbc4b-8699-4838-8039-c3f8218b6d7e tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.852s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:23:36 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-4dbae9ae-3751-41f9-bbd9-c08db01d3c08 tempest-CreateVolumesFromImageTest-1563659042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.326s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:23:36 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-4dbae9ae-3751-41f9-bbd9-c08db01d3c08 tempest-CreateVolumesFromImageTest-1563659042 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:23:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-621293445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6557c861-94c5-4e49-9b24-3e7146a5b11f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c19a8d5eaf0743fcb02ac30853647551',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:23:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:23:34Z,use_quota=True,user_id='81ea4f5b49a9417ebc416b0b6b672f9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:23:36 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-4dbae9ae-3751-41f9-bbd9-c08db01d3c08 tempest-CreateVolumesFromImageTest-1563659042 None] Creating volume 6557c861-94c5-4e49-9b24-3e7146a5b11f {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:23:36 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-4dbae9ae-3751-41f9-bbd9-c08db01d3c08 tempest-CreateVolumesFromImageTest-1563659042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:23:36 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-4dbae9ae-3751-41f9-bbd9-c08db01d3c08 tempest-CreateVolumesFromImageTest-1563659042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:23:36 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-4dbae9ae-3751-41f9-bbd9-c08db01d3c08 tempest-CreateVolumesFromImageTest-1563659042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:23:36 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-4dbae9ae-3751-41f9-bbd9-c08db01d3c08 tempest-CreateVolumesFromImageTest-1563659042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:23:36 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-4dbae9ae-3751-41f9-bbd9-c08db01d3c08 tempest-CreateVolumesFromImageTest-1563659042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:23:36 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-4dbae9ae-3751-41f9-bbd9-c08db01d3c08 tempest-CreateVolumesFromImageTest-1563659042 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:23:36 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-4dbae9ae-3751-41f9-bbd9-c08db01d3c08 tempest-CreateVolumesFromImageTest-1563659042 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:23:36 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-4dbae9ae-3751-41f9-bbd9-c08db01d3c08 tempest-CreateVolumesFromImageTest-1563659042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-6557c861-94c5-4e49-9b24-3e7146a5b11f 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:36 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-477dbc4b-8699-4838-8039-c3f8218b6d7e tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (505cd9bb-d015-4f76-98a7-4576bb879ff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3748392e-5863-423c-aa48-e0035ca708fd', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:36 devstack sudo[104702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-6557c861-94c5-4e49-9b24-3e7146a5b11f 1073741824 Nov 02 10:23:36 devstack sudo[104702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:36 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-477dbc4b-8699-4838-8039-c3f8218b6d7e tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd2165b2-2c83-411e-8937-4b86a6aacbe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:36 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-477dbc4b-8699-4838-8039-c3f8218b6d7e tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Volume volume-3748392e-5863-423c-aa48-e0035ca708fd (3748392e-5863-423c-aa48-e0035ca708fd): created successfully Nov 02 10:23:36 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-477dbc4b-8699-4838-8039-c3f8218b6d7e tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd2165b2-2c83-411e-8937-4b86a6aacbe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:36 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-477dbc4b-8699-4838-8039-c3f8218b6d7e tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Flow 'volume_create_manager' (1103b96c-a4fc-4961-a1b6-de15bf6dbbdc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:23:36 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-477dbc4b-8699-4838-8039-c3f8218b6d7e tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Created volume successfully. Nov 02 10:23:36 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a69c670-96e0-47c7-90be-5f797d14f5fd tempest-VolumeAndVolumeTypeFromImageTest-1575186715 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:23:36 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-6a69c670-96e0-47c7-90be-5f797d14f5fd tempest-VolumeAndVolumeTypeFromImageTest-1575186715 None] Flow 'volume_create_manager' (c88ce49e-b85e-4b6a-b7c2-ce61ebfb867e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:23:37 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-6a69c670-96e0-47c7-90be-5f797d14f5fd tempest-VolumeAndVolumeTypeFromImageTest-1575186715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (073556f4-656c-40bf-8b1e-dbd65f9f0e58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:37 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-6a69c670-96e0-47c7-90be-5f797d14f5fd tempest-VolumeAndVolumeTypeFromImageTest-1575186715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (073556f4-656c-40bf-8b1e-dbd65f9f0e58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:23:37Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44192c97-85d9-4333-bde5-2f6576e46327,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2e18f5b1bd7456a9a089c57017f3aeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:23:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:23:37Z,use_quota=True,user_id='ae98a73a3e33470dab4e5100e464f2ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2eb6ad5a-7b5f-4139-86f5-673e061e2f93),volume_type_id=2eb6ad5a-7b5f-4139-86f5-673e061e2f93)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:37 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-6a69c670-96e0-47c7-90be-5f797d14f5fd tempest-VolumeAndVolumeTypeFromImageTest-1575186715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2354ec3-4c35-45e9-b87f-9b74b102654a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:37 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-6a69c670-96e0-47c7-90be-5f797d14f5fd tempest-VolumeAndVolumeTypeFromImageTest-1575186715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2354ec3-4c35-45e9-b87f-9b74b102654a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:37 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-6a69c670-96e0-47c7-90be-5f797d14f5fd tempest-VolumeAndVolumeTypeFromImageTest-1575186715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13de79bc-6b00-4a85-b532-433d02eb7afc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:37 devstack cinder-volume[86890]: DEBUG cinder.image.glance [None req-6a69c670-96e0-47c7-90be-5f797d14f5fd tempest-VolumeAndVolumeTypeFromImageTest-1575186715 None] Creating Keystone auth plugin from conf {{(pid=86890) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 10:23:37 devstack sudo[104702]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:37 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-4dbae9ae-3751-41f9-bbd9-c08db01d3c08 tempest-CreateVolumesFromImageTest-1563659042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-6557c861-94c5-4e49-9b24-3e7146a5b11f 1073741824" returned: 0 in 0.552s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:37 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-4dbae9ae-3751-41f9-bbd9-c08db01d3c08 tempest-CreateVolumesFromImageTest-1563659042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-6557c861-94c5-4e49-9b24-3e7146a5b11f {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:37 devstack sudo[104708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-6557c861-94c5-4e49-9b24-3e7146a5b11f Nov 02 10:23:37 devstack sudo[104708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:37 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-7da554e4-c48c-4149-a0b2-97753b9a8d43 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:23:37 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-7da554e4-c48c-4149-a0b2-97753b9a8d43 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Flow 'volume_create_manager' (89fe660b-fd30-4668-8b8b-b50e616fcd40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:23:37 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-7da554e4-c48c-4149-a0b2-97753b9a8d43 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c701a6e-017a-4baa-96ba-de81978b58f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:37 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-7da554e4-c48c-4149-a0b2-97753b9a8d43 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c701a6e-017a-4baa-96ba-de81978b58f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:23:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-817799440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=335c025b-e99a-4269-8eb9-b7f9d3182131,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7039fc3033ef42f1b67b7dfce204cbc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:23:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:23:37Z,use_quota=True,user_id='f341757e3c03499ea020c56af95474e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:37 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-7da554e4-c48c-4149-a0b2-97753b9a8d43 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65c1314e-5f03-4145-9f12-5bdab25a47fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:37 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-7da554e4-c48c-4149-a0b2-97753b9a8d43 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65c1314e-5f03-4145-9f12-5bdab25a47fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:37 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-7da554e4-c48c-4149-a0b2-97753b9a8d43 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (038cb67d-98f6-4aa5-8460-008788f80f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:37 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-7da554e4-c48c-4149-a0b2-97753b9a8d43 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (038cb67d-98f6-4aa5-8460-008788f80f9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '335c025b-e99a-4269-8eb9-b7f9d3182131', 'volume_name': 'volume-335c025b-e99a-4269-8eb9-b7f9d3182131', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:37 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-7da554e4-c48c-4149-a0b2-97753b9a8d43 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7936f8c8-80e7-48ce-a554-25f73763fdd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:37 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-7da554e4-c48c-4149-a0b2-97753b9a8d43 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7936f8c8-80e7-48ce-a554-25f73763fdd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:37 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-7da554e4-c48c-4149-a0b2-97753b9a8d43 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b034bb1-f5e8-4287-b7bf-cf5d32073cba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:37 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-7da554e4-c48c-4149-a0b2-97753b9a8d43 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Volume 335c025b-e99a-4269-8eb9-b7f9d3182131: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-335c025b-e99a-4269-8eb9-b7f9d3182131', 'volume_size': 1} Nov 02 10:23:37 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-7da554e4-c48c-4149-a0b2-97753b9a8d43 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:23:37 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-6a69c670-96e0-47c7-90be-5f797d14f5fd tempest-VolumeAndVolumeTypeFromImageTest-1575186715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13de79bc-6b00-4a85-b532-433d02eb7afc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '44192c97-85d9-4333-bde5-2f6576e46327', 'volume_name': 'volume-44192c97-85d9-4333-bde5-2f6576e46327', 'volume_size': 1, 'image_id': '20765abf-73db-4d53-b9b7-d82f038eceea', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/20765abf-73db-4d53-b9b7-d82f038eceea', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '03054a71b552ee5658ddcd19e6d23b3e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e2e18f5b1bd7456a9a089c57017f3aeb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a3b031bb4f957bcfff982e5b9176aff569a531e07725b8e28cffa46d7521dae42e3309f089c6baa1e41f43898b49e289bad974e979045cad9b905f508a416f30', 'id': '20765abf-73db-4d53-b9b7-d82f038eceea', 'created_at': datetime.datetime(2026, 11, 2, 9, 23, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 23, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/20765abf-73db-4d53-b9b7-d82f038eceea/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:37 devstack sudo[104708]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:37 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-6a69c670-96e0-47c7-90be-5f797d14f5fd tempest-VolumeAndVolumeTypeFromImageTest-1575186715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (804bc64f-4d94-4de6-9cfb-b3e970da81fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:37 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-6a69c670-96e0-47c7-90be-5f797d14f5fd tempest-VolumeAndVolumeTypeFromImageTest-1575186715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (804bc64f-4d94-4de6-9cfb-b3e970da81fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:37 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-6a69c670-96e0-47c7-90be-5f797d14f5fd tempest-VolumeAndVolumeTypeFromImageTest-1575186715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dfb3561-4954-4922-839e-9f7b653f652f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:37 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-6a69c670-96e0-47c7-90be-5f797d14f5fd tempest-VolumeAndVolumeTypeFromImageTest-1575186715 None] Volume 44192c97-85d9-4333-bde5-2f6576e46327: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-44192c97-85d9-4333-bde5-2f6576e46327', 'volume_size': 1, 'image_id': '20765abf-73db-4d53-b9b7-d82f038eceea', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/20765abf-73db-4d53-b9b7-d82f038eceea', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '03054a71b552ee5658ddcd19e6d23b3e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e2e18f5b1bd7456a9a089c57017f3aeb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a3b031bb4f957bcfff982e5b9176aff569a531e07725b8e28cffa46d7521dae42e3309f089c6baa1e41f43898b49e289bad974e979045cad9b905f508a416f30', 'id': '20765abf-73db-4d53-b9b7-d82f038eceea', 'created_at': datetime.datetime(2026, 11, 2, 9, 23, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 23, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/20765abf-73db-4d53-b9b7-d82f038eceea/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Nov 02 10:23:37 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a69c670-96e0-47c7-90be-5f797d14f5fd tempest-VolumeAndVolumeTypeFromImageTest-1575186715 None] Trying to clone 44192c97-85d9-4333-bde5-2f6576e46327 from image 20765abf-73db-4d53-b9b7-d82f038eceea at location (None, [{'url': 'file:///opt/stack/data/glance/images/20765abf-73db-4d53-b9b7-d82f038eceea', 'metadata': {}}]). {{(pid=86890) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 02 10:23:37 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-4dbae9ae-3751-41f9-bbd9-c08db01d3c08 tempest-CreateVolumesFromImageTest-1563659042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-6557c861-94c5-4e49-9b24-3e7146a5b11f" returned: 0 in 0.375s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:37 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-4dbae9ae-3751-41f9-bbd9-c08db01d3c08 tempest-CreateVolumesFromImageTest-1563659042 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:23:37 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-4dbae9ae-3751-41f9-bbd9-c08db01d3c08 tempest-CreateVolumesFromImageTest-1563659042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:23:37 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-dad466e9-ee1e-4448-a2e0-3492584e3163 tempest-CreateVolumesFromImageTest-1563659042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.230s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:23:37 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-dad466e9-ee1e-4448-a2e0-3492584e3163 tempest-CreateVolumesFromImageTest-1563659042 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:23:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-941492963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=835a32c2-c910-4a7d-9197-7fbaef2100b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c19a8d5eaf0743fcb02ac30853647551',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:23:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:23:34Z,use_quota=True,user_id='81ea4f5b49a9417ebc416b0b6b672f9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:23:37 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-dad466e9-ee1e-4448-a2e0-3492584e3163 tempest-CreateVolumesFromImageTest-1563659042 None] Creating volume 835a32c2-c910-4a7d-9197-7fbaef2100b5 {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:23:37 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-dad466e9-ee1e-4448-a2e0-3492584e3163 tempest-CreateVolumesFromImageTest-1563659042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:23:37 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-dad466e9-ee1e-4448-a2e0-3492584e3163 tempest-CreateVolumesFromImageTest-1563659042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:23:37 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-dad466e9-ee1e-4448-a2e0-3492584e3163 tempest-CreateVolumesFromImageTest-1563659042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:23:37 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-dad466e9-ee1e-4448-a2e0-3492584e3163 tempest-CreateVolumesFromImageTest-1563659042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:23:37 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-dad466e9-ee1e-4448-a2e0-3492584e3163 tempest-CreateVolumesFromImageTest-1563659042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:23:37 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-dad466e9-ee1e-4448-a2e0-3492584e3163 tempest-CreateVolumesFromImageTest-1563659042 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:23:37 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-dad466e9-ee1e-4448-a2e0-3492584e3163 tempest-CreateVolumesFromImageTest-1563659042 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:23:37 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-dad466e9-ee1e-4448-a2e0-3492584e3163 tempest-CreateVolumesFromImageTest-1563659042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-835a32c2-c910-4a7d-9197-7fbaef2100b5 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:37 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-4dbae9ae-3751-41f9-bbd9-c08db01d3c08 tempest-CreateVolumesFromImageTest-1563659042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (741035fa-691a-4402-9ff1-01fe8f240f46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6557c861-94c5-4e49-9b24-3e7146a5b11f', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:37 devstack sudo[104711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-835a32c2-c910-4a7d-9197-7fbaef2100b5 1073741824 Nov 02 10:23:37 devstack sudo[104711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:37 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-4dbae9ae-3751-41f9-bbd9-c08db01d3c08 tempest-CreateVolumesFromImageTest-1563659042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1bd3cdb-5620-4f4e-b8ac-5edb9cfde30a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:37 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-4dbae9ae-3751-41f9-bbd9-c08db01d3c08 tempest-CreateVolumesFromImageTest-1563659042 None] Volume volume-6557c861-94c5-4e49-9b24-3e7146a5b11f (6557c861-94c5-4e49-9b24-3e7146a5b11f): created successfully Nov 02 10:23:37 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-4dbae9ae-3751-41f9-bbd9-c08db01d3c08 tempest-CreateVolumesFromImageTest-1563659042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1bd3cdb-5620-4f4e-b8ac-5edb9cfde30a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:37 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-4dbae9ae-3751-41f9-bbd9-c08db01d3c08 tempest-CreateVolumesFromImageTest-1563659042 None] Flow 'volume_create_manager' (5426d34e-80e0-4739-91b8-3027512b123f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:23:37 devstack cinder-volume[86890]: DEBUG cinder.image.image_utils [None req-6a69c670-96e0-47c7-90be-5f797d14f5fd tempest-VolumeAndVolumeTypeFromImageTest-1575186715 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_20765abf-73db-4d53-b9b7-d82f038eceea_gyvwnqakdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86890) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 02 10:23:37 devstack cinder-volume[86890]: INFO cinder.image.image_utils [None req-6a69c670-96e0-47c7-90be-5f797d14f5fd tempest-VolumeAndVolumeTypeFromImageTest-1575186715 None] Image download 0.00 MB at 0.00 MB/s Nov 02 10:23:37 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-4dbae9ae-3751-41f9-bbd9-c08db01d3c08 tempest-CreateVolumesFromImageTest-1563659042 None] Created volume successfully. Nov 02 10:23:37 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2586c12-296a-4c05-9527-67244b21cd5b]: (4, 'raw') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:23:37 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6a69c670-96e0-47c7-90be-5f797d14f5fd tempest-VolumeAndVolumeTypeFromImageTest-1575186715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_20765abf-73db-4d53-b9b7-d82f038eceea_gyvwnqakdevstack@QuobyteHD {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:37 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e8afa83-643a-42dd-9530-d582193c923d tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:23:37 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-0e8afa83-643a-42dd-9530-d582193c923d tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Flow 'volume_create_manager' (871d2a7b-eae6-4da3-9019-657cf2e281ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:23:37 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-0e8afa83-643a-42dd-9530-d582193c923d tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40fd0e9d-c860-40d4-b6d7-d315cf9d30be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:37 devstack sudo[104713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_20765abf-73db-4d53-b9b7-d82f038eceea_gyvwnqakdevstack@QuobyteHD Nov 02 10:23:37 devstack sudo[104713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:37 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-0e8afa83-643a-42dd-9530-d582193c923d tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40fd0e9d-c860-40d4-b6d7-d315cf9d30be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:23:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1243178571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de99767b-e7e2-4c5d-999e-5f869b50dfd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7039fc3033ef42f1b67b7dfce204cbc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:23:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:23:38Z,use_quota=True,user_id='f341757e3c03499ea020c56af95474e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:37 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-0e8afa83-643a-42dd-9530-d582193c923d tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec7a94a5-9d87-4d70-8d69-7ad944e5343e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:37 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-0e8afa83-643a-42dd-9530-d582193c923d tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec7a94a5-9d87-4d70-8d69-7ad944e5343e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:37 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-0e8afa83-643a-42dd-9530-d582193c923d tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce9f3af6-79a6-4076-80f7-99dd553e8d10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:38 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-0e8afa83-643a-42dd-9530-d582193c923d tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce9f3af6-79a6-4076-80f7-99dd553e8d10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de99767b-e7e2-4c5d-999e-5f869b50dfd9', 'volume_name': 'volume-de99767b-e7e2-4c5d-999e-5f869b50dfd9', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:38 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-0e8afa83-643a-42dd-9530-d582193c923d tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52c2a12a-a2bf-4938-8179-69e2cf14b7b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:38 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-0e8afa83-643a-42dd-9530-d582193c923d tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52c2a12a-a2bf-4938-8179-69e2cf14b7b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:38 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-0e8afa83-643a-42dd-9530-d582193c923d tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cd07348-621d-416c-91c7-b87af54f3405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:38 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-0e8afa83-643a-42dd-9530-d582193c923d tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Volume de99767b-e7e2-4c5d-999e-5f869b50dfd9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de99767b-e7e2-4c5d-999e-5f869b50dfd9', 'volume_size': 1} Nov 02 10:23:38 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-0e8afa83-643a-42dd-9530-d582193c923d tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:23:38 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6a69c670-96e0-47c7-90be-5f797d14f5fd tempest-VolumeAndVolumeTypeFromImageTest-1575186715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_20765abf-73db-4d53-b9b7-d82f038eceea_gyvwnqakdevstack@QuobyteHD" returned: 0 in 0.435s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:38 devstack sudo[104713]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:38 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6a69c670-96e0-47c7-90be-5f797d14f5fd tempest-VolumeAndVolumeTypeFromImageTest-1575186715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_20765abf-73db-4d53-b9b7-d82f038eceea_gyvwnqakdevstack@QuobyteHD {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:38 devstack sudo[104711]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:38 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-dad466e9-ee1e-4448-a2e0-3492584e3163 tempest-CreateVolumesFromImageTest-1563659042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-835a32c2-c910-4a7d-9197-7fbaef2100b5 1073741824" returned: 0 in 0.664s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:38 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-dad466e9-ee1e-4448-a2e0-3492584e3163 tempest-CreateVolumesFromImageTest-1563659042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-835a32c2-c910-4a7d-9197-7fbaef2100b5 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:38 devstack sudo[104722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-835a32c2-c910-4a7d-9197-7fbaef2100b5 Nov 02 10:23:38 devstack sudo[104722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:38 devstack sudo[104721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_20765abf-73db-4d53-b9b7-d82f038eceea_gyvwnqakdevstack@QuobyteHD Nov 02 10:23:38 devstack sudo[104721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:38 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-7660dee6-968b-4227-adef-48fd989aef1e tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:23:38 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-7660dee6-968b-4227-adef-48fd989aef1e tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Flow 'volume_create_manager' (9461e956-7360-45a4-abc6-13f5c2411b4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:23:38 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-7660dee6-968b-4227-adef-48fd989aef1e tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39ee9d58-7110-4c1f-a7b1-d7878fc6fd84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:38 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-7660dee6-968b-4227-adef-48fd989aef1e tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39ee9d58-7110-4c1f-a7b1-d7878fc6fd84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:23:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1200210314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2267724a-c72f-407b-8425-c07837f89882,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7039fc3033ef42f1b67b7dfce204cbc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:23:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:23:38Z,use_quota=True,user_id='f341757e3c03499ea020c56af95474e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:38 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-7660dee6-968b-4227-adef-48fd989aef1e tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b1cd5cc-0849-434d-94b3-fd9ce4c656f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:38 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-7660dee6-968b-4227-adef-48fd989aef1e tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b1cd5cc-0849-434d-94b3-fd9ce4c656f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:38 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-7660dee6-968b-4227-adef-48fd989aef1e tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d820b53-83a9-4a31-9956-71d5e5f38697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:38 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-7660dee6-968b-4227-adef-48fd989aef1e tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d820b53-83a9-4a31-9956-71d5e5f38697) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2267724a-c72f-407b-8425-c07837f89882', 'volume_name': 'volume-2267724a-c72f-407b-8425-c07837f89882', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:38 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-7660dee6-968b-4227-adef-48fd989aef1e tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dd5de19-30fd-4a01-b65f-00c8da164899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:38 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-7660dee6-968b-4227-adef-48fd989aef1e tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dd5de19-30fd-4a01-b65f-00c8da164899) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:38 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-7660dee6-968b-4227-adef-48fd989aef1e tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac19ce6a-b6dd-4f45-b7ba-5548bcb8e580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:38 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-7660dee6-968b-4227-adef-48fd989aef1e tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Volume 2267724a-c72f-407b-8425-c07837f89882: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2267724a-c72f-407b-8425-c07837f89882', 'volume_size': 1} Nov 02 10:23:38 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-7660dee6-968b-4227-adef-48fd989aef1e tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:23:38 devstack sudo[104721]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:38 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6a69c670-96e0-47c7-90be-5f797d14f5fd tempest-VolumeAndVolumeTypeFromImageTest-1575186715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_20765abf-73db-4d53-b9b7-d82f038eceea_gyvwnqakdevstack@QuobyteHD" returned: 1 in 0.464s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:38 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6a69c670-96e0-47c7-90be-5f797d14f5fd tempest-VolumeAndVolumeTypeFromImageTest-1575186715 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_20765abf-73db-4d53-b9b7-d82f038eceea_gyvwnqakdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 10:23:38 devstack cinder-volume[86890]: DEBUG cinder.image.image_utils [None req-6a69c670-96e0-47c7-90be-5f797d14f5fd tempest-VolumeAndVolumeTypeFromImageTest-1575186715 None] Temporary image 20765abf-73db-4d53-b9b7-d82f038eceea is fetched for user ae98a73a3e33470dab4e5100e464f2ac. {{(pid=86890) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 02 10:23:38 devstack sudo[104722]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:38 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-dad466e9-ee1e-4448-a2e0-3492584e3163 tempest-CreateVolumesFromImageTest-1563659042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-835a32c2-c910-4a7d-9197-7fbaef2100b5" returned: 0 in 0.377s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:38 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-dad466e9-ee1e-4448-a2e0-3492584e3163 tempest-CreateVolumesFromImageTest-1563659042 None] <== create_volume: return (1117ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:23:38 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-dad466e9-ee1e-4448-a2e0-3492584e3163 tempest-CreateVolumesFromImageTest-1563659042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.121s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:23:38 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-cc1b9781-86db-4cca-8e92-df51c4b21a67 tempest-CreateVolumesFromImageTest-1563659042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.210s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:23:38 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-cc1b9781-86db-4cca-8e92-df51c4b21a67 tempest-CreateVolumesFromImageTest-1563659042 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:23:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1768570460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c5ba789-93e1-42dc-8f3f-c67c5ca677ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c19a8d5eaf0743fcb02ac30853647551',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:23:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:23:34Z,use_quota=True,user_id='81ea4f5b49a9417ebc416b0b6b672f9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:23:38 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-cc1b9781-86db-4cca-8e92-df51c4b21a67 tempest-CreateVolumesFromImageTest-1563659042 None] Creating volume 5c5ba789-93e1-42dc-8f3f-c67c5ca677ee {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:23:38 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-cc1b9781-86db-4cca-8e92-df51c4b21a67 tempest-CreateVolumesFromImageTest-1563659042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:23:38 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-cc1b9781-86db-4cca-8e92-df51c4b21a67 tempest-CreateVolumesFromImageTest-1563659042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:23:38 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-cc1b9781-86db-4cca-8e92-df51c4b21a67 tempest-CreateVolumesFromImageTest-1563659042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:23:38 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-cc1b9781-86db-4cca-8e92-df51c4b21a67 tempest-CreateVolumesFromImageTest-1563659042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:23:38 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-cc1b9781-86db-4cca-8e92-df51c4b21a67 tempest-CreateVolumesFromImageTest-1563659042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:23:38 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-cc1b9781-86db-4cca-8e92-df51c4b21a67 tempest-CreateVolumesFromImageTest-1563659042 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:23:38 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-cc1b9781-86db-4cca-8e92-df51c4b21a67 tempest-CreateVolumesFromImageTest-1563659042 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:23:38 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-cc1b9781-86db-4cca-8e92-df51c4b21a67 tempest-CreateVolumesFromImageTest-1563659042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-5c5ba789-93e1-42dc-8f3f-c67c5ca677ee 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:38 devstack sudo[104729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-5c5ba789-93e1-42dc-8f3f-c67c5ca677ee 1073741824 Nov 02 10:23:38 devstack sudo[104729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:38 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-dad466e9-ee1e-4448-a2e0-3492584e3163 tempest-CreateVolumesFromImageTest-1563659042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e118e35-4091-4f36-bfc6-f241158b6fdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-835a32c2-c910-4a7d-9197-7fbaef2100b5', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:38 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-dad466e9-ee1e-4448-a2e0-3492584e3163 tempest-CreateVolumesFromImageTest-1563659042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66b6bf56-ad5f-4c85-a46c-30696a56c10c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:38 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d27457d-c3f6-403b-8c73-dbc7a094abbd tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:23:38 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-5d27457d-c3f6-403b-8c73-dbc7a094abbd tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Flow 'volume_create_manager' (7c9adcf3-c18c-492d-aa7c-bd95bce52a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:23:38 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-5d27457d-c3f6-403b-8c73-dbc7a094abbd tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acec64ca-a1dc-4e01-a79e-5bba4c96d543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:38 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-dad466e9-ee1e-4448-a2e0-3492584e3163 tempest-CreateVolumesFromImageTest-1563659042 None] Volume volume-835a32c2-c910-4a7d-9197-7fbaef2100b5 (835a32c2-c910-4a7d-9197-7fbaef2100b5): created successfully Nov 02 10:23:38 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-dad466e9-ee1e-4448-a2e0-3492584e3163 tempest-CreateVolumesFromImageTest-1563659042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66b6bf56-ad5f-4c85-a46c-30696a56c10c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:38 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-dad466e9-ee1e-4448-a2e0-3492584e3163 tempest-CreateVolumesFromImageTest-1563659042 None] Flow 'volume_create_manager' (987d65e2-bf24-4976-b523-4c6a488d16e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:23:38 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-5d27457d-c3f6-403b-8c73-dbc7a094abbd tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acec64ca-a1dc-4e01-a79e-5bba4c96d543) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:23:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-824324108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1b712b0-1dd1-4635-875b-15370a182d9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7039fc3033ef42f1b67b7dfce204cbc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:23:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:23:39Z,use_quota=True,user_id='f341757e3c03499ea020c56af95474e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:38 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-5d27457d-c3f6-403b-8c73-dbc7a094abbd tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61d27592-4a45-4c1d-8c7e-082688cdd897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:38 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-5d27457d-c3f6-403b-8c73-dbc7a094abbd tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61d27592-4a45-4c1d-8c7e-082688cdd897) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:38 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-5d27457d-c3f6-403b-8c73-dbc7a094abbd tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a7c43bf-0081-45e8-ba3c-cba7464f0e8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:38 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-5d27457d-c3f6-403b-8c73-dbc7a094abbd tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a7c43bf-0081-45e8-ba3c-cba7464f0e8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1b712b0-1dd1-4635-875b-15370a182d9b', 'volume_name': 'volume-a1b712b0-1dd1-4635-875b-15370a182d9b', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:38 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-5d27457d-c3f6-403b-8c73-dbc7a094abbd tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86165637-f5b7-4372-a6b1-3d3f3048a97d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:38 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-5d27457d-c3f6-403b-8c73-dbc7a094abbd tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86165637-f5b7-4372-a6b1-3d3f3048a97d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:38 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-5d27457d-c3f6-403b-8c73-dbc7a094abbd tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50fed9bc-c9eb-4354-93ff-52e828701bd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:38 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-5d27457d-c3f6-403b-8c73-dbc7a094abbd tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Volume a1b712b0-1dd1-4635-875b-15370a182d9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1b712b0-1dd1-4635-875b-15370a182d9b', 'volume_size': 1} Nov 02 10:23:38 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-5d27457d-c3f6-403b-8c73-dbc7a094abbd tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:23:38 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3c13f36-2e1c-494e-b72a-27b6eb7bf739]: (4, 'raw') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:23:38 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6a69c670-96e0-47c7-90be-5f797d14f5fd tempest-VolumeAndVolumeTypeFromImageTest-1575186715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_20765abf-73db-4d53-b9b7-d82f038eceea_gyvwnqakdevstack@QuobyteHD {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:38 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-dad466e9-ee1e-4448-a2e0-3492584e3163 tempest-CreateVolumesFromImageTest-1563659042 None] Created volume successfully. Nov 02 10:23:39 devstack sudo[104731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_20765abf-73db-4d53-b9b7-d82f038eceea_gyvwnqakdevstack@QuobyteHD Nov 02 10:23:39 devstack sudo[104731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:39 devstack sudo[104731]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:39 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6a69c670-96e0-47c7-90be-5f797d14f5fd tempest-VolumeAndVolumeTypeFromImageTest-1575186715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_20765abf-73db-4d53-b9b7-d82f038eceea_gyvwnqakdevstack@QuobyteHD" returned: 0 in 0.383s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:39 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6a69c670-96e0-47c7-90be-5f797d14f5fd tempest-VolumeAndVolumeTypeFromImageTest-1575186715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_20765abf-73db-4d53-b9b7-d82f038eceea_gyvwnqakdevstack@QuobyteHD {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:39 devstack sudo[104729]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:39 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-cc1b9781-86db-4cca-8e92-df51c4b21a67 tempest-CreateVolumesFromImageTest-1563659042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-5c5ba789-93e1-42dc-8f3f-c67c5ca677ee 1073741824" returned: 0 in 0.587s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:39 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-0527483a-1145-4c59-b7eb-6c4353374c35 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:23:39 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-0527483a-1145-4c59-b7eb-6c4353374c35 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Flow 'volume_create_manager' (bf81153d-06fe-4b6c-9652-1b8cb9999b69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:23:39 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-0527483a-1145-4c59-b7eb-6c4353374c35 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66f4b0f3-698d-4962-bc33-ead0cf436784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:39 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-0527483a-1145-4c59-b7eb-6c4353374c35 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66f4b0f3-698d-4962-bc33-ead0cf436784) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:23:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-234548741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=787ec981-b796-49a2-82ac-517772791929,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7039fc3033ef42f1b67b7dfce204cbc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:23:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:23:39Z,use_quota=True,user_id='f341757e3c03499ea020c56af95474e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:39 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-0527483a-1145-4c59-b7eb-6c4353374c35 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e2fb4b7-90f5-420e-9139-317dafdf1ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:39 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-0527483a-1145-4c59-b7eb-6c4353374c35 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e2fb4b7-90f5-420e-9139-317dafdf1ead) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:39 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-0527483a-1145-4c59-b7eb-6c4353374c35 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a655626-8eee-48c7-bc95-d277f7ed2d84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:39 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-0527483a-1145-4c59-b7eb-6c4353374c35 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a655626-8eee-48c7-bc95-d277f7ed2d84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '787ec981-b796-49a2-82ac-517772791929', 'volume_name': 'volume-787ec981-b796-49a2-82ac-517772791929', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:39 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-0527483a-1145-4c59-b7eb-6c4353374c35 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c75dbb9-35b7-44c7-8a98-1be7b8d1a01e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:39 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-0527483a-1145-4c59-b7eb-6c4353374c35 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c75dbb9-35b7-44c7-8a98-1be7b8d1a01e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:39 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-0527483a-1145-4c59-b7eb-6c4353374c35 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23aa8c72-98ff-4ee5-9e4d-d107ae418bef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:39 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-0527483a-1145-4c59-b7eb-6c4353374c35 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Volume 787ec981-b796-49a2-82ac-517772791929: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-787ec981-b796-49a2-82ac-517772791929', 'volume_size': 1} Nov 02 10:23:39 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-0527483a-1145-4c59-b7eb-6c4353374c35 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:23:39 devstack sudo[104739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_20765abf-73db-4d53-b9b7-d82f038eceea_gyvwnqakdevstack@QuobyteHD Nov 02 10:23:39 devstack sudo[104739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:39 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-cc1b9781-86db-4cca-8e92-df51c4b21a67 tempest-CreateVolumesFromImageTest-1563659042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-5c5ba789-93e1-42dc-8f3f-c67c5ca677ee {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:39 devstack sudo[104741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-5c5ba789-93e1-42dc-8f3f-c67c5ca677ee Nov 02 10:23:39 devstack sudo[104741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:39 devstack sudo[104739]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:39 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6a69c670-96e0-47c7-90be-5f797d14f5fd tempest-VolumeAndVolumeTypeFromImageTest-1575186715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_20765abf-73db-4d53-b9b7-d82f038eceea_gyvwnqakdevstack@QuobyteHD" returned: 1 in 0.361s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:39 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6a69c670-96e0-47c7-90be-5f797d14f5fd tempest-VolumeAndVolumeTypeFromImageTest-1575186715 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_20765abf-73db-4d53-b9b7-d82f038eceea_gyvwnqakdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 10:23:39 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-6a69c670-96e0-47c7-90be-5f797d14f5fd tempest-VolumeAndVolumeTypeFromImageTest-1575186715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:23:39 devstack sudo[104741]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:39 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-cc1b9781-86db-4cca-8e92-df51c4b21a67 tempest-CreateVolumesFromImageTest-1563659042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-5c5ba789-93e1-42dc-8f3f-c67c5ca677ee" returned: 0 in 0.256s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:39 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-cc1b9781-86db-4cca-8e92-df51c4b21a67 tempest-CreateVolumesFromImageTest-1563659042 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:23:39 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-cc1b9781-86db-4cca-8e92-df51c4b21a67 tempest-CreateVolumesFromImageTest-1563659042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:23:39 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-cb56e50f-a8d7-47c6-8309-8fb0d1f7f4a5 tempest-VolumeDependencyTests-724561728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.532s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:23:39 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-cc1b9781-86db-4cca-8e92-df51c4b21a67 tempest-CreateVolumesFromImageTest-1563659042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (740ca061-f44a-4c2c-8726-725b324ee03f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c5ba789-93e1-42dc-8f3f-c67c5ca677ee', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:39 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-cc1b9781-86db-4cca-8e92-df51c4b21a67 tempest-CreateVolumesFromImageTest-1563659042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a55c1d52-89f5-410d-9eea-58fdfcd44e6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:39 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-cb56e50f-a8d7-47c6-8309-8fb0d1f7f4a5 tempest-VolumeDependencyTests-724561728 None] Creating offline snapshot 5e8d7cd2-68aa-49a7-b7a2-e726d17a7685 of volume b65175c9-bbdc-4eb8-b06d-15953654223e {{(pid=86890) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:23:39 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-cc1b9781-86db-4cca-8e92-df51c4b21a67 tempest-CreateVolumesFromImageTest-1563659042 None] Volume volume-5c5ba789-93e1-42dc-8f3f-c67c5ca677ee (5c5ba789-93e1-42dc-8f3f-c67c5ca677ee): created successfully Nov 02 10:23:39 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-cc1b9781-86db-4cca-8e92-df51c4b21a67 tempest-CreateVolumesFromImageTest-1563659042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a55c1d52-89f5-410d-9eea-58fdfcd44e6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:39 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-cc1b9781-86db-4cca-8e92-df51c4b21a67 tempest-CreateVolumesFromImageTest-1563659042 None] Flow 'volume_create_manager' (84ec8192-e3ca-4016-9ed6-8422a30a7df2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:23:39 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[417d1778-feb9-450f-b297-cbf999557a5d]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:23:39 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-cb56e50f-a8d7-47c6-8309-8fb0d1f7f4a5 tempest-VolumeDependencyTests-724561728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b65175c9-bbdc-4eb8-b06d-15953654223e {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:39 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-cc1b9781-86db-4cca-8e92-df51c4b21a67 tempest-CreateVolumesFromImageTest-1563659042 None] Created volume successfully. Nov 02 10:23:39 devstack sudo[104747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b65175c9-bbdc-4eb8-b06d-15953654223e Nov 02 10:23:39 devstack sudo[104747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:40 devstack sudo[104747]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:40 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-cb56e50f-a8d7-47c6-8309-8fb0d1f7f4a5 tempest-VolumeDependencyTests-724561728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b65175c9-bbdc-4eb8-b06d-15953654223e" returned: 0 in 0.385s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:40 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-cb56e50f-a8d7-47c6-8309-8fb0d1f7f4a5 tempest-VolumeDependencyTests-724561728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b65175c9-bbdc-4eb8-b06d-15953654223e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b65175c9-bbdc-4eb8-b06d-15953654223e.5e8d7cd2-68aa-49a7-b7a2-e726d17a7685 1G {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:40 devstack sudo[104752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b65175c9-bbdc-4eb8-b06d-15953654223e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b65175c9-bbdc-4eb8-b06d-15953654223e.5e8d7cd2-68aa-49a7-b7a2-e726d17a7685 1G Nov 02 10:23:40 devstack sudo[104752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:40 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-ceacb069-c508-4713-bf4a-a995f4025790 tempest-CreateVolumesFromImageTest-1563659042 None] Acquiring lock "cinder-5c5ba789-93e1-42dc-8f3f-c67c5ca677ee-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:23:40 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-ceacb069-c508-4713-bf4a-a995f4025790 tempest-CreateVolumesFromImageTest-1563659042 None] Lock "cinder-5c5ba789-93e1-42dc-8f3f-c67c5ca677ee-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:23:40 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-ceacb069-c508-4713-bf4a-a995f4025790 tempest-CreateVolumesFromImageTest-1563659042 None] Acquiring lock "cinder-quobyte-5c5ba789-93e1-42dc-8f3f-c67c5ca677ee" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:23:40 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-ceacb069-c508-4713-bf4a-a995f4025790 tempest-CreateVolumesFromImageTest-1563659042 None] Lock "cinder-quobyte-5c5ba789-93e1-42dc-8f3f-c67c5ca677ee" acquired by "delete_volume" :: waited 0.017s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:23:40 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e733d72-f030-45c2-9b3f-55bd0548ee3d]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:23:40 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ceacb069-c508-4713-bf4a-a995f4025790 tempest-CreateVolumesFromImageTest-1563659042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-5c5ba789-93e1-42dc-8f3f-c67c5ca677ee {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:40 devstack sudo[104752]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:40 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-cb56e50f-a8d7-47c6-8309-8fb0d1f7f4a5 tempest-VolumeDependencyTests-724561728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b65175c9-bbdc-4eb8-b06d-15953654223e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b65175c9-bbdc-4eb8-b06d-15953654223e.5e8d7cd2-68aa-49a7-b7a2-e726d17a7685 1G" returned: 0 in 0.498s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:40 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-cb56e50f-a8d7-47c6-8309-8fb0d1f7f4a5 tempest-VolumeDependencyTests-724561728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b65175c9-bbdc-4eb8-b06d-15953654223e -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b65175c9-bbdc-4eb8-b06d-15953654223e.5e8d7cd2-68aa-49a7-b7a2-e726d17a7685 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:40 devstack sudo[104759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b65175c9-bbdc-4eb8-b06d-15953654223e -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b65175c9-bbdc-4eb8-b06d-15953654223e.5e8d7cd2-68aa-49a7-b7a2-e726d17a7685 Nov 02 10:23:40 devstack sudo[104759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:40 devstack sudo[104758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-5c5ba789-93e1-42dc-8f3f-c67c5ca677ee Nov 02 10:23:40 devstack sudo[104758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:40 devstack sudo[104759]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:40 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-cb56e50f-a8d7-47c6-8309-8fb0d1f7f4a5 tempest-VolumeDependencyTests-724561728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b65175c9-bbdc-4eb8-b06d-15953654223e -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b65175c9-bbdc-4eb8-b06d-15953654223e.5e8d7cd2-68aa-49a7-b7a2-e726d17a7685" returned: 0 in 0.281s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:40 devstack cinder-volume[86890]: WARNING cinder.volume.drivers.remotefs [None req-cb56e50f-a8d7-47c6-8309-8fb0d1f7f4a5 tempest-VolumeDependencyTests-724561728 None] /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b65175c9-bbdc-4eb8-b06d-15953654223e.5e8d7cd2-68aa-49a7-b7a2-e726d17a7685 is being set with open permissions: ugo+rw Nov 02 10:23:40 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-cb56e50f-a8d7-47c6-8309-8fb0d1f7f4a5 tempest-VolumeDependencyTests-724561728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b65175c9-bbdc-4eb8-b06d-15953654223e.5e8d7cd2-68aa-49a7-b7a2-e726d17a7685 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:40 devstack sudo[104767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b65175c9-bbdc-4eb8-b06d-15953654223e.5e8d7cd2-68aa-49a7-b7a2-e726d17a7685 Nov 02 10:23:40 devstack sudo[104767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:40 devstack sudo[104758]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:41 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ceacb069-c508-4713-bf4a-a995f4025790 tempest-CreateVolumesFromImageTest-1563659042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-5c5ba789-93e1-42dc-8f3f-c67c5ca677ee" returned: 0 in 0.363s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:41 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ceacb069-c508-4713-bf4a-a995f4025790 tempest-CreateVolumesFromImageTest-1563659042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-5c5ba789-93e1-42dc-8f3f-c67c5ca677ee {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:41 devstack sudo[104770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-5c5ba789-93e1-42dc-8f3f-c67c5ca677ee Nov 02 10:23:41 devstack sudo[104770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:41 devstack sudo[104767]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:41 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-cb56e50f-a8d7-47c6-8309-8fb0d1f7f4a5 tempest-VolumeDependencyTests-724561728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b65175c9-bbdc-4eb8-b06d-15953654223e.5e8d7cd2-68aa-49a7-b7a2-e726d17a7685" returned: 0 in 0.262s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:41 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-cb56e50f-a8d7-47c6-8309-8fb0d1f7f4a5 tempest-VolumeDependencyTests-724561728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b65175c9-bbdc-4eb8-b06d-15953654223e.info {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:41 devstack sudo[104774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b65175c9-bbdc-4eb8-b06d-15953654223e.info Nov 02 10:23:41 devstack sudo[104774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:41 devstack sudo[104770]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:41 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ceacb069-c508-4713-bf4a-a995f4025790 tempest-CreateVolumesFromImageTest-1563659042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-5c5ba789-93e1-42dc-8f3f-c67c5ca677ee" returned: 0 in 0.272s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:41 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-ceacb069-c508-4713-bf4a-a995f4025790 tempest-CreateVolumesFromImageTest-1563659042 None] Lock "cinder-quobyte-5c5ba789-93e1-42dc-8f3f-c67c5ca677ee" released by "delete_volume" :: held 0.679s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:23:41 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-ceacb069-c508-4713-bf4a-a995f4025790 tempest-CreateVolumesFromImageTest-1563659042 None] Created reservations ['b51305b3-a043-48c7-a2ae-750254190783', '4f0a8642-f69d-42ea-9a15-00eec665fb2c', '504b91c7-03bb-4b37-bce6-19279d034496', 'd3f5a424-7d42-4602-a19c-a79033a01e77'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:23:41 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-ceacb069-c508-4713-bf4a-a995f4025790 tempest-CreateVolumesFromImageTest-1563659042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:23:41 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-ceacb069-c508-4713-bf4a-a995f4025790 tempest-CreateVolumesFromImageTest-1563659042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:23:41 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-ceacb069-c508-4713-bf4a-a995f4025790 tempest-CreateVolumesFromImageTest-1563659042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:23:41 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-ceacb069-c508-4713-bf4a-a995f4025790 tempest-CreateVolumesFromImageTest-1563659042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:23:41 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-ceacb069-c508-4713-bf4a-a995f4025790 tempest-CreateVolumesFromImageTest-1563659042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:23:41 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ceacb069-c508-4713-bf4a-a995f4025790 tempest-CreateVolumesFromImageTest-1563659042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:41 devstack sudo[104776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:23:41 devstack sudo[104776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:41 devstack sudo[104774]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:41 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-cb56e50f-a8d7-47c6-8309-8fb0d1f7f4a5 tempest-VolumeDependencyTests-724561728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b65175c9-bbdc-4eb8-b06d-15953654223e.info" returned: 0 in 0.271s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:41 devstack cinder-volume[86890]: WARNING cinder.volume.drivers.remotefs [None req-cb56e50f-a8d7-47c6-8309-8fb0d1f7f4a5 tempest-VolumeDependencyTests-724561728 None] /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b65175c9-bbdc-4eb8-b06d-15953654223e.info is being set with open permissions: ugo+rw Nov 02 10:23:41 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-cb56e50f-a8d7-47c6-8309-8fb0d1f7f4a5 tempest-VolumeDependencyTests-724561728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b65175c9-bbdc-4eb8-b06d-15953654223e.info {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:41 devstack sudo[104779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b65175c9-bbdc-4eb8-b06d-15953654223e.info Nov 02 10:23:41 devstack sudo[104779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:41 devstack sudo[104776]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:41 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ceacb069-c508-4713-bf4a-a995f4025790 tempest-CreateVolumesFromImageTest-1563659042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.245s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:41 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-ceacb069-c508-4713-bf4a-a995f4025790 tempest-CreateVolumesFromImageTest-1563659042 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:23:41 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-ceacb069-c508-4713-bf4a-a995f4025790 tempest-CreateVolumesFromImageTest-1563659042 None] Deleted volume successfully. Nov 02 10:23:41 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-ceacb069-c508-4713-bf4a-a995f4025790 tempest-CreateVolumesFromImageTest-1563659042 None] Lock "cinder-5c5ba789-93e1-42dc-8f3f-c67c5ca677ee-delete_volume" released by "delete_volume" :: held 1.160s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:23:41 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-222321c6-3b0b-4e26-99c0-740eb33899fc tempest-CreateVolumesFromImageTest-1563659042 None] Acquiring lock "cinder-835a32c2-c910-4a7d-9197-7fbaef2100b5-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:23:41 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-222321c6-3b0b-4e26-99c0-740eb33899fc tempest-CreateVolumesFromImageTest-1563659042 None] Lock "cinder-835a32c2-c910-4a7d-9197-7fbaef2100b5-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:23:41 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-222321c6-3b0b-4e26-99c0-740eb33899fc tempest-CreateVolumesFromImageTest-1563659042 None] Acquiring lock "cinder-quobyte-835a32c2-c910-4a7d-9197-7fbaef2100b5" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:23:41 devstack sudo[104779]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:41 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-cb56e50f-a8d7-47c6-8309-8fb0d1f7f4a5 tempest-VolumeDependencyTests-724561728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b65175c9-bbdc-4eb8-b06d-15953654223e.info" returned: 0 in 0.288s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:41 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-cb56e50f-a8d7-47c6-8309-8fb0d1f7f4a5 tempest-VolumeDependencyTests-724561728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.112s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:23:41 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-222321c6-3b0b-4e26-99c0-740eb33899fc tempest-CreateVolumesFromImageTest-1563659042 None] Lock "cinder-quobyte-835a32c2-c910-4a7d-9197-7fbaef2100b5" acquired by "delete_volume" :: waited 0.040s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:23:41 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-7da554e4-c48c-4149-a0b2-97753b9a8d43 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.319s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:23:41 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-7da554e4-c48c-4149-a0b2-97753b9a8d43 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:23:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-817799440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=335c025b-e99a-4269-8eb9-b7f9d3182131,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7039fc3033ef42f1b67b7dfce204cbc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:23:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:23:37Z,use_quota=True,user_id='f341757e3c03499ea020c56af95474e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:23:41 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-7da554e4-c48c-4149-a0b2-97753b9a8d43 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Creating volume 335c025b-e99a-4269-8eb9-b7f9d3182131 {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:23:41 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-7da554e4-c48c-4149-a0b2-97753b9a8d43 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:23:41 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-7da554e4-c48c-4149-a0b2-97753b9a8d43 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:23:41 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-7da554e4-c48c-4149-a0b2-97753b9a8d43 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:23:41 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-7da554e4-c48c-4149-a0b2-97753b9a8d43 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:23:41 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-7da554e4-c48c-4149-a0b2-97753b9a8d43 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:23:41 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-7da554e4-c48c-4149-a0b2-97753b9a8d43 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:23:41 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-7da554e4-c48c-4149-a0b2-97753b9a8d43 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:23:41 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-7da554e4-c48c-4149-a0b2-97753b9a8d43 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-335c025b-e99a-4269-8eb9-b7f9d3182131 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:41 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[a33afc36-5cc6-4d54-91b9-a7ec8471f496]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:23:41 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-222321c6-3b0b-4e26-99c0-740eb33899fc tempest-CreateVolumesFromImageTest-1563659042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-835a32c2-c910-4a7d-9197-7fbaef2100b5 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:41 devstack sudo[104783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-335c025b-e99a-4269-8eb9-b7f9d3182131 1073741824 Nov 02 10:23:41 devstack sudo[104783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:41 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-cb56e50f-a8d7-47c6-8309-8fb0d1f7f4a5 tempest-VolumeDependencyTests-724561728 None] Create snapshot completed successfully Nov 02 10:23:41 devstack sudo[104784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-835a32c2-c910-4a7d-9197-7fbaef2100b5 Nov 02 10:23:41 devstack sudo[104784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:42 devstack sudo[104784]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:42 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-222321c6-3b0b-4e26-99c0-740eb33899fc tempest-CreateVolumesFromImageTest-1563659042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-835a32c2-c910-4a7d-9197-7fbaef2100b5" returned: 0 in 0.443s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:42 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-222321c6-3b0b-4e26-99c0-740eb33899fc tempest-CreateVolumesFromImageTest-1563659042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-835a32c2-c910-4a7d-9197-7fbaef2100b5 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:42 devstack sudo[104783]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:42 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-7da554e4-c48c-4149-a0b2-97753b9a8d43 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-335c025b-e99a-4269-8eb9-b7f9d3182131 1073741824" returned: 0 in 0.483s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:42 devstack sudo[104794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-835a32c2-c910-4a7d-9197-7fbaef2100b5 Nov 02 10:23:42 devstack sudo[104794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:42 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-7da554e4-c48c-4149-a0b2-97753b9a8d43 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-335c025b-e99a-4269-8eb9-b7f9d3182131 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:42 devstack sudo[104796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-335c025b-e99a-4269-8eb9-b7f9d3182131 Nov 02 10:23:42 devstack sudo[104796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:42 devstack sudo[104794]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:42 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-222321c6-3b0b-4e26-99c0-740eb33899fc tempest-CreateVolumesFromImageTest-1563659042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-835a32c2-c910-4a7d-9197-7fbaef2100b5" returned: 0 in 0.266s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:42 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-222321c6-3b0b-4e26-99c0-740eb33899fc tempest-CreateVolumesFromImageTest-1563659042 None] Lock "cinder-quobyte-835a32c2-c910-4a7d-9197-7fbaef2100b5" released by "delete_volume" :: held 0.771s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:23:42 devstack sudo[104796]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:42 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-7da554e4-c48c-4149-a0b2-97753b9a8d43 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-335c025b-e99a-4269-8eb9-b7f9d3182131" returned: 0 in 0.262s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:42 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-7da554e4-c48c-4149-a0b2-97753b9a8d43 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] <== create_volume: return (792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:23:42 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-7da554e4-c48c-4149-a0b2-97753b9a8d43 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.797s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:23:42 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-0e8afa83-643a-42dd-9530-d582193c923d tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.590s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:23:42 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-0e8afa83-643a-42dd-9530-d582193c923d tempest-CreateVolumesFromSourceVolumeTest-466506559 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:23:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1243178571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de99767b-e7e2-4c5d-999e-5f869b50dfd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7039fc3033ef42f1b67b7dfce204cbc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:23:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:23:38Z,use_quota=True,user_id='f341757e3c03499ea020c56af95474e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:23:42 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-0e8afa83-643a-42dd-9530-d582193c923d tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Creating volume de99767b-e7e2-4c5d-999e-5f869b50dfd9 {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:23:42 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-0e8afa83-643a-42dd-9530-d582193c923d tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:23:42 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-0e8afa83-643a-42dd-9530-d582193c923d tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:23:42 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-0e8afa83-643a-42dd-9530-d582193c923d tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:23:42 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-0e8afa83-643a-42dd-9530-d582193c923d tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:23:42 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-0e8afa83-643a-42dd-9530-d582193c923d tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:23:42 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-0e8afa83-643a-42dd-9530-d582193c923d tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:23:42 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-0e8afa83-643a-42dd-9530-d582193c923d tempest-CreateVolumesFromSourceVolumeTest-466506559 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:23:42 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-0e8afa83-643a-42dd-9530-d582193c923d tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-de99767b-e7e2-4c5d-999e-5f869b50dfd9 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:42 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-7da554e4-c48c-4149-a0b2-97753b9a8d43 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b034bb1-f5e8-4287-b7bf-cf5d32073cba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-335c025b-e99a-4269-8eb9-b7f9d3182131', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:42 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-7da554e4-c48c-4149-a0b2-97753b9a8d43 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb582b35-b625-494a-a100-e288b07a9651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:42 devstack sudo[104800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-de99767b-e7e2-4c5d-999e-5f869b50dfd9 1073741824 Nov 02 10:23:42 devstack sudo[104800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:42 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-222321c6-3b0b-4e26-99c0-740eb33899fc tempest-CreateVolumesFromImageTest-1563659042 None] Created reservations ['82e53f28-0c71-44a5-aedb-d670df82d48e', 'e716f0b6-a4c4-465c-9cdf-8ed342d4539c', 'b7a4dca7-6d37-44a0-91d3-2673b9d1ab78', 'e473c24c-5b80-4fcd-bf8e-dca1229c00fc'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:23:42 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-7da554e4-c48c-4149-a0b2-97753b9a8d43 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Volume volume-335c025b-e99a-4269-8eb9-b7f9d3182131 (335c025b-e99a-4269-8eb9-b7f9d3182131): created successfully Nov 02 10:23:42 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-7da554e4-c48c-4149-a0b2-97753b9a8d43 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb582b35-b625-494a-a100-e288b07a9651) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:42 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-7da554e4-c48c-4149-a0b2-97753b9a8d43 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Flow 'volume_create_manager' (89fe660b-fd30-4668-8b8b-b50e616fcd40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:23:42 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-7da554e4-c48c-4149-a0b2-97753b9a8d43 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Created volume successfully. Nov 02 10:23:42 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-222321c6-3b0b-4e26-99c0-740eb33899fc tempest-CreateVolumesFromImageTest-1563659042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:23:42 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-222321c6-3b0b-4e26-99c0-740eb33899fc tempest-CreateVolumesFromImageTest-1563659042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:23:42 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-222321c6-3b0b-4e26-99c0-740eb33899fc tempest-CreateVolumesFromImageTest-1563659042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:23:42 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-222321c6-3b0b-4e26-99c0-740eb33899fc tempest-CreateVolumesFromImageTest-1563659042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:23:42 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-222321c6-3b0b-4e26-99c0-740eb33899fc tempest-CreateVolumesFromImageTest-1563659042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:23:42 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-222321c6-3b0b-4e26-99c0-740eb33899fc tempest-CreateVolumesFromImageTest-1563659042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:42 devstack sudo[104802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:23:42 devstack sudo[104802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:42 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-02af45e3-1d5e-40fa-a2cd-a66f8a366784 tempest-CreateVolumesFromImageTest-1563659042 None] Acquiring lock "cinder-6557c861-94c5-4e49-9b24-3e7146a5b11f-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:23:42 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-02af45e3-1d5e-40fa-a2cd-a66f8a366784 tempest-CreateVolumesFromImageTest-1563659042 None] Lock "cinder-6557c861-94c5-4e49-9b24-3e7146a5b11f-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:23:43 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-02af45e3-1d5e-40fa-a2cd-a66f8a366784 tempest-CreateVolumesFromImageTest-1563659042 None] Acquiring lock "cinder-quobyte-6557c861-94c5-4e49-9b24-3e7146a5b11f" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:23:43 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-02af45e3-1d5e-40fa-a2cd-a66f8a366784 tempest-CreateVolumesFromImageTest-1563659042 None] Lock "cinder-quobyte-6557c861-94c5-4e49-9b24-3e7146a5b11f" acquired by "delete_volume" :: waited 0.023s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:23:43 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f199920-36f6-4e11-b5dc-1e208a618107]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:23:43 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-02af45e3-1d5e-40fa-a2cd-a66f8a366784 tempest-CreateVolumesFromImageTest-1563659042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-6557c861-94c5-4e49-9b24-3e7146a5b11f {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:43 devstack sudo[104802]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:43 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-222321c6-3b0b-4e26-99c0-740eb33899fc tempest-CreateVolumesFromImageTest-1563659042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.332s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:43 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-222321c6-3b0b-4e26-99c0-740eb33899fc tempest-CreateVolumesFromImageTest-1563659042 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:23:43 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-222321c6-3b0b-4e26-99c0-740eb33899fc tempest-CreateVolumesFromImageTest-1563659042 None] Deleted volume successfully. Nov 02 10:23:43 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-222321c6-3b0b-4e26-99c0-740eb33899fc tempest-CreateVolumesFromImageTest-1563659042 None] Lock "cinder-835a32c2-c910-4a7d-9197-7fbaef2100b5-delete_volume" released by "delete_volume" :: held 1.422s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:23:43 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e8f677b-2db3-413d-bc65-983a0009ed1f tempest-VolumeDependencyTests-724561728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:23:43 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-8e8f677b-2db3-413d-bc65-983a0009ed1f tempest-VolumeDependencyTests-724561728 None] Flow 'volume_create_manager' (07f9a050-6a09-4d23-964a-3e9274c4e8a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:23:43 devstack sudo[104808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-6557c861-94c5-4e49-9b24-3e7146a5b11f Nov 02 10:23:43 devstack sudo[104808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:43 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-8e8f677b-2db3-413d-bc65-983a0009ed1f tempest-VolumeDependencyTests-724561728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c580906-96a1-4b26-bdb9-595bdc07bf9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:43 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-8e8f677b-2db3-413d-bc65-983a0009ed1f tempest-VolumeDependencyTests-724561728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c580906-96a1-4b26-bdb9-595bdc07bf9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:23:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1587837505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16a919b3-4c6f-439b-b8cd-35118a9a3a83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f71543519d98466a90b42fd2459a6fef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:23:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5e8d7cd2-68aa-49a7-b7a2-e726d17a7685,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:23:43Z,use_quota=True,user_id='4c9843acb10b46879f5a589aea244ec3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:43 devstack sudo[104800]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:43 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-8e8f677b-2db3-413d-bc65-983a0009ed1f tempest-VolumeDependencyTests-724561728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e011c6fd-d177-410e-839c-593cb5b9eb4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:43 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-8e8f677b-2db3-413d-bc65-983a0009ed1f tempest-VolumeDependencyTests-724561728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e011c6fd-d177-410e-839c-593cb5b9eb4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:43 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-8e8f677b-2db3-413d-bc65-983a0009ed1f tempest-VolumeDependencyTests-724561728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5320935-7368-487d-ae84-370296d29782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:43 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-8e8f677b-2db3-413d-bc65-983a0009ed1f tempest-VolumeDependencyTests-724561728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5320935-7368-487d-ae84-370296d29782) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '16a919b3-4c6f-439b-b8cd-35118a9a3a83', 'volume_name': 'volume-16a919b3-4c6f-439b-b8cd-35118a9a3a83', 'volume_size': 1, 'snapshot_id': '5e8d7cd2-68aa-49a7-b7a2-e726d17a7685'}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:43 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-8e8f677b-2db3-413d-bc65-983a0009ed1f tempest-VolumeDependencyTests-724561728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (912a61f7-662d-4668-9203-3b16c96a8cf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:43 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-8e8f677b-2db3-413d-bc65-983a0009ed1f tempest-VolumeDependencyTests-724561728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (912a61f7-662d-4668-9203-3b16c96a8cf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:43 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-8e8f677b-2db3-413d-bc65-983a0009ed1f tempest-VolumeDependencyTests-724561728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (315e8a15-65be-4ec4-a4db-b2ea47415485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:43 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-8e8f677b-2db3-413d-bc65-983a0009ed1f tempest-VolumeDependencyTests-724561728 None] Volume 16a919b3-4c6f-439b-b8cd-35118a9a3a83: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-16a919b3-4c6f-439b-b8cd-35118a9a3a83', 'volume_size': 1, 'snapshot_id': '5e8d7cd2-68aa-49a7-b7a2-e726d17a7685'} Nov 02 10:23:43 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-0e8afa83-643a-42dd-9530-d582193c923d tempest-CreateVolumesFromSourceVolumeTest-466506559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-de99767b-e7e2-4c5d-999e-5f869b50dfd9 1073741824" returned: 0 in 0.686s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:43 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-8e8f677b-2db3-413d-bc65-983a0009ed1f tempest-VolumeDependencyTests-724561728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:23:43 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-0e8afa83-643a-42dd-9530-d582193c923d tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-de99767b-e7e2-4c5d-999e-5f869b50dfd9 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:43 devstack sudo[104810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-de99767b-e7e2-4c5d-999e-5f869b50dfd9 Nov 02 10:23:43 devstack sudo[104810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:43 devstack sudo[104808]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:43 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-02af45e3-1d5e-40fa-a2cd-a66f8a366784 tempest-CreateVolumesFromImageTest-1563659042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-6557c861-94c5-4e49-9b24-3e7146a5b11f" returned: 0 in 0.426s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:43 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-02af45e3-1d5e-40fa-a2cd-a66f8a366784 tempest-CreateVolumesFromImageTest-1563659042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-6557c861-94c5-4e49-9b24-3e7146a5b11f {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:43 devstack sudo[104815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-6557c861-94c5-4e49-9b24-3e7146a5b11f Nov 02 10:23:43 devstack sudo[104815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:43 devstack sudo[104810]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:43 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-0e8afa83-643a-42dd-9530-d582193c923d tempest-CreateVolumesFromSourceVolumeTest-466506559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-de99767b-e7e2-4c5d-999e-5f869b50dfd9" returned: 0 in 0.268s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:43 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-0e8afa83-643a-42dd-9530-d582193c923d tempest-CreateVolumesFromSourceVolumeTest-466506559 None] <== create_volume: return (1001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:23:43 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-0e8afa83-643a-42dd-9530-d582193c923d tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.003s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:23:43 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-7660dee6-968b-4227-adef-48fd989aef1e tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.058s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:23:43 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-7660dee6-968b-4227-adef-48fd989aef1e tempest-CreateVolumesFromSourceVolumeTest-466506559 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:23:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1200210314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2267724a-c72f-407b-8425-c07837f89882,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7039fc3033ef42f1b67b7dfce204cbc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:23:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:23:38Z,use_quota=True,user_id='f341757e3c03499ea020c56af95474e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:23:43 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-7660dee6-968b-4227-adef-48fd989aef1e tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Creating volume 2267724a-c72f-407b-8425-c07837f89882 {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:23:43 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-7660dee6-968b-4227-adef-48fd989aef1e tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:23:43 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-7660dee6-968b-4227-adef-48fd989aef1e tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:23:43 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-7660dee6-968b-4227-adef-48fd989aef1e tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:23:43 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-7660dee6-968b-4227-adef-48fd989aef1e tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:23:43 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-7660dee6-968b-4227-adef-48fd989aef1e tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:23:43 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-7660dee6-968b-4227-adef-48fd989aef1e tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:23:43 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-7660dee6-968b-4227-adef-48fd989aef1e tempest-CreateVolumesFromSourceVolumeTest-466506559 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:23:43 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-7660dee6-968b-4227-adef-48fd989aef1e tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-2267724a-c72f-407b-8425-c07837f89882 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:43 devstack sudo[104818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-2267724a-c72f-407b-8425-c07837f89882 1073741824 Nov 02 10:23:43 devstack sudo[104818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:43 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-0e8afa83-643a-42dd-9530-d582193c923d tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cd07348-621d-416c-91c7-b87af54f3405) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de99767b-e7e2-4c5d-999e-5f869b50dfd9', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:43 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-0e8afa83-643a-42dd-9530-d582193c923d tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42805427-478d-49d7-853e-66447a5d41f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:43 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-0e8afa83-643a-42dd-9530-d582193c923d tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Volume volume-de99767b-e7e2-4c5d-999e-5f869b50dfd9 (de99767b-e7e2-4c5d-999e-5f869b50dfd9): created successfully Nov 02 10:23:43 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-0e8afa83-643a-42dd-9530-d582193c923d tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42805427-478d-49d7-853e-66447a5d41f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:43 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-0e8afa83-643a-42dd-9530-d582193c923d tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Flow 'volume_create_manager' (871d2a7b-eae6-4da3-9019-657cf2e281ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:23:43 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-0e8afa83-643a-42dd-9530-d582193c923d tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Created volume successfully. Nov 02 10:23:43 devstack sudo[104815]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:43 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-02af45e3-1d5e-40fa-a2cd-a66f8a366784 tempest-CreateVolumesFromImageTest-1563659042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-6557c861-94c5-4e49-9b24-3e7146a5b11f" returned: 0 in 0.264s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:43 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-02af45e3-1d5e-40fa-a2cd-a66f8a366784 tempest-CreateVolumesFromImageTest-1563659042 None] Lock "cinder-quobyte-6557c861-94c5-4e49-9b24-3e7146a5b11f" released by "delete_volume" :: held 0.740s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:23:43 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-02af45e3-1d5e-40fa-a2cd-a66f8a366784 tempest-CreateVolumesFromImageTest-1563659042 None] Created reservations ['a36c11de-70ec-430c-b405-2b486c7a4eb4', 'b64efe5e-03b3-45b7-9c03-ec79c8e2bcce', '02ae74e1-15cb-44b0-b029-567bf3eec0cb', '40ba1eb8-29ee-4dce-afd8-fade1df24fee'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:23:43 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-02af45e3-1d5e-40fa-a2cd-a66f8a366784 tempest-CreateVolumesFromImageTest-1563659042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:23:43 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-02af45e3-1d5e-40fa-a2cd-a66f8a366784 tempest-CreateVolumesFromImageTest-1563659042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:23:43 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-02af45e3-1d5e-40fa-a2cd-a66f8a366784 tempest-CreateVolumesFromImageTest-1563659042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:23:43 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-02af45e3-1d5e-40fa-a2cd-a66f8a366784 tempest-CreateVolumesFromImageTest-1563659042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:23:43 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-02af45e3-1d5e-40fa-a2cd-a66f8a366784 tempest-CreateVolumesFromImageTest-1563659042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:23:43 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-02af45e3-1d5e-40fa-a2cd-a66f8a366784 tempest-CreateVolumesFromImageTest-1563659042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:43 devstack sudo[104824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:23:43 devstack sudo[104824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:44 devstack sudo[104818]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:44 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-7660dee6-968b-4227-adef-48fd989aef1e tempest-CreateVolumesFromSourceVolumeTest-466506559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-2267724a-c72f-407b-8425-c07837f89882 1073741824" returned: 0 in 0.490s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:44 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-9a760cbe-ee83-441c-a429-1d6fa42b2941 tempest-CreateVolumesFromImageTest-1563659042 None] Acquiring lock "cinder-17d6781a-724b-49d1-92f6-bdd460f57393-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:23:44 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-7660dee6-968b-4227-adef-48fd989aef1e tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-2267724a-c72f-407b-8425-c07837f89882 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:44 devstack sudo[104824]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:44 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-9a760cbe-ee83-441c-a429-1d6fa42b2941 tempest-CreateVolumesFromImageTest-1563659042 None] Lock "cinder-17d6781a-724b-49d1-92f6-bdd460f57393-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:23:44 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-02af45e3-1d5e-40fa-a2cd-a66f8a366784 tempest-CreateVolumesFromImageTest-1563659042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.293s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:44 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-02af45e3-1d5e-40fa-a2cd-a66f8a366784 tempest-CreateVolumesFromImageTest-1563659042 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:23:44 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-02af45e3-1d5e-40fa-a2cd-a66f8a366784 tempest-CreateVolumesFromImageTest-1563659042 None] Deleted volume successfully. Nov 02 10:23:44 devstack sudo[104828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-2267724a-c72f-407b-8425-c07837f89882 Nov 02 10:23:44 devstack sudo[104828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:44 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-02af45e3-1d5e-40fa-a2cd-a66f8a366784 tempest-CreateVolumesFromImageTest-1563659042 None] Lock "cinder-6557c861-94c5-4e49-9b24-3e7146a5b11f-delete_volume" released by "delete_volume" :: held 1.296s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:23:44 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-9a760cbe-ee83-441c-a429-1d6fa42b2941 tempest-CreateVolumesFromImageTest-1563659042 None] Acquiring lock "cinder-quobyte-17d6781a-724b-49d1-92f6-bdd460f57393" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:23:44 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-9a760cbe-ee83-441c-a429-1d6fa42b2941 tempest-CreateVolumesFromImageTest-1563659042 None] Lock "cinder-quobyte-17d6781a-724b-49d1-92f6-bdd460f57393" acquired by "delete_volume" :: waited 0.022s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:23:44 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[41aa0396-5ea7-4feb-a9dc-00695491c0eb]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:23:44 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-9a760cbe-ee83-441c-a429-1d6fa42b2941 tempest-CreateVolumesFromImageTest-1563659042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-17d6781a-724b-49d1-92f6-bdd460f57393 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:44 devstack sudo[104830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-17d6781a-724b-49d1-92f6-bdd460f57393 Nov 02 10:23:44 devstack sudo[104830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:44 devstack sudo[104828]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:44 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-7660dee6-968b-4227-adef-48fd989aef1e tempest-CreateVolumesFromSourceVolumeTest-466506559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-2267724a-c72f-407b-8425-c07837f89882" returned: 0 in 0.346s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:44 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-7660dee6-968b-4227-adef-48fd989aef1e tempest-CreateVolumesFromSourceVolumeTest-466506559 None] <== create_volume: return (895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:23:44 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-7660dee6-968b-4227-adef-48fd989aef1e tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:23:44 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-5d27457d-c3f6-403b-8c73-dbc7a094abbd tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.646s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:23:44 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-5d27457d-c3f6-403b-8c73-dbc7a094abbd tempest-CreateVolumesFromSourceVolumeTest-466506559 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:23:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-824324108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1b712b0-1dd1-4635-875b-15370a182d9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7039fc3033ef42f1b67b7dfce204cbc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:23:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:23:39Z,use_quota=True,user_id='f341757e3c03499ea020c56af95474e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:23:44 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-5d27457d-c3f6-403b-8c73-dbc7a094abbd tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Creating volume a1b712b0-1dd1-4635-875b-15370a182d9b {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:23:44 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-5d27457d-c3f6-403b-8c73-dbc7a094abbd tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:23:44 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-5d27457d-c3f6-403b-8c73-dbc7a094abbd tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:23:44 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-5d27457d-c3f6-403b-8c73-dbc7a094abbd tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:23:44 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-5d27457d-c3f6-403b-8c73-dbc7a094abbd tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:23:44 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-5d27457d-c3f6-403b-8c73-dbc7a094abbd tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:23:44 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-5d27457d-c3f6-403b-8c73-dbc7a094abbd tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:23:44 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-5d27457d-c3f6-403b-8c73-dbc7a094abbd tempest-CreateVolumesFromSourceVolumeTest-466506559 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:23:44 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-5d27457d-c3f6-403b-8c73-dbc7a094abbd tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-a1b712b0-1dd1-4635-875b-15370a182d9b 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:44 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-7660dee6-968b-4227-adef-48fd989aef1e tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac19ce6a-b6dd-4f45-b7ba-5548bcb8e580) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2267724a-c72f-407b-8425-c07837f89882', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:44 devstack sudo[104833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-a1b712b0-1dd1-4635-875b-15370a182d9b 1073741824 Nov 02 10:23:44 devstack sudo[104833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:44 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-7660dee6-968b-4227-adef-48fd989aef1e tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (beb1dfbd-3987-44e1-8a00-9ce2f1ef5d77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:44 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-7660dee6-968b-4227-adef-48fd989aef1e tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Volume volume-2267724a-c72f-407b-8425-c07837f89882 (2267724a-c72f-407b-8425-c07837f89882): created successfully Nov 02 10:23:44 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-7660dee6-968b-4227-adef-48fd989aef1e tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (beb1dfbd-3987-44e1-8a00-9ce2f1ef5d77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:44 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-7660dee6-968b-4227-adef-48fd989aef1e tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Flow 'volume_create_manager' (9461e956-7360-45a4-abc6-13f5c2411b4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:23:44 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-7660dee6-968b-4227-adef-48fd989aef1e tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Created volume successfully. Nov 02 10:23:44 devstack sudo[104830]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:44 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-9a760cbe-ee83-441c-a429-1d6fa42b2941 tempest-CreateVolumesFromImageTest-1563659042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-17d6781a-724b-49d1-92f6-bdd460f57393" returned: 0 in 0.427s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:44 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-9a760cbe-ee83-441c-a429-1d6fa42b2941 tempest-CreateVolumesFromImageTest-1563659042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-17d6781a-724b-49d1-92f6-bdd460f57393 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:44 devstack sudo[104838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-17d6781a-724b-49d1-92f6-bdd460f57393 Nov 02 10:23:44 devstack sudo[104838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:44 devstack sudo[104833]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:44 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-5d27457d-c3f6-403b-8c73-dbc7a094abbd tempest-CreateVolumesFromSourceVolumeTest-466506559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-a1b712b0-1dd1-4635-875b-15370a182d9b 1073741824" returned: 0 in 0.436s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:45 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-5d27457d-c3f6-403b-8c73-dbc7a094abbd tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-a1b712b0-1dd1-4635-875b-15370a182d9b {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:45 devstack sudo[104838]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:45 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-9a760cbe-ee83-441c-a429-1d6fa42b2941 tempest-CreateVolumesFromImageTest-1563659042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-17d6781a-724b-49d1-92f6-bdd460f57393" returned: 0 in 0.272s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:45 devstack sudo[104844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-a1b712b0-1dd1-4635-875b-15370a182d9b Nov 02 10:23:45 devstack sudo[104844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:45 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-9a760cbe-ee83-441c-a429-1d6fa42b2941 tempest-CreateVolumesFromImageTest-1563659042 None] Lock "cinder-quobyte-17d6781a-724b-49d1-92f6-bdd460f57393" released by "delete_volume" :: held 0.760s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:23:45 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-9a760cbe-ee83-441c-a429-1d6fa42b2941 tempest-CreateVolumesFromImageTest-1563659042 None] Created reservations ['1b331570-c70c-4df8-80e8-f1da2a58d619', 'b054c2fb-c11f-453d-8428-977faa051c10', '2f8cf65a-6e70-4e2c-b5b2-bd68081b8eb8', '10c2671a-27bf-47aa-9b50-079313aae4c6'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:23:45 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-9a760cbe-ee83-441c-a429-1d6fa42b2941 tempest-CreateVolumesFromImageTest-1563659042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:23:45 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-9a760cbe-ee83-441c-a429-1d6fa42b2941 tempest-CreateVolumesFromImageTest-1563659042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:23:45 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-9a760cbe-ee83-441c-a429-1d6fa42b2941 tempest-CreateVolumesFromImageTest-1563659042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:23:45 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-9a760cbe-ee83-441c-a429-1d6fa42b2941 tempest-CreateVolumesFromImageTest-1563659042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:23:45 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-9a760cbe-ee83-441c-a429-1d6fa42b2941 tempest-CreateVolumesFromImageTest-1563659042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:23:45 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-9a760cbe-ee83-441c-a429-1d6fa42b2941 tempest-CreateVolumesFromImageTest-1563659042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:45 devstack sudo[104846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:23:45 devstack sudo[104846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:45 devstack sudo[104844]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:45 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-5d27457d-c3f6-403b-8c73-dbc7a094abbd tempest-CreateVolumesFromSourceVolumeTest-466506559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-a1b712b0-1dd1-4635-875b-15370a182d9b" returned: 0 in 0.285s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:45 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-5d27457d-c3f6-403b-8c73-dbc7a094abbd tempest-CreateVolumesFromSourceVolumeTest-466506559 None] <== create_volume: return (773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:23:45 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-5d27457d-c3f6-403b-8c73-dbc7a094abbd tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.777s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:23:45 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-0527483a-1145-4c59-b7eb-6c4353374c35 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.895s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:23:45 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-0527483a-1145-4c59-b7eb-6c4353374c35 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:23:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-234548741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=787ec981-b796-49a2-82ac-517772791929,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7039fc3033ef42f1b67b7dfce204cbc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:23:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:23:39Z,use_quota=True,user_id='f341757e3c03499ea020c56af95474e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:23:45 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-0527483a-1145-4c59-b7eb-6c4353374c35 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Creating volume 787ec981-b796-49a2-82ac-517772791929 {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:23:45 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-0527483a-1145-4c59-b7eb-6c4353374c35 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:23:45 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-0527483a-1145-4c59-b7eb-6c4353374c35 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:23:45 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-0527483a-1145-4c59-b7eb-6c4353374c35 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:23:45 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-0527483a-1145-4c59-b7eb-6c4353374c35 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:23:45 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-0527483a-1145-4c59-b7eb-6c4353374c35 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:23:45 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-0527483a-1145-4c59-b7eb-6c4353374c35 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:23:45 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-0527483a-1145-4c59-b7eb-6c4353374c35 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:23:45 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-0527483a-1145-4c59-b7eb-6c4353374c35 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-787ec981-b796-49a2-82ac-517772791929 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:45 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-5d27457d-c3f6-403b-8c73-dbc7a094abbd tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50fed9bc-c9eb-4354-93ff-52e828701bd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1b712b0-1dd1-4635-875b-15370a182d9b', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:45 devstack sudo[104849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-787ec981-b796-49a2-82ac-517772791929 1073741824 Nov 02 10:23:45 devstack sudo[104849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:45 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-5d27457d-c3f6-403b-8c73-dbc7a094abbd tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccdd90dd-acc0-4d53-a3b0-dc168a943545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:45 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-219fc7b0-6e69-4d98-9d8c-8765a0b44477 tempest-CreateVolumesFromImageTest-1563659042 None] Acquiring lock "cinder-5121a00f-2f51-425f-9cc0-fbf2e15ea14f-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:23:45 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-5d27457d-c3f6-403b-8c73-dbc7a094abbd tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Volume volume-a1b712b0-1dd1-4635-875b-15370a182d9b (a1b712b0-1dd1-4635-875b-15370a182d9b): created successfully Nov 02 10:23:45 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-5d27457d-c3f6-403b-8c73-dbc7a094abbd tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccdd90dd-acc0-4d53-a3b0-dc168a943545) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:45 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-5d27457d-c3f6-403b-8c73-dbc7a094abbd tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Flow 'volume_create_manager' (7c9adcf3-c18c-492d-aa7c-bd95bce52a6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:23:45 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-219fc7b0-6e69-4d98-9d8c-8765a0b44477 tempest-CreateVolumesFromImageTest-1563659042 None] Lock "cinder-5121a00f-2f51-425f-9cc0-fbf2e15ea14f-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:23:45 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-5d27457d-c3f6-403b-8c73-dbc7a094abbd tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Created volume successfully. Nov 02 10:23:45 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-219fc7b0-6e69-4d98-9d8c-8765a0b44477 tempest-CreateVolumesFromImageTest-1563659042 None] Acquiring lock "cinder-quobyte-5121a00f-2f51-425f-9cc0-fbf2e15ea14f" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:23:45 devstack sudo[104846]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:45 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-219fc7b0-6e69-4d98-9d8c-8765a0b44477 tempest-CreateVolumesFromImageTest-1563659042 None] Lock "cinder-quobyte-5121a00f-2f51-425f-9cc0-fbf2e15ea14f" acquired by "delete_volume" :: waited 0.021s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:23:45 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-9a760cbe-ee83-441c-a429-1d6fa42b2941 tempest-CreateVolumesFromImageTest-1563659042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.324s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:45 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-9a760cbe-ee83-441c-a429-1d6fa42b2941 tempest-CreateVolumesFromImageTest-1563659042 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:23:45 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-9a760cbe-ee83-441c-a429-1d6fa42b2941 tempest-CreateVolumesFromImageTest-1563659042 None] Deleted volume successfully. Nov 02 10:23:45 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d696d9a-d617-4a56-98d3-79b34de6661b]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:23:45 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-219fc7b0-6e69-4d98-9d8c-8765a0b44477 tempest-CreateVolumesFromImageTest-1563659042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-5121a00f-2f51-425f-9cc0-fbf2e15ea14f {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:45 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-9a760cbe-ee83-441c-a429-1d6fa42b2941 tempest-CreateVolumesFromImageTest-1563659042 None] Lock "cinder-17d6781a-724b-49d1-92f6-bdd460f57393-delete_volume" released by "delete_volume" :: held 1.353s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:23:45 devstack sudo[104852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-5121a00f-2f51-425f-9cc0-fbf2e15ea14f Nov 02 10:23:45 devstack sudo[104852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:45 devstack sudo[104849]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:45 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-0527483a-1145-4c59-b7eb-6c4353374c35 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-787ec981-b796-49a2-82ac-517772791929 1073741824" returned: 0 in 0.573s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:45 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-0527483a-1145-4c59-b7eb-6c4353374c35 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-787ec981-b796-49a2-82ac-517772791929 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:45 devstack sudo[104861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-787ec981-b796-49a2-82ac-517772791929 Nov 02 10:23:45 devstack sudo[104852]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:45 devstack sudo[104861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:45 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-219fc7b0-6e69-4d98-9d8c-8765a0b44477 tempest-CreateVolumesFromImageTest-1563659042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-5121a00f-2f51-425f-9cc0-fbf2e15ea14f" returned: 0 in 0.431s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:45 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-219fc7b0-6e69-4d98-9d8c-8765a0b44477 tempest-CreateVolumesFromImageTest-1563659042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-5121a00f-2f51-425f-9cc0-fbf2e15ea14f {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:46 devstack sudo[104863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-5121a00f-2f51-425f-9cc0-fbf2e15ea14f Nov 02 10:23:46 devstack sudo[104863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:46 devstack sudo[104861]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:46 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-0527483a-1145-4c59-b7eb-6c4353374c35 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-787ec981-b796-49a2-82ac-517772791929" returned: 0 in 0.272s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:46 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-0527483a-1145-4c59-b7eb-6c4353374c35 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] <== create_volume: return (893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:23:46 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-0527483a-1145-4c59-b7eb-6c4353374c35 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.897s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:23:46 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-6a69c670-96e0-47c7-90be-5f797d14f5fd tempest-VolumeAndVolumeTypeFromImageTest-1575186715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.573s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:23:46 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-6a69c670-96e0-47c7-90be-5f797d14f5fd tempest-VolumeAndVolumeTypeFromImageTest-1575186715 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:23:37Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44192c97-85d9-4333-bde5-2f6576e46327,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2e18f5b1bd7456a9a089c57017f3aeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:23:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:23:37Z,use_quota=True,user_id='ae98a73a3e33470dab4e5100e464f2ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2eb6ad5a-7b5f-4139-86f5-673e061e2f93),volume_type_id=2eb6ad5a-7b5f-4139-86f5-673e061e2f93)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:23:46 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-6a69c670-96e0-47c7-90be-5f797d14f5fd tempest-VolumeAndVolumeTypeFromImageTest-1575186715 None] Creating volume 44192c97-85d9-4333-bde5-2f6576e46327 {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:23:46 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-6a69c670-96e0-47c7-90be-5f797d14f5fd tempest-VolumeAndVolumeTypeFromImageTest-1575186715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:23:46 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-6a69c670-96e0-47c7-90be-5f797d14f5fd tempest-VolumeAndVolumeTypeFromImageTest-1575186715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:23:46 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-6a69c670-96e0-47c7-90be-5f797d14f5fd tempest-VolumeAndVolumeTypeFromImageTest-1575186715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:23:46 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-6a69c670-96e0-47c7-90be-5f797d14f5fd tempest-VolumeAndVolumeTypeFromImageTest-1575186715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:23:46 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-6a69c670-96e0-47c7-90be-5f797d14f5fd tempest-VolumeAndVolumeTypeFromImageTest-1575186715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:23:46 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-6a69c670-96e0-47c7-90be-5f797d14f5fd tempest-VolumeAndVolumeTypeFromImageTest-1575186715 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:23:46 devstack sudo[104863]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:46 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-6a69c670-96e0-47c7-90be-5f797d14f5fd tempest-VolumeAndVolumeTypeFromImageTest-1575186715 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:23:46 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6a69c670-96e0-47c7-90be-5f797d14f5fd tempest-VolumeAndVolumeTypeFromImageTest-1575186715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-44192c97-85d9-4333-bde5-2f6576e46327 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:46 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-219fc7b0-6e69-4d98-9d8c-8765a0b44477 tempest-CreateVolumesFromImageTest-1563659042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-5121a00f-2f51-425f-9cc0-fbf2e15ea14f" returned: 0 in 0.298s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:46 devstack sudo[104867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-44192c97-85d9-4333-bde5-2f6576e46327 1073741824 Nov 02 10:23:46 devstack sudo[104867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:46 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-0527483a-1145-4c59-b7eb-6c4353374c35 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23aa8c72-98ff-4ee5-9e4d-d107ae418bef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-787ec981-b796-49a2-82ac-517772791929', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:46 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-0527483a-1145-4c59-b7eb-6c4353374c35 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bb8daa5-62a1-4f47-a572-7191449a30db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:46 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-219fc7b0-6e69-4d98-9d8c-8765a0b44477 tempest-CreateVolumesFromImageTest-1563659042 None] Lock "cinder-quobyte-5121a00f-2f51-425f-9cc0-fbf2e15ea14f" released by "delete_volume" :: held 0.801s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:23:46 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-0527483a-1145-4c59-b7eb-6c4353374c35 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Volume volume-787ec981-b796-49a2-82ac-517772791929 (787ec981-b796-49a2-82ac-517772791929): created successfully Nov 02 10:23:46 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-0527483a-1145-4c59-b7eb-6c4353374c35 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bb8daa5-62a1-4f47-a572-7191449a30db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:46 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-0527483a-1145-4c59-b7eb-6c4353374c35 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Flow 'volume_create_manager' (bf81153d-06fe-4b6c-9652-1b8cb9999b69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:23:46 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-0527483a-1145-4c59-b7eb-6c4353374c35 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Created volume successfully. Nov 02 10:23:46 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-219fc7b0-6e69-4d98-9d8c-8765a0b44477 tempest-CreateVolumesFromImageTest-1563659042 None] Created reservations ['936d7842-b194-475f-aa9b-157fef6608c1', '6a9447ed-c482-48c1-9616-77f7217aa71e', '3755bd92-d22f-4938-b785-65d14bf1fcf7', 'e7a6125b-2ee2-47ed-89e3-7b82a6004ec2'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:23:46 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-219fc7b0-6e69-4d98-9d8c-8765a0b44477 tempest-CreateVolumesFromImageTest-1563659042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:23:46 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-219fc7b0-6e69-4d98-9d8c-8765a0b44477 tempest-CreateVolumesFromImageTest-1563659042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:23:46 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-219fc7b0-6e69-4d98-9d8c-8765a0b44477 tempest-CreateVolumesFromImageTest-1563659042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:23:46 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-219fc7b0-6e69-4d98-9d8c-8765a0b44477 tempest-CreateVolumesFromImageTest-1563659042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:23:46 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-219fc7b0-6e69-4d98-9d8c-8765a0b44477 tempest-CreateVolumesFromImageTest-1563659042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:23:46 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-219fc7b0-6e69-4d98-9d8c-8765a0b44477 tempest-CreateVolumesFromImageTest-1563659042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:46 devstack sudo[104869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:23:46 devstack sudo[104869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:46 devstack sudo[104869]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:46 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-219fc7b0-6e69-4d98-9d8c-8765a0b44477 tempest-CreateVolumesFromImageTest-1563659042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.308s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:46 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-219fc7b0-6e69-4d98-9d8c-8765a0b44477 tempest-CreateVolumesFromImageTest-1563659042 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:23:46 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-219fc7b0-6e69-4d98-9d8c-8765a0b44477 tempest-CreateVolumesFromImageTest-1563659042 None] Deleted volume successfully. Nov 02 10:23:46 devstack sudo[104867]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:46 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6a69c670-96e0-47c7-90be-5f797d14f5fd tempest-VolumeAndVolumeTypeFromImageTest-1575186715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-44192c97-85d9-4333-bde5-2f6576e46327 1073741824" returned: 0 in 0.561s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:46 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-219fc7b0-6e69-4d98-9d8c-8765a0b44477 tempest-CreateVolumesFromImageTest-1563659042 None] Lock "cinder-5121a00f-2f51-425f-9cc0-fbf2e15ea14f-delete_volume" released by "delete_volume" :: held 1.388s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:23:46 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6a69c670-96e0-47c7-90be-5f797d14f5fd tempest-VolumeAndVolumeTypeFromImageTest-1575186715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-44192c97-85d9-4333-bde5-2f6576e46327 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:46 devstack sudo[104875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-44192c97-85d9-4333-bde5-2f6576e46327 Nov 02 10:23:46 devstack sudo[104875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:46 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-66aeaf6f-d2e6-4ae5-8afd-3dfeaa1f89bd tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Acquiring lock "cinder-787ec981-b796-49a2-82ac-517772791929-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:23:46 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-66aeaf6f-d2e6-4ae5-8afd-3dfeaa1f89bd tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Lock "cinder-787ec981-b796-49a2-82ac-517772791929-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:23:47 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-66aeaf6f-d2e6-4ae5-8afd-3dfeaa1f89bd tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Acquiring lock "cinder-quobyte-787ec981-b796-49a2-82ac-517772791929" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:23:47 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-66aeaf6f-d2e6-4ae5-8afd-3dfeaa1f89bd tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Lock "cinder-quobyte-787ec981-b796-49a2-82ac-517772791929" acquired by "delete_volume" :: waited 0.017s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:23:47 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae819752-5369-4d4f-8eef-93566ff9335e]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:23:47 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-66aeaf6f-d2e6-4ae5-8afd-3dfeaa1f89bd tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-787ec981-b796-49a2-82ac-517772791929 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:47 devstack sudo[104877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-787ec981-b796-49a2-82ac-517772791929 Nov 02 10:23:47 devstack sudo[104877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:47 devstack sudo[104875]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:47 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6a69c670-96e0-47c7-90be-5f797d14f5fd tempest-VolumeAndVolumeTypeFromImageTest-1575186715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-44192c97-85d9-4333-bde5-2f6576e46327" returned: 0 in 0.353s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:47 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-6a69c670-96e0-47c7-90be-5f797d14f5fd tempest-VolumeAndVolumeTypeFromImageTest-1575186715 None] <== create_volume: return (981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:23:47 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-6a69c670-96e0-47c7-90be-5f797d14f5fd tempest-VolumeAndVolumeTypeFromImageTest-1575186715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.987s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:23:47 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-8e8f677b-2db3-413d-bc65-983a0009ed1f tempest-VolumeDependencyTests-724561728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.875s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:23:47 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-8e8f677b-2db3-413d-bc65-983a0009ed1f tempest-VolumeDependencyTests-724561728 None] Acquiring lock "cinder-quobyte-5e8d7cd2-68aa-49a7-b7a2-e726d17a7685-16a919b3-4c6f-439b-b8cd-35118a9a3a83" by "_create_volume_from_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:23:47 devstack cinder-volume[86890]: DEBUG cinder.volume.volume_utils [None req-6a69c670-96e0-47c7-90be-5f797d14f5fd tempest-VolumeAndVolumeTypeFromImageTest-1575186715 None] Attempting download of 20765abf-73db-4d53-b9b7-d82f038eceea ((None, [{'url': 'file:///opt/stack/data/glance/images/20765abf-73db-4d53-b9b7-d82f038eceea', 'metadata': {}}])) to volume 44192c97-85d9-4333-bde5-2f6576e46327. {{(pid=86890) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 02 10:23:47 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-8e8f677b-2db3-413d-bc65-983a0009ed1f tempest-VolumeDependencyTests-724561728 None] Lock "cinder-quobyte-5e8d7cd2-68aa-49a7-b7a2-e726d17a7685-16a919b3-4c6f-439b-b8cd-35118a9a3a83" acquired by "_create_volume_from_snapshot" :: waited 0.036s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:23:47 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-8e8f677b-2db3-413d-bc65-983a0009ed1f tempest-VolumeDependencyTests-724561728 None] Creating volume 16a919b3-4c6f-439b-b8cd-35118a9a3a83 from snapshot 5e8d7cd2-68aa-49a7-b7a2-e726d17a7685 {{(pid=86890) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 02 10:23:47 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-8e8f677b-2db3-413d-bc65-983a0009ed1f tempest-VolumeDependencyTests-724561728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:23:47 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-8e8f677b-2db3-413d-bc65-983a0009ed1f tempest-VolumeDependencyTests-724561728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:23:47 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-8e8f677b-2db3-413d-bc65-983a0009ed1f tempest-VolumeDependencyTests-724561728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:23:47 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-8e8f677b-2db3-413d-bc65-983a0009ed1f tempest-VolumeDependencyTests-724561728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:23:47 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-8e8f677b-2db3-413d-bc65-983a0009ed1f tempest-VolumeDependencyTests-724561728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:23:47 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-8e8f677b-2db3-413d-bc65-983a0009ed1f tempest-VolumeDependencyTests-724561728 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:23:47 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-8e8f677b-2db3-413d-bc65-983a0009ed1f tempest-VolumeDependencyTests-724561728 None] Acquiring lock "cinder-quobyte-16a919b3-4c6f-439b-b8cd-35118a9a3a83" by "_copy_volume_from_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:23:47 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-8e8f677b-2db3-413d-bc65-983a0009ed1f tempest-VolumeDependencyTests-724561728 None] Lock "cinder-quobyte-16a919b3-4c6f-439b-b8cd-35118a9a3a83" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:23:47 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-8e8f677b-2db3-413d-bc65-983a0009ed1f tempest-VolumeDependencyTests-724561728 None] snapshot: 5e8d7cd2-68aa-49a7-b7a2-e726d17a7685, volume: 16a919b3-4c6f-439b-b8cd-35118a9a3a83, {{(pid=86890) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 10:23:47 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-8e8f677b-2db3-413d-bc65-983a0009ed1f tempest-VolumeDependencyTests-724561728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:23:47 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-8e8f677b-2db3-413d-bc65-983a0009ed1f tempest-VolumeDependencyTests-724561728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:23:47 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-8e8f677b-2db3-413d-bc65-983a0009ed1f tempest-VolumeDependencyTests-724561728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:23:47 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-8e8f677b-2db3-413d-bc65-983a0009ed1f tempest-VolumeDependencyTests-724561728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:23:47 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-8e8f677b-2db3-413d-bc65-983a0009ed1f tempest-VolumeDependencyTests-724561728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:23:47 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dcd480b-04ce-420c-964d-2e71581c5aec]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:23:47 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8e8f677b-2db3-413d-bc65-983a0009ed1f tempest-VolumeDependencyTests-724561728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b65175c9-bbdc-4eb8-b06d-15953654223e.5e8d7cd2-68aa-49a7-b7a2-e726d17a7685 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:47 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[01b0e3b5-bc78-44a9-b371-b4adc4be6b1e]: (4, 'raw') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:23:47 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6a69c670-96e0-47c7-90be-5f797d14f5fd tempest-VolumeAndVolumeTypeFromImageTest-1575186715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_20765abf-73db-4d53-b9b7-d82f038eceea_1l183crq {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:47 devstack sudo[104880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b65175c9-bbdc-4eb8-b06d-15953654223e.5e8d7cd2-68aa-49a7-b7a2-e726d17a7685 Nov 02 10:23:47 devstack sudo[104880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:47 devstack sudo[104877]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:47 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-66aeaf6f-d2e6-4ae5-8afd-3dfeaa1f89bd tempest-CreateVolumesFromSourceVolumeTest-466506559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-787ec981-b796-49a2-82ac-517772791929" returned: 0 in 0.483s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:47 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-66aeaf6f-d2e6-4ae5-8afd-3dfeaa1f89bd tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-787ec981-b796-49a2-82ac-517772791929 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:47 devstack sudo[104881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_20765abf-73db-4d53-b9b7-d82f038eceea_1l183crq Nov 02 10:23:47 devstack sudo[104881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:47 devstack sudo[104886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-787ec981-b796-49a2-82ac-517772791929 Nov 02 10:23:47 devstack sudo[104886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:47 devstack sudo[104881]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:47 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6a69c670-96e0-47c7-90be-5f797d14f5fd tempest-VolumeAndVolumeTypeFromImageTest-1575186715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_20765abf-73db-4d53-b9b7-d82f038eceea_1l183crq" returned: 0 in 0.475s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:47 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6a69c670-96e0-47c7-90be-5f797d14f5fd tempest-VolumeAndVolumeTypeFromImageTest-1575186715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_20765abf-73db-4d53-b9b7-d82f038eceea_1l183crq {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:47 devstack sudo[104886]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:47 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-66aeaf6f-d2e6-4ae5-8afd-3dfeaa1f89bd tempest-CreateVolumesFromSourceVolumeTest-466506559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-787ec981-b796-49a2-82ac-517772791929" returned: 0 in 0.332s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:47 devstack sudo[104880]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:47 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8e8f677b-2db3-413d-bc65-983a0009ed1f tempest-VolumeDependencyTests-724561728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b65175c9-bbdc-4eb8-b06d-15953654223e.5e8d7cd2-68aa-49a7-b7a2-e726d17a7685" returned: 0 in 0.528s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:47 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-8e8f677b-2db3-413d-bc65-983a0009ed1f tempest-VolumeDependencyTests-724561728 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b65175c9-bbdc-4eb8-b06d-15953654223e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86890) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:23:47 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-66aeaf6f-d2e6-4ae5-8afd-3dfeaa1f89bd tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Lock "cinder-quobyte-787ec981-b796-49a2-82ac-517772791929" released by "delete_volume" :: held 0.870s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:23:47 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c8a3b75-f520-405f-90b3-aaf1867ffd6e]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:23:47 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8e8f677b-2db3-413d-bc65-983a0009ed1f tempest-VolumeDependencyTests-724561728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b65175c9-bbdc-4eb8-b06d-15953654223e {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:47 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-66aeaf6f-d2e6-4ae5-8afd-3dfeaa1f89bd tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Created reservations ['28a9863a-3f34-4bf3-9e13-2899dfbc61bb', '45a5be62-4448-47db-8dc3-719745ff9bba', 'd4eedc89-c92e-466b-a3a6-c5451385da54', '4ef32b03-63af-4a0d-b260-0699e8305937'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:23:48 devstack sudo[104895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_20765abf-73db-4d53-b9b7-d82f038eceea_1l183crq Nov 02 10:23:48 devstack sudo[104895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:48 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-66aeaf6f-d2e6-4ae5-8afd-3dfeaa1f89bd tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:23:48 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-66aeaf6f-d2e6-4ae5-8afd-3dfeaa1f89bd tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:23:48 devstack sudo[104896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b65175c9-bbdc-4eb8-b06d-15953654223e Nov 02 10:23:48 devstack sudo[104896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:48 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-66aeaf6f-d2e6-4ae5-8afd-3dfeaa1f89bd tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:23:48 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-66aeaf6f-d2e6-4ae5-8afd-3dfeaa1f89bd tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:23:48 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-66aeaf6f-d2e6-4ae5-8afd-3dfeaa1f89bd tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:23:48 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-66aeaf6f-d2e6-4ae5-8afd-3dfeaa1f89bd tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:48 devstack sudo[104899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:23:48 devstack sudo[104899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:48 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-ca3e5aba-091c-4ea5-b255-e3def0845592 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Acquiring lock "cinder-a1b712b0-1dd1-4635-875b-15370a182d9b-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:23:48 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-ca3e5aba-091c-4ea5-b255-e3def0845592 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Lock "cinder-a1b712b0-1dd1-4635-875b-15370a182d9b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:23:48 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-ca3e5aba-091c-4ea5-b255-e3def0845592 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Acquiring lock "cinder-quobyte-a1b712b0-1dd1-4635-875b-15370a182d9b" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:23:48 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-ca3e5aba-091c-4ea5-b255-e3def0845592 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Lock "cinder-quobyte-a1b712b0-1dd1-4635-875b-15370a182d9b" acquired by "delete_volume" :: waited 0.026s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:23:48 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[08e55183-b921-4101-891f-971b7d70bab8]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:23:48 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ca3e5aba-091c-4ea5-b255-e3def0845592 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-a1b712b0-1dd1-4635-875b-15370a182d9b {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:48 devstack sudo[104895]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:48 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6a69c670-96e0-47c7-90be-5f797d14f5fd tempest-VolumeAndVolumeTypeFromImageTest-1575186715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_20765abf-73db-4d53-b9b7-d82f038eceea_1l183crq" returned: 1 in 0.555s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:48 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6a69c670-96e0-47c7-90be-5f797d14f5fd tempest-VolumeAndVolumeTypeFromImageTest-1575186715 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_20765abf-73db-4d53-b9b7-d82f038eceea_1l183crq' failed. Not Retrying. {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 10:23:48 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[854e0bb5-bce2-4f61-8c63-788e58ba1d3d]: (4, 'raw') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:23:48 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6a69c670-96e0-47c7-90be-5f797d14f5fd tempest-VolumeAndVolumeTypeFromImageTest-1575186715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_20765abf-73db-4d53-b9b7-d82f038eceea_gyvwnqakdevstack@QuobyteHD {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:48 devstack sudo[104899]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:48 devstack sudo[104904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_20765abf-73db-4d53-b9b7-d82f038eceea_gyvwnqakdevstack@QuobyteHD Nov 02 10:23:48 devstack sudo[104904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:48 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-66aeaf6f-d2e6-4ae5-8afd-3dfeaa1f89bd tempest-CreateVolumesFromSourceVolumeTest-466506559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.516s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:48 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-66aeaf6f-d2e6-4ae5-8afd-3dfeaa1f89bd tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:23:48 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-66aeaf6f-d2e6-4ae5-8afd-3dfeaa1f89bd tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Deleted volume successfully. Nov 02 10:23:48 devstack sudo[104903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-a1b712b0-1dd1-4635-875b-15370a182d9b Nov 02 10:23:48 devstack sudo[104903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:48 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-66aeaf6f-d2e6-4ae5-8afd-3dfeaa1f89bd tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Lock "cinder-787ec981-b796-49a2-82ac-517772791929-delete_volume" released by "delete_volume" :: held 1.675s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:23:48 devstack sudo[104896]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:48 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8e8f677b-2db3-413d-bc65-983a0009ed1f tempest-VolumeDependencyTests-724561728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b65175c9-bbdc-4eb8-b06d-15953654223e" returned: 0 in 0.754s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:48 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-8e8f677b-2db3-413d-bc65-983a0009ed1f tempest-VolumeDependencyTests-724561728 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b65175c9-bbdc-4eb8-b06d-15953654223e {{(pid=86890) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 10:23:48 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-8e8f677b-2db3-413d-bc65-983a0009ed1f tempest-VolumeDependencyTests-724561728 None] Creating direct copy from snapshot {{(pid=86890) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 10:23:48 devstack cinder-volume[86890]: DEBUG cinder.utils [None req-8e8f677b-2db3-413d-bc65-983a0009ed1f tempest-VolumeDependencyTests-724561728 None] Path /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-16a919b3-4c6f-439b-b8cd-35118a9a3a83 not found in is_blk_device check {{(pid=86890) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 10:23:48 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8e8f677b-2db3-413d-bc65-983a0009ed1f tempest-VolumeDependencyTests-724561728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b65175c9-bbdc-4eb8-b06d-15953654223e /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-16a919b3-4c6f-439b-b8cd-35118a9a3a83 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:48 devstack sudo[104911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b65175c9-bbdc-4eb8-b06d-15953654223e /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-16a919b3-4c6f-439b-b8cd-35118a9a3a83 Nov 02 10:23:48 devstack sudo[104911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:48 devstack sudo[104904]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:48 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6a69c670-96e0-47c7-90be-5f797d14f5fd tempest-VolumeAndVolumeTypeFromImageTest-1575186715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_20765abf-73db-4d53-b9b7-d82f038eceea_gyvwnqakdevstack@QuobyteHD" returned: 0 in 0.420s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:48 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6a69c670-96e0-47c7-90be-5f797d14f5fd tempest-VolumeAndVolumeTypeFromImageTest-1575186715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_20765abf-73db-4d53-b9b7-d82f038eceea_gyvwnqakdevstack@QuobyteHD {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:49 devstack sudo[104903]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:49 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ca3e5aba-091c-4ea5-b255-e3def0845592 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-a1b712b0-1dd1-4635-875b-15370a182d9b" returned: 0 in 0.608s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:49 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ca3e5aba-091c-4ea5-b255-e3def0845592 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-a1b712b0-1dd1-4635-875b-15370a182d9b {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:49 devstack sudo[104915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_20765abf-73db-4d53-b9b7-d82f038eceea_gyvwnqakdevstack@QuobyteHD Nov 02 10:23:49 devstack sudo[104915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:49 devstack sudo[104923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-a1b712b0-1dd1-4635-875b-15370a182d9b Nov 02 10:23:49 devstack sudo[104923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:49 devstack sudo[104915]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:49 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6a69c670-96e0-47c7-90be-5f797d14f5fd tempest-VolumeAndVolumeTypeFromImageTest-1575186715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_20765abf-73db-4d53-b9b7-d82f038eceea_gyvwnqakdevstack@QuobyteHD" returned: 1 in 0.455s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:49 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6a69c670-96e0-47c7-90be-5f797d14f5fd tempest-VolumeAndVolumeTypeFromImageTest-1575186715 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_20765abf-73db-4d53-b9b7-d82f038eceea_gyvwnqakdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 10:23:49 devstack cinder-volume[86890]: DEBUG cinder.image.image_utils [None req-6a69c670-96e0-47c7-90be-5f797d14f5fd tempest-VolumeAndVolumeTypeFromImageTest-1575186715 None] 20765abf-73db-4d53-b9b7-d82f038eceea was raw, converting to qcow2 {{(pid=86890) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 02 10:23:49 devstack sudo[104923]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:49 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6a69c670-96e0-47c7-90be-5f797d14f5fd tempest-VolumeAndVolumeTypeFromImageTest-1575186715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_20765abf-73db-4d53-b9b7-d82f038eceea_gyvwnqakdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-44192c97-85d9-4333-bde5-2f6576e46327 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:49 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ca3e5aba-091c-4ea5-b255-e3def0845592 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-a1b712b0-1dd1-4635-875b-15370a182d9b" returned: 0 in 0.346s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:49 devstack sudo[104933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_20765abf-73db-4d53-b9b7-d82f038eceea_gyvwnqakdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-44192c97-85d9-4333-bde5-2f6576e46327 Nov 02 10:23:49 devstack sudo[104933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:49 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-ca3e5aba-091c-4ea5-b255-e3def0845592 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Lock "cinder-quobyte-a1b712b0-1dd1-4635-875b-15370a182d9b" released by "delete_volume" :: held 1.063s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:23:49 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-ca3e5aba-091c-4ea5-b255-e3def0845592 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Created reservations ['ebea3be9-b9ce-404e-b8a4-0bcc59cb9bb5', '004dce6d-c107-4586-9491-8c1f045b4c7f', '5552a225-1385-484e-884e-1a046c6d1dde', 'fb328607-4943-4dcf-a3ec-a19c81c192f6'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:23:49 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-ca3e5aba-091c-4ea5-b255-e3def0845592 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:23:49 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-ca3e5aba-091c-4ea5-b255-e3def0845592 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:23:49 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-ca3e5aba-091c-4ea5-b255-e3def0845592 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:23:49 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-ca3e5aba-091c-4ea5-b255-e3def0845592 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:23:49 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-ca3e5aba-091c-4ea5-b255-e3def0845592 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:23:49 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ca3e5aba-091c-4ea5-b255-e3def0845592 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:49 devstack sudo[104939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:23:49 devstack sudo[104939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:50 devstack sudo[104939]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:50 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ca3e5aba-091c-4ea5-b255-e3def0845592 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.352s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:50 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-ca3e5aba-091c-4ea5-b255-e3def0845592 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:23:50 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-ca3e5aba-091c-4ea5-b255-e3def0845592 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Deleted volume successfully. Nov 02 10:23:50 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-ca3e5aba-091c-4ea5-b255-e3def0845592 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Lock "cinder-a1b712b0-1dd1-4635-875b-15370a182d9b-delete_volume" released by "delete_volume" :: held 1.968s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:23:50 devstack sudo[104933]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:50 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6a69c670-96e0-47c7-90be-5f797d14f5fd tempest-VolumeAndVolumeTypeFromImageTest-1575186715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_20765abf-73db-4d53-b9b7-d82f038eceea_gyvwnqakdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-44192c97-85d9-4333-bde5-2f6576e46327" returned: 0 in 1.251s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:50 devstack cinder-volume[86890]: DEBUG cinder.image.image_utils [None req-6a69c670-96e0-47c7-90be-5f797d14f5fd tempest-VolumeAndVolumeTypeFromImageTest-1575186715 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_20765abf-73db-4d53-b9b7-d82f038eceea_gyvwnqakdevstack@QuobyteHD, size 0.00 MB, duration 1.25 sec, destination /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-44192c97-85d9-4333-bde5-2f6576e46327 {{(pid=86890) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 10:23:50 devstack cinder-volume[86890]: INFO cinder.image.image_utils [None req-6a69c670-96e0-47c7-90be-5f797d14f5fd tempest-VolumeAndVolumeTypeFromImageTest-1575186715 None] Converted 0.00 MB image at 0.00 MB/s Nov 02 10:23:50 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6a69c670-96e0-47c7-90be-5f797d14f5fd tempest-VolumeAndVolumeTypeFromImageTest-1575186715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-44192c97-85d9-4333-bde5-2f6576e46327 1G {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:50 devstack sudo[104945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-44192c97-85d9-4333-bde5-2f6576e46327 1G Nov 02 10:23:50 devstack sudo[104945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:50 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-f7b490f7-bcfd-40a5-9dfb-14c0ae0beff6 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Acquiring lock "cinder-2267724a-c72f-407b-8425-c07837f89882-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:23:50 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-f7b490f7-bcfd-40a5-9dfb-14c0ae0beff6 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Lock "cinder-2267724a-c72f-407b-8425-c07837f89882-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:23:50 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-f7b490f7-bcfd-40a5-9dfb-14c0ae0beff6 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Acquiring lock "cinder-quobyte-2267724a-c72f-407b-8425-c07837f89882" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:23:50 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-f7b490f7-bcfd-40a5-9dfb-14c0ae0beff6 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Lock "cinder-quobyte-2267724a-c72f-407b-8425-c07837f89882" acquired by "delete_volume" :: waited 0.047s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:23:51 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[baf737a6-82d2-467b-9421-167a964240f8]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:23:51 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-f7b490f7-bcfd-40a5-9dfb-14c0ae0beff6 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-2267724a-c72f-407b-8425-c07837f89882 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:51 devstack sudo[104947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-2267724a-c72f-407b-8425-c07837f89882 Nov 02 10:23:51 devstack sudo[104947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:51 devstack sudo[104945]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:51 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6a69c670-96e0-47c7-90be-5f797d14f5fd tempest-VolumeAndVolumeTypeFromImageTest-1575186715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-44192c97-85d9-4333-bde5-2f6576e46327 1G" returned: 0 in 0.897s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:51 devstack cinder-volume[86890]: DEBUG cinder.volume.volume_utils [None req-6a69c670-96e0-47c7-90be-5f797d14f5fd tempest-VolumeAndVolumeTypeFromImageTest-1575186715 None] Downloaded image 20765abf-73db-4d53-b9b7-d82f038eceea ((None, [{'url': 'file:///opt/stack/data/glance/images/20765abf-73db-4d53-b9b7-d82f038eceea', 'metadata': {}}])) to volume 44192c97-85d9-4333-bde5-2f6576e46327 successfully. {{(pid=86890) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 02 10:23:51 devstack cinder-volume[86890]: DEBUG cinder.image.image_utils [None req-6a69c670-96e0-47c7-90be-5f797d14f5fd tempest-VolumeAndVolumeTypeFromImageTest-1575186715 None] Temporary image 20765abf-73db-4d53-b9b7-d82f038eceea for user ae98a73a3e33470dab4e5100e464f2ac is deleted. {{(pid=86890) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 02 10:23:51 devstack cinder-volume[86890]: DEBUG cinder.volume.volume_utils [None req-6a69c670-96e0-47c7-90be-5f797d14f5fd tempest-VolumeAndVolumeTypeFromImageTest-1575186715 None] Marking volume 44192c97-85d9-4333-bde5-2f6576e46327 as bootable. {{(pid=86890) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 02 10:23:51 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a69c670-96e0-47c7-90be-5f797d14f5fd tempest-VolumeAndVolumeTypeFromImageTest-1575186715 None] Copying metadata from image 20765abf-73db-4d53-b9b7-d82f038eceea to 44192c97-85d9-4333-bde5-2f6576e46327. {{(pid=86890) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 10:23:51 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a69c670-96e0-47c7-90be-5f797d14f5fd tempest-VolumeAndVolumeTypeFromImageTest-1575186715 None] Creating volume glance metadata for volume 44192c97-85d9-4333-bde5-2f6576e46327 backed by image 20765abf-73db-4d53-b9b7-d82f038eceea with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '20765abf-73db-4d53-b9b7-d82f038eceea', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '03054a71b552ee5658ddcd19e6d23b3e', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86890) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 10:23:51 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-e593b4ca-3f56-48c1-9b1b-3dc6e364c9a0 tempest-CreateVolumesFromSnapshotTest-1668273897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:23:51 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-e593b4ca-3f56-48c1-9b1b-3dc6e364c9a0 tempest-CreateVolumesFromSnapshotTest-1668273897 None] Flow 'volume_create_manager' (127d06af-ae8a-4b4e-a93d-46ae2da2a195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:23:51 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-e593b4ca-3f56-48c1-9b1b-3dc6e364c9a0 tempest-CreateVolumesFromSnapshotTest-1668273897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95972cd0-6a31-45a0-a8b6-e90395a59fcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:51 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-e593b4ca-3f56-48c1-9b1b-3dc6e364c9a0 tempest-CreateVolumesFromSnapshotTest-1668273897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95972cd0-6a31-45a0-a8b6-e90395a59fcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:23:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-659886533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=902745cf-6e64-4c27-906c-6efba04100a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6f1f3d5cf4949fda7d4184bc66179a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:23:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:23:51Z,use_quota=True,user_id='fa4440951e5e4cf59a22b022c1db9263',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:51 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-e593b4ca-3f56-48c1-9b1b-3dc6e364c9a0 tempest-CreateVolumesFromSnapshotTest-1668273897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecb94726-69d0-4d0b-b9de-86ebecf5fc1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:51 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-e593b4ca-3f56-48c1-9b1b-3dc6e364c9a0 tempest-CreateVolumesFromSnapshotTest-1668273897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecb94726-69d0-4d0b-b9de-86ebecf5fc1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:51 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-e593b4ca-3f56-48c1-9b1b-3dc6e364c9a0 tempest-CreateVolumesFromSnapshotTest-1668273897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ceef906-8e5a-4bec-99a8-27f3bc983c6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:51 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-e593b4ca-3f56-48c1-9b1b-3dc6e364c9a0 tempest-CreateVolumesFromSnapshotTest-1668273897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ceef906-8e5a-4bec-99a8-27f3bc983c6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '902745cf-6e64-4c27-906c-6efba04100a6', 'volume_name': 'volume-902745cf-6e64-4c27-906c-6efba04100a6', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:51 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-e593b4ca-3f56-48c1-9b1b-3dc6e364c9a0 tempest-CreateVolumesFromSnapshotTest-1668273897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (902b2334-6a8f-4a42-b895-d2852692c230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:51 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-e593b4ca-3f56-48c1-9b1b-3dc6e364c9a0 tempest-CreateVolumesFromSnapshotTest-1668273897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (902b2334-6a8f-4a42-b895-d2852692c230) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:51 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-e593b4ca-3f56-48c1-9b1b-3dc6e364c9a0 tempest-CreateVolumesFromSnapshotTest-1668273897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dadf0226-341d-41d5-aff6-ebb6b614c005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:51 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-e593b4ca-3f56-48c1-9b1b-3dc6e364c9a0 tempest-CreateVolumesFromSnapshotTest-1668273897 None] Volume 902745cf-6e64-4c27-906c-6efba04100a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-902745cf-6e64-4c27-906c-6efba04100a6', 'volume_size': 1} Nov 02 10:23:51 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-e593b4ca-3f56-48c1-9b1b-3dc6e364c9a0 tempest-CreateVolumesFromSnapshotTest-1668273897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:23:51 devstack sudo[104947]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:51 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-f7b490f7-bcfd-40a5-9dfb-14c0ae0beff6 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-2267724a-c72f-407b-8425-c07837f89882" returned: 0 in 0.724s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:51 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-f7b490f7-bcfd-40a5-9dfb-14c0ae0beff6 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-2267724a-c72f-407b-8425-c07837f89882 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:51 devstack sudo[104956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-2267724a-c72f-407b-8425-c07837f89882 Nov 02 10:23:51 devstack sudo[104956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:51 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-6a69c670-96e0-47c7-90be-5f797d14f5fd tempest-VolumeAndVolumeTypeFromImageTest-1575186715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dfb3561-4954-4922-839e-9f7b653f652f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44192c97-85d9-4333-bde5-2f6576e46327', 'volume_size': 1, 'image_id': '20765abf-73db-4d53-b9b7-d82f038eceea', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/20765abf-73db-4d53-b9b7-d82f038eceea', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '03054a71b552ee5658ddcd19e6d23b3e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e2e18f5b1bd7456a9a089c57017f3aeb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a3b031bb4f957bcfff982e5b9176aff569a531e07725b8e28cffa46d7521dae42e3309f089c6baa1e41f43898b49e289bad974e979045cad9b905f508a416f30', 'id': '20765abf-73db-4d53-b9b7-d82f038eceea', 'created_at': datetime.datetime(2026, 11, 2, 9, 23, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 23, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/20765abf-73db-4d53-b9b7-d82f038eceea/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:51 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-6a69c670-96e0-47c7-90be-5f797d14f5fd tempest-VolumeAndVolumeTypeFromImageTest-1575186715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6aec6203-667c-451f-be45-f6c352d679d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:51 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-6a69c670-96e0-47c7-90be-5f797d14f5fd tempest-VolumeAndVolumeTypeFromImageTest-1575186715 None] Volume volume-44192c97-85d9-4333-bde5-2f6576e46327 (44192c97-85d9-4333-bde5-2f6576e46327): created successfully Nov 02 10:23:51 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-6a69c670-96e0-47c7-90be-5f797d14f5fd tempest-VolumeAndVolumeTypeFromImageTest-1575186715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6aec6203-667c-451f-be45-f6c352d679d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:51 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-6a69c670-96e0-47c7-90be-5f797d14f5fd tempest-VolumeAndVolumeTypeFromImageTest-1575186715 None] Flow 'volume_create_manager' (c88ce49e-b85e-4b6a-b7c2-ce61ebfb867e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:23:51 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-6a69c670-96e0-47c7-90be-5f797d14f5fd tempest-VolumeAndVolumeTypeFromImageTest-1575186715 None] Created volume successfully. Nov 02 10:23:52 devstack sudo[104956]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:52 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-f7b490f7-bcfd-40a5-9dfb-14c0ae0beff6 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-2267724a-c72f-407b-8425-c07837f89882" returned: 0 in 0.360s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:52 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-f7b490f7-bcfd-40a5-9dfb-14c0ae0beff6 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Lock "cinder-quobyte-2267724a-c72f-407b-8425-c07837f89882" released by "delete_volume" :: held 1.190s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:23:52 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-f7b490f7-bcfd-40a5-9dfb-14c0ae0beff6 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Created reservations ['d4edaae9-4f65-417e-976a-f7f3f3f0da16', 'b69e4138-1cad-4703-bb50-f7a0025ff52c', '5b4239b0-1f36-41d5-9ffb-0f082c34bb03', '1639d5a2-ba69-4ca4-8fc0-92e21dbc7f3c'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:23:52 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-f7b490f7-bcfd-40a5-9dfb-14c0ae0beff6 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:23:52 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-f7b490f7-bcfd-40a5-9dfb-14c0ae0beff6 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:23:52 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-f7b490f7-bcfd-40a5-9dfb-14c0ae0beff6 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:23:52 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-f7b490f7-bcfd-40a5-9dfb-14c0ae0beff6 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:23:52 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-f7b490f7-bcfd-40a5-9dfb-14c0ae0beff6 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:23:52 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-f7b490f7-bcfd-40a5-9dfb-14c0ae0beff6 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:52 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-1d81fa81-2268-48d4-a486-028fab016f28 tempest-VolumeAndVolumeTypeFromImageTest-1575186715 None] Acquiring lock "cinder-44192c97-85d9-4333-bde5-2f6576e46327-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:23:52 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-1d81fa81-2268-48d4-a486-028fab016f28 tempest-VolumeAndVolumeTypeFromImageTest-1575186715 None] Lock "cinder-44192c97-85d9-4333-bde5-2f6576e46327-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:23:52 devstack sudo[104960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:23:52 devstack sudo[104960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:52 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-1d81fa81-2268-48d4-a486-028fab016f28 tempest-VolumeAndVolumeTypeFromImageTest-1575186715 None] Acquiring lock "cinder-quobyte-44192c97-85d9-4333-bde5-2f6576e46327" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:23:52 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-1d81fa81-2268-48d4-a486-028fab016f28 tempest-VolumeAndVolumeTypeFromImageTest-1575186715 None] Lock "cinder-quobyte-44192c97-85d9-4333-bde5-2f6576e46327" acquired by "delete_volume" :: waited 0.020s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:23:52 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f46e0fc-aaba-49d2-a78b-1497246c3a95]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:23:52 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-1d81fa81-2268-48d4-a486-028fab016f28 tempest-VolumeAndVolumeTypeFromImageTest-1575186715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-44192c97-85d9-4333-bde5-2f6576e46327 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:52 devstack sudo[104962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-44192c97-85d9-4333-bde5-2f6576e46327 Nov 02 10:23:52 devstack sudo[104962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:52 devstack sudo[104960]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:52 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-f7b490f7-bcfd-40a5-9dfb-14c0ae0beff6 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.492s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:52 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-f7b490f7-bcfd-40a5-9dfb-14c0ae0beff6 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:23:52 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-f7b490f7-bcfd-40a5-9dfb-14c0ae0beff6 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Deleted volume successfully. Nov 02 10:23:53 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-f7b490f7-bcfd-40a5-9dfb-14c0ae0beff6 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Lock "cinder-2267724a-c72f-407b-8425-c07837f89882-delete_volume" released by "delete_volume" :: held 2.165s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:23:53 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-eba0e739-39fb-43ad-9f36-065662f246f7 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Acquiring lock "cinder-de99767b-e7e2-4c5d-999e-5f869b50dfd9-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:23:53 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-eba0e739-39fb-43ad-9f36-065662f246f7 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Lock "cinder-de99767b-e7e2-4c5d-999e-5f869b50dfd9-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:23:53 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-eba0e739-39fb-43ad-9f36-065662f246f7 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Acquiring lock "cinder-quobyte-de99767b-e7e2-4c5d-999e-5f869b50dfd9" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:23:53 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-eba0e739-39fb-43ad-9f36-065662f246f7 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Lock "cinder-quobyte-de99767b-e7e2-4c5d-999e-5f869b50dfd9" acquired by "delete_volume" :: waited 0.040s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:23:53 devstack sudo[104962]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:53 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-1d81fa81-2268-48d4-a486-028fab016f28 tempest-VolumeAndVolumeTypeFromImageTest-1575186715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-44192c97-85d9-4333-bde5-2f6576e46327" returned: 0 in 0.864s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:53 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-1d81fa81-2268-48d4-a486-028fab016f28 tempest-VolumeAndVolumeTypeFromImageTest-1575186715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-44192c97-85d9-4333-bde5-2f6576e46327 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:53 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a035377-beb0-49d8-a547-2ee49d3db656]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:23:53 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-eba0e739-39fb-43ad-9f36-065662f246f7 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-de99767b-e7e2-4c5d-999e-5f869b50dfd9 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:53 devstack sudo[104968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-44192c97-85d9-4333-bde5-2f6576e46327 Nov 02 10:23:53 devstack sudo[104968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:53 devstack sudo[104969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-de99767b-e7e2-4c5d-999e-5f869b50dfd9 Nov 02 10:23:53 devstack sudo[104969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:53 devstack sudo[104968]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:53 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-1d81fa81-2268-48d4-a486-028fab016f28 tempest-VolumeAndVolumeTypeFromImageTest-1575186715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-44192c97-85d9-4333-bde5-2f6576e46327" returned: 0 in 0.394s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:54 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-1d81fa81-2268-48d4-a486-028fab016f28 tempest-VolumeAndVolumeTypeFromImageTest-1575186715 None] Lock "cinder-quobyte-44192c97-85d9-4333-bde5-2f6576e46327" released by "delete_volume" :: held 1.355s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:23:54 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-1d81fa81-2268-48d4-a486-028fab016f28 tempest-VolumeAndVolumeTypeFromImageTest-1575186715 None] Created reservations ['960e01eb-0556-43b9-bb0e-9fec8a3d4547', 'cdd6abb5-b34f-4d3b-8a39-947bfe470018', 'd284b260-b8dc-4db1-98c2-dac8d4c423ad', '07580164-7822-4132-bc01-5ae688facde6'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:23:54 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-1d81fa81-2268-48d4-a486-028fab016f28 tempest-VolumeAndVolumeTypeFromImageTest-1575186715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:23:54 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-1d81fa81-2268-48d4-a486-028fab016f28 tempest-VolumeAndVolumeTypeFromImageTest-1575186715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:23:54 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-1d81fa81-2268-48d4-a486-028fab016f28 tempest-VolumeAndVolumeTypeFromImageTest-1575186715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:23:54 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-1d81fa81-2268-48d4-a486-028fab016f28 tempest-VolumeAndVolumeTypeFromImageTest-1575186715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:23:54 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-1d81fa81-2268-48d4-a486-028fab016f28 tempest-VolumeAndVolumeTypeFromImageTest-1575186715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:23:54 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-1d81fa81-2268-48d4-a486-028fab016f28 tempest-VolumeAndVolumeTypeFromImageTest-1575186715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:54 devstack sudo[104976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:23:54 devstack sudo[104976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:54 devstack sudo[104969]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:54 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-eba0e739-39fb-43ad-9f36-065662f246f7 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-de99767b-e7e2-4c5d-999e-5f869b50dfd9" returned: 0 in 0.812s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:54 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-eba0e739-39fb-43ad-9f36-065662f246f7 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-de99767b-e7e2-4c5d-999e-5f869b50dfd9 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:54 devstack sudo[104979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-de99767b-e7e2-4c5d-999e-5f869b50dfd9 Nov 02 10:23:54 devstack sudo[104979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:54 devstack sudo[104976]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:54 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-1d81fa81-2268-48d4-a486-028fab016f28 tempest-VolumeAndVolumeTypeFromImageTest-1575186715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.354s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:54 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-1d81fa81-2268-48d4-a486-028fab016f28 tempest-VolumeAndVolumeTypeFromImageTest-1575186715 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:23:54 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-1d81fa81-2268-48d4-a486-028fab016f28 tempest-VolumeAndVolumeTypeFromImageTest-1575186715 None] Deleted volume successfully. Nov 02 10:23:54 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-1d81fa81-2268-48d4-a486-028fab016f28 tempest-VolumeAndVolumeTypeFromImageTest-1575186715 None] Lock "cinder-44192c97-85d9-4333-bde5-2f6576e46327-delete_volume" released by "delete_volume" :: held 2.133s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:23:55 devstack sudo[104979]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:55 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-eba0e739-39fb-43ad-9f36-065662f246f7 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-de99767b-e7e2-4c5d-999e-5f869b50dfd9" returned: 0 in 0.575s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:55 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-eba0e739-39fb-43ad-9f36-065662f246f7 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Lock "cinder-quobyte-de99767b-e7e2-4c5d-999e-5f869b50dfd9" released by "delete_volume" :: held 1.526s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:23:55 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-eba0e739-39fb-43ad-9f36-065662f246f7 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Created reservations ['9ba57752-0b34-403b-8cb8-c39354e70f27', '7d269f71-8db2-4f48-b693-c87817b3f6b0', 'c509baf8-4185-4f1a-8091-765f68c9efdb', '5c25ce9f-f514-4461-9be1-f30d15aaad0e'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:23:55 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-eba0e739-39fb-43ad-9f36-065662f246f7 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:23:55 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-eba0e739-39fb-43ad-9f36-065662f246f7 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:23:55 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-eba0e739-39fb-43ad-9f36-065662f246f7 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:23:55 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-eba0e739-39fb-43ad-9f36-065662f246f7 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:23:55 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-eba0e739-39fb-43ad-9f36-065662f246f7 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:23:55 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-eba0e739-39fb-43ad-9f36-065662f246f7 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:55 devstack sudo[104983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:23:55 devstack sudo[104983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:55 devstack sudo[104983]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:55 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-eba0e739-39fb-43ad-9f36-065662f246f7 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.402s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:55 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-eba0e739-39fb-43ad-9f36-065662f246f7 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:23:55 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-eba0e739-39fb-43ad-9f36-065662f246f7 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Deleted volume successfully. Nov 02 10:23:55 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-eba0e739-39fb-43ad-9f36-065662f246f7 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Lock "cinder-de99767b-e7e2-4c5d-999e-5f869b50dfd9-delete_volume" released by "delete_volume" :: held 2.387s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:23:55 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-222bdcf6-d410-4b4e-938f-9e15b1c127b3 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Acquiring lock "cinder-335c025b-e99a-4269-8eb9-b7f9d3182131-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:23:55 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-222bdcf6-d410-4b4e-938f-9e15b1c127b3 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Lock "cinder-335c025b-e99a-4269-8eb9-b7f9d3182131-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:23:55 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-222bdcf6-d410-4b4e-938f-9e15b1c127b3 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Acquiring lock "cinder-quobyte-335c025b-e99a-4269-8eb9-b7f9d3182131" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:23:56 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-222bdcf6-d410-4b4e-938f-9e15b1c127b3 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Lock "cinder-quobyte-335c025b-e99a-4269-8eb9-b7f9d3182131" acquired by "delete_volume" :: waited 0.042s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:23:56 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[38250139-d304-4b32-9650-9f0fdbfc5f58]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:23:56 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-222bdcf6-d410-4b4e-938f-9e15b1c127b3 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-335c025b-e99a-4269-8eb9-b7f9d3182131 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:56 devstack sudo[104986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-335c025b-e99a-4269-8eb9-b7f9d3182131 Nov 02 10:23:56 devstack sudo[104986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:56 devstack sudo[104911]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:56 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8e8f677b-2db3-413d-bc65-983a0009ed1f tempest-VolumeDependencyTests-724561728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b65175c9-bbdc-4eb8-b06d-15953654223e /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-16a919b3-4c6f-439b-b8cd-35118a9a3a83" returned: 0 in 8.048s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:56 devstack cinder-volume[86890]: DEBUG cinder.image.image_utils [None req-8e8f677b-2db3-413d-bc65-983a0009ed1f tempest-VolumeDependencyTests-724561728 None] Image conversion details: src /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b65175c9-bbdc-4eb8-b06d-15953654223e, size 1024.00 MB, duration 8.05 sec, destination /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-16a919b3-4c6f-439b-b8cd-35118a9a3a83 {{(pid=86890) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 10:23:56 devstack cinder-volume[86890]: INFO cinder.image.image_utils [None req-8e8f677b-2db3-413d-bc65-983a0009ed1f tempest-VolumeDependencyTests-724561728 None] Converted 1024.00 MB image at 127.21 MB/s Nov 02 10:23:56 devstack cinder-volume[86890]: WARNING cinder.volume.drivers.remotefs [None req-8e8f677b-2db3-413d-bc65-983a0009ed1f tempest-VolumeDependencyTests-724561728 None] /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-16a919b3-4c6f-439b-b8cd-35118a9a3a83 is being set with open permissions: ugo+rw Nov 02 10:23:56 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8e8f677b-2db3-413d-bc65-983a0009ed1f tempest-VolumeDependencyTests-724561728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-16a919b3-4c6f-439b-b8cd-35118a9a3a83 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:56 devstack sudo[104992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-16a919b3-4c6f-439b-b8cd-35118a9a3a83 Nov 02 10:23:56 devstack sudo[104992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:56 devstack sudo[104986]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:56 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-222bdcf6-d410-4b4e-938f-9e15b1c127b3 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-335c025b-e99a-4269-8eb9-b7f9d3182131" returned: 0 in 0.751s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:56 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-222bdcf6-d410-4b4e-938f-9e15b1c127b3 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-335c025b-e99a-4269-8eb9-b7f9d3182131 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:56 devstack sudo[104995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-335c025b-e99a-4269-8eb9-b7f9d3182131 Nov 02 10:23:56 devstack sudo[104995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:57 devstack sudo[104992]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:57 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8e8f677b-2db3-413d-bc65-983a0009ed1f tempest-VolumeDependencyTests-724561728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-16a919b3-4c6f-439b-b8cd-35118a9a3a83" returned: 0 in 0.345s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:57 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-8e8f677b-2db3-413d-bc65-983a0009ed1f tempest-VolumeDependencyTests-724561728 None] Lock "cinder-quobyte-16a919b3-4c6f-439b-b8cd-35118a9a3a83" released by "_copy_volume_from_snapshot" :: held 9.814s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:23:57 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-8e8f677b-2db3-413d-bc65-983a0009ed1f tempest-VolumeDependencyTests-724561728 None] Lock "cinder-quobyte-5e8d7cd2-68aa-49a7-b7a2-e726d17a7685-16a919b3-4c6f-439b-b8cd-35118a9a3a83" released by "_create_volume_from_snapshot" :: held 9.904s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:23:57 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-8e8f677b-2db3-413d-bc65-983a0009ed1f tempest-VolumeDependencyTests-724561728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.942s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:23:57 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-e593b4ca-3f56-48c1-9b1b-3dc6e364c9a0 tempest-CreateVolumesFromSnapshotTest-1668273897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.430s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:23:57 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-e593b4ca-3f56-48c1-9b1b-3dc6e364c9a0 tempest-CreateVolumesFromSnapshotTest-1668273897 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:23:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-659886533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=902745cf-6e64-4c27-906c-6efba04100a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6f1f3d5cf4949fda7d4184bc66179a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:23:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:23:51Z,use_quota=True,user_id='fa4440951e5e4cf59a22b022c1db9263',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:23:57 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-e593b4ca-3f56-48c1-9b1b-3dc6e364c9a0 tempest-CreateVolumesFromSnapshotTest-1668273897 None] Creating volume 902745cf-6e64-4c27-906c-6efba04100a6 {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:23:57 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-e593b4ca-3f56-48c1-9b1b-3dc6e364c9a0 tempest-CreateVolumesFromSnapshotTest-1668273897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:23:57 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-e593b4ca-3f56-48c1-9b1b-3dc6e364c9a0 tempest-CreateVolumesFromSnapshotTest-1668273897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:23:57 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-e593b4ca-3f56-48c1-9b1b-3dc6e364c9a0 tempest-CreateVolumesFromSnapshotTest-1668273897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:23:57 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-e593b4ca-3f56-48c1-9b1b-3dc6e364c9a0 tempest-CreateVolumesFromSnapshotTest-1668273897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:23:57 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-e593b4ca-3f56-48c1-9b1b-3dc6e364c9a0 tempest-CreateVolumesFromSnapshotTest-1668273897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:23:57 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-e593b4ca-3f56-48c1-9b1b-3dc6e364c9a0 tempest-CreateVolumesFromSnapshotTest-1668273897 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:23:57 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-e593b4ca-3f56-48c1-9b1b-3dc6e364c9a0 tempest-CreateVolumesFromSnapshotTest-1668273897 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:23:57 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-e593b4ca-3f56-48c1-9b1b-3dc6e364c9a0 tempest-CreateVolumesFromSnapshotTest-1668273897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-902745cf-6e64-4c27-906c-6efba04100a6 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:57 devstack sudo[104995]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:57 devstack sudo[104999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-902745cf-6e64-4c27-906c-6efba04100a6 1073741824 Nov 02 10:23:57 devstack sudo[104999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:57 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-222bdcf6-d410-4b4e-938f-9e15b1c127b3 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-335c025b-e99a-4269-8eb9-b7f9d3182131" returned: 0 in 0.348s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:57 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-8e8f677b-2db3-413d-bc65-983a0009ed1f tempest-VolumeDependencyTests-724561728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (315e8a15-65be-4ec4-a4db-b2ea47415485) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16a919b3-4c6f-439b-b8cd-35118a9a3a83', 'volume_size': 1, 'snapshot_id': '5e8d7cd2-68aa-49a7-b7a2-e726d17a7685'}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:57 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-8e8f677b-2db3-413d-bc65-983a0009ed1f tempest-VolumeDependencyTests-724561728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dfac6e5-ef38-4c0e-b2e8-455a005bbe73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:57 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-222bdcf6-d410-4b4e-938f-9e15b1c127b3 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Lock "cinder-quobyte-335c025b-e99a-4269-8eb9-b7f9d3182131" released by "delete_volume" :: held 1.218s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:23:57 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-8e8f677b-2db3-413d-bc65-983a0009ed1f tempest-VolumeDependencyTests-724561728 None] Volume volume-16a919b3-4c6f-439b-b8cd-35118a9a3a83 (16a919b3-4c6f-439b-b8cd-35118a9a3a83): created successfully Nov 02 10:23:57 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-8e8f677b-2db3-413d-bc65-983a0009ed1f tempest-VolumeDependencyTests-724561728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dfac6e5-ef38-4c0e-b2e8-455a005bbe73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:57 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-8e8f677b-2db3-413d-bc65-983a0009ed1f tempest-VolumeDependencyTests-724561728 None] Flow 'volume_create_manager' (07f9a050-6a09-4d23-964a-3e9274c4e8a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:23:57 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-8e8f677b-2db3-413d-bc65-983a0009ed1f tempest-VolumeDependencyTests-724561728 None] Created volume successfully. Nov 02 10:23:57 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-222bdcf6-d410-4b4e-938f-9e15b1c127b3 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Created reservations ['3acc1e35-7bab-4181-b39f-22dce2b4eb2b', '91f7f4c1-a966-4c24-bac7-37f3d36f5a5f', 'ebec34d3-6cf3-4c52-83ff-64c70af405c5', '3ee4bae3-8e2b-4b94-8663-2b2a86a05680'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:23:57 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-222bdcf6-d410-4b4e-938f-9e15b1c127b3 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:23:57 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-222bdcf6-d410-4b4e-938f-9e15b1c127b3 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:23:57 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-222bdcf6-d410-4b4e-938f-9e15b1c127b3 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:23:57 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-222bdcf6-d410-4b4e-938f-9e15b1c127b3 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:23:57 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-222bdcf6-d410-4b4e-938f-9e15b1c127b3 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:23:57 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-222bdcf6-d410-4b4e-938f-9e15b1c127b3 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:57 devstack sudo[105004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:23:57 devstack sudo[105004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:57 devstack sudo[104999]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:57 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-e593b4ca-3f56-48c1-9b1b-3dc6e364c9a0 tempest-CreateVolumesFromSnapshotTest-1668273897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-902745cf-6e64-4c27-906c-6efba04100a6 1073741824" returned: 0 in 0.579s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:57 devstack sudo[105004]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:57 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-2cbfa90e-d646-4473-b633-37c196b62ad4 tempest-VolumeDependencyTests-724561728 None] Acquiring lock "cinder-5e8d7cd2-68aa-49a7-b7a2-e726d17a7685-delete_snapshot" by "delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:23:57 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-222bdcf6-d410-4b4e-938f-9e15b1c127b3 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.300s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:57 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-222bdcf6-d410-4b4e-938f-9e15b1c127b3 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:23:57 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-222bdcf6-d410-4b4e-938f-9e15b1c127b3 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Deleted volume successfully. Nov 02 10:23:57 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-2cbfa90e-d646-4473-b633-37c196b62ad4 tempest-VolumeDependencyTests-724561728 None] Lock "cinder-5e8d7cd2-68aa-49a7-b7a2-e726d17a7685-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:23:57 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-2cbfa90e-d646-4473-b633-37c196b62ad4 tempest-VolumeDependencyTests-724561728 None] Acquiring lock "cinder-quobyte-b65175c9-bbdc-4eb8-b06d-15953654223e" by "delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:23:57 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-e593b4ca-3f56-48c1-9b1b-3dc6e364c9a0 tempest-CreateVolumesFromSnapshotTest-1668273897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-902745cf-6e64-4c27-906c-6efba04100a6 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:57 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-2cbfa90e-d646-4473-b633-37c196b62ad4 tempest-VolumeDependencyTests-724561728 None] Lock "cinder-quobyte-b65175c9-bbdc-4eb8-b06d-15953654223e" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:23:57 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-2cbfa90e-d646-4473-b633-37c196b62ad4 tempest-VolumeDependencyTests-724561728 None] Acquiring lock "cinder-quobyte-5e8d7cd2-68aa-49a7-b7a2-e726d17a7685" by "_delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:23:57 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-222bdcf6-d410-4b4e-938f-9e15b1c127b3 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Lock "cinder-335c025b-e99a-4269-8eb9-b7f9d3182131-delete_volume" released by "delete_volume" :: held 1.972s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:23:57 devstack sudo[105008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-902745cf-6e64-4c27-906c-6efba04100a6 Nov 02 10:23:57 devstack sudo[105008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:57 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-2cbfa90e-d646-4473-b633-37c196b62ad4 tempest-VolumeDependencyTests-724561728 None] Lock "cinder-quobyte-5e8d7cd2-68aa-49a7-b7a2-e726d17a7685" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:23:57 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-2cbfa90e-d646-4473-b633-37c196b62ad4 tempest-VolumeDependencyTests-724561728 None] Deleting offline snapshot 5e8d7cd2-68aa-49a7-b7a2-e726d17a7685 of volume b65175c9-bbdc-4eb8-b06d-15953654223e {{(pid=86890) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:23:57 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-2cbfa90e-d646-4473-b633-37c196b62ad4 tempest-VolumeDependencyTests-724561728 None] snapshot_file for this snap is: volume-b65175c9-bbdc-4eb8-b06d-15953654223e.5e8d7cd2-68aa-49a7-b7a2-e726d17a7685 {{(pid=86890) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:23:57 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[b529b327-edad-4ec0-9440-541f4e24e00d]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:23:57 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-2cbfa90e-d646-4473-b633-37c196b62ad4 tempest-VolumeDependencyTests-724561728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b65175c9-bbdc-4eb8-b06d-15953654223e.5e8d7cd2-68aa-49a7-b7a2-e726d17a7685 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:58 devstack sudo[105010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b65175c9-bbdc-4eb8-b06d-15953654223e.5e8d7cd2-68aa-49a7-b7a2-e726d17a7685 Nov 02 10:23:58 devstack sudo[105010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:58 devstack sudo[105008]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:58 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-e593b4ca-3f56-48c1-9b1b-3dc6e364c9a0 tempest-CreateVolumesFromSnapshotTest-1668273897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-902745cf-6e64-4c27-906c-6efba04100a6" returned: 0 in 0.347s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:58 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-e593b4ca-3f56-48c1-9b1b-3dc6e364c9a0 tempest-CreateVolumesFromSnapshotTest-1668273897 None] <== create_volume: return (1017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:23:58 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-e593b4ca-3f56-48c1-9b1b-3dc6e364c9a0 tempest-CreateVolumesFromSnapshotTest-1668273897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.024s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:23:58 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-e593b4ca-3f56-48c1-9b1b-3dc6e364c9a0 tempest-CreateVolumesFromSnapshotTest-1668273897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dadf0226-341d-41d5-aff6-ebb6b614c005) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-902745cf-6e64-4c27-906c-6efba04100a6', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:58 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-e593b4ca-3f56-48c1-9b1b-3dc6e364c9a0 tempest-CreateVolumesFromSnapshotTest-1668273897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fdb0501-2602-4cd0-a7ce-a339dd4d3ff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:58 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-bc76203f-e050-4d17-a627-c4549f0bd065 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Acquiring lock "cinder-3748392e-5863-423c-aa48-e0035ca708fd-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:23:58 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-e593b4ca-3f56-48c1-9b1b-3dc6e364c9a0 tempest-CreateVolumesFromSnapshotTest-1668273897 None] Volume volume-902745cf-6e64-4c27-906c-6efba04100a6 (902745cf-6e64-4c27-906c-6efba04100a6): created successfully Nov 02 10:23:58 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-e593b4ca-3f56-48c1-9b1b-3dc6e364c9a0 tempest-CreateVolumesFromSnapshotTest-1668273897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fdb0501-2602-4cd0-a7ce-a339dd4d3ff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:58 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-e593b4ca-3f56-48c1-9b1b-3dc6e364c9a0 tempest-CreateVolumesFromSnapshotTest-1668273897 None] Flow 'volume_create_manager' (127d06af-ae8a-4b4e-a93d-46ae2da2a195) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:23:58 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-bc76203f-e050-4d17-a627-c4549f0bd065 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Lock "cinder-3748392e-5863-423c-aa48-e0035ca708fd-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:23:58 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-e593b4ca-3f56-48c1-9b1b-3dc6e364c9a0 tempest-CreateVolumesFromSnapshotTest-1668273897 None] Created volume successfully. Nov 02 10:23:58 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-bc76203f-e050-4d17-a627-c4549f0bd065 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Acquiring lock "cinder-quobyte-3748392e-5863-423c-aa48-e0035ca708fd" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:23:58 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-bc76203f-e050-4d17-a627-c4549f0bd065 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Lock "cinder-quobyte-3748392e-5863-423c-aa48-e0035ca708fd" acquired by "delete_volume" :: waited 0.015s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:23:58 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[c041bc60-e330-4b3a-a242-e473a5bb96a1]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:23:58 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-bc76203f-e050-4d17-a627-c4549f0bd065 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3748392e-5863-423c-aa48-e0035ca708fd {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:58 devstack sudo[105010]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:58 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-2cbfa90e-d646-4473-b633-37c196b62ad4 tempest-VolumeDependencyTests-724561728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b65175c9-bbdc-4eb8-b06d-15953654223e.5e8d7cd2-68aa-49a7-b7a2-e726d17a7685" returned: 0 in 0.482s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:58 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-2cbfa90e-d646-4473-b633-37c196b62ad4 tempest-VolumeDependencyTests-724561728 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b65175c9-bbdc-4eb8-b06d-15953654223e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86890) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:23:58 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[938cf93f-5e08-4e81-83b9-fda78cc9e3b5]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:23:58 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-2cbfa90e-d646-4473-b633-37c196b62ad4 tempest-VolumeDependencyTests-724561728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b65175c9-bbdc-4eb8-b06d-15953654223e {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:58 devstack sudo[105017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3748392e-5863-423c-aa48-e0035ca708fd Nov 02 10:23:58 devstack sudo[105017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:58 devstack sudo[105018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b65175c9-bbdc-4eb8-b06d-15953654223e Nov 02 10:23:58 devstack sudo[105018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:58 devstack sudo[105017]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:58 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-bc76203f-e050-4d17-a627-c4549f0bd065 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3748392e-5863-423c-aa48-e0035ca708fd" returned: 0 in 0.422s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:58 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-bc76203f-e050-4d17-a627-c4549f0bd065 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3748392e-5863-423c-aa48-e0035ca708fd {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:58 devstack sudo[105027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3748392e-5863-423c-aa48-e0035ca708fd Nov 02 10:23:58 devstack sudo[105027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:59 devstack sudo[105018]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:59 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-2cbfa90e-d646-4473-b633-37c196b62ad4 tempest-VolumeDependencyTests-724561728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b65175c9-bbdc-4eb8-b06d-15953654223e" returned: 0 in 0.616s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:59 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-2cbfa90e-d646-4473-b633-37c196b62ad4 tempest-VolumeDependencyTests-724561728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b65175c9-bbdc-4eb8-b06d-15953654223e.5e8d7cd2-68aa-49a7-b7a2-e726d17a7685 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:59 devstack sudo[105031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b65175c9-bbdc-4eb8-b06d-15953654223e.5e8d7cd2-68aa-49a7-b7a2-e726d17a7685 Nov 02 10:23:59 devstack sudo[105031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:59 devstack sudo[105027]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:59 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-bc76203f-e050-4d17-a627-c4549f0bd065 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3748392e-5863-423c-aa48-e0035ca708fd" returned: 0 in 0.311s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:59 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-bc76203f-e050-4d17-a627-c4549f0bd065 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Lock "cinder-quobyte-3748392e-5863-423c-aa48-e0035ca708fd" released by "delete_volume" :: held 0.792s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:23:59 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-bc76203f-e050-4d17-a627-c4549f0bd065 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Created reservations ['fea6846e-3fa6-49c2-bc7d-fda58f9e35a3', 'c1ae35ed-7292-40a9-8431-e1de51f70365', 'e10d9072-4e1f-4766-9edd-48fe97ed2903', '7331bb64-ea5b-4b63-9ab9-69958e6c4d8c'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:23:59 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-bc76203f-e050-4d17-a627-c4549f0bd065 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:23:59 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-bc76203f-e050-4d17-a627-c4549f0bd065 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:23:59 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-bc76203f-e050-4d17-a627-c4549f0bd065 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:23:59 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-bc76203f-e050-4d17-a627-c4549f0bd065 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:23:59 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-bc76203f-e050-4d17-a627-c4549f0bd065 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:23:59 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-bc76203f-e050-4d17-a627-c4549f0bd065 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:59 devstack sudo[105034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:23:59 devstack sudo[105034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:59 devstack sudo[105031]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:59 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-2cbfa90e-d646-4473-b633-37c196b62ad4 tempest-VolumeDependencyTests-724561728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b65175c9-bbdc-4eb8-b06d-15953654223e.5e8d7cd2-68aa-49a7-b7a2-e726d17a7685" returned: 0 in 0.526s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:59 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-2cbfa90e-d646-4473-b633-37c196b62ad4 tempest-VolumeDependencyTests-724561728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b65175c9-bbdc-4eb8-b06d-15953654223e.5e8d7cd2-68aa-49a7-b7a2-e726d17a7685 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:59 devstack sudo[105038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b65175c9-bbdc-4eb8-b06d-15953654223e.5e8d7cd2-68aa-49a7-b7a2-e726d17a7685 Nov 02 10:23:59 devstack sudo[105038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:59 devstack sudo[105034]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:59 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-bc76203f-e050-4d17-a627-c4549f0bd065 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.359s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:59 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-bc76203f-e050-4d17-a627-c4549f0bd065 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:23:59 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-bc76203f-e050-4d17-a627-c4549f0bd065 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Deleted volume successfully. Nov 02 10:23:59 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-bc76203f-e050-4d17-a627-c4549f0bd065 tempest-CreateVolumesFromSourceVolumeTest-466506559 None] Lock "cinder-3748392e-5863-423c-aa48-e0035ca708fd-delete_volume" released by "delete_volume" :: held 1.456s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:23:59 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-4da5f326-f4e5-43e7-8827-a64d105ff20d tempest-CreateVolumesFromSnapshotTest-1668273897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:23:59 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-4da5f326-f4e5-43e7-8827-a64d105ff20d tempest-CreateVolumesFromSnapshotTest-1668273897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:23:59 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-4da5f326-f4e5-43e7-8827-a64d105ff20d tempest-CreateVolumesFromSnapshotTest-1668273897 None] Creating offline snapshot 17f9fd5d-64c1-4974-82c0-56a2b5ec4a32 of volume 902745cf-6e64-4c27-906c-6efba04100a6 {{(pid=86890) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:23:59 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[4454e25a-4405-4b99-8225-2968f3049417]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:23:59 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-4da5f326-f4e5-43e7-8827-a64d105ff20d tempest-CreateVolumesFromSnapshotTest-1668273897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-902745cf-6e64-4c27-906c-6efba04100a6 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:59 devstack sudo[105038]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:59 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-2cbfa90e-d646-4473-b633-37c196b62ad4 tempest-VolumeDependencyTests-724561728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b65175c9-bbdc-4eb8-b06d-15953654223e.5e8d7cd2-68aa-49a7-b7a2-e726d17a7685" returned: 0 in 0.350s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:59 devstack sudo[105041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-902745cf-6e64-4c27-906c-6efba04100a6 Nov 02 10:23:59 devstack sudo[105041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:00 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-2cbfa90e-d646-4473-b633-37c196b62ad4 tempest-VolumeDependencyTests-724561728 None] Lock "cinder-quobyte-5e8d7cd2-68aa-49a7-b7a2-e726d17a7685" released by "_delete_snapshot" :: held 2.126s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:24:00 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-2cbfa90e-d646-4473-b633-37c196b62ad4 tempest-VolumeDependencyTests-724561728 None] Lock "cinder-quobyte-b65175c9-bbdc-4eb8-b06d-15953654223e" released by "delete_snapshot" :: held 2.164s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:24:00 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-2cbfa90e-d646-4473-b633-37c196b62ad4 tempest-VolumeDependencyTests-724561728 None] Created reservations ['e2878c40-c873-4ce8-889c-de2372b658c6', '6e871210-d63f-41ec-8d1d-e5476deefd98', '0fa0084a-8c2c-48ef-a42e-994eb1a6b668', 'ea331632-4bef-49cd-830a-817892ff68cd'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:24:00 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-2cbfa90e-d646-4473-b633-37c196b62ad4 tempest-VolumeDependencyTests-724561728 None] Delete snapshot completed successfully. Nov 02 10:24:00 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-2cbfa90e-d646-4473-b633-37c196b62ad4 tempest-VolumeDependencyTests-724561728 None] Lock "cinder-5e8d7cd2-68aa-49a7-b7a2-e726d17a7685-delete_snapshot" released by "delete_snapshot" :: held 2.373s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:24:00 devstack sudo[105041]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:00 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-4da5f326-f4e5-43e7-8827-a64d105ff20d tempest-CreateVolumesFromSnapshotTest-1668273897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-902745cf-6e64-4c27-906c-6efba04100a6" returned: 0 in 0.449s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:00 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-4da5f326-f4e5-43e7-8827-a64d105ff20d tempest-CreateVolumesFromSnapshotTest-1668273897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-902745cf-6e64-4c27-906c-6efba04100a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-902745cf-6e64-4c27-906c-6efba04100a6.17f9fd5d-64c1-4974-82c0-56a2b5ec4a32 1G {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:00 devstack sudo[105048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-902745cf-6e64-4c27-906c-6efba04100a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-902745cf-6e64-4c27-906c-6efba04100a6.17f9fd5d-64c1-4974-82c0-56a2b5ec4a32 1G Nov 02 10:24:00 devstack sudo[105048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:00 devstack sudo[105048]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:00 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-4da5f326-f4e5-43e7-8827-a64d105ff20d tempest-CreateVolumesFromSnapshotTest-1668273897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-902745cf-6e64-4c27-906c-6efba04100a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-902745cf-6e64-4c27-906c-6efba04100a6.17f9fd5d-64c1-4974-82c0-56a2b5ec4a32 1G" returned: 0 in 0.502s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:00 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-4da5f326-f4e5-43e7-8827-a64d105ff20d tempest-CreateVolumesFromSnapshotTest-1668273897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-902745cf-6e64-4c27-906c-6efba04100a6 -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-902745cf-6e64-4c27-906c-6efba04100a6.17f9fd5d-64c1-4974-82c0-56a2b5ec4a32 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:00 devstack sudo[105054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-902745cf-6e64-4c27-906c-6efba04100a6 -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-902745cf-6e64-4c27-906c-6efba04100a6.17f9fd5d-64c1-4974-82c0-56a2b5ec4a32 Nov 02 10:24:00 devstack sudo[105054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:01 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-6a2e155c-5670-40ab-b286-10e4511cc5a5 tempest-VolumeDependencyTests-724561728 None] Acquiring lock "cinder-b65175c9-bbdc-4eb8-b06d-15953654223e-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:24:01 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-6a2e155c-5670-40ab-b286-10e4511cc5a5 tempest-VolumeDependencyTests-724561728 None] Lock "cinder-b65175c9-bbdc-4eb8-b06d-15953654223e-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:24:01 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-6a2e155c-5670-40ab-b286-10e4511cc5a5 tempest-VolumeDependencyTests-724561728 None] Acquiring lock "cinder-quobyte-b65175c9-bbdc-4eb8-b06d-15953654223e" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:24:01 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-6a2e155c-5670-40ab-b286-10e4511cc5a5 tempest-VolumeDependencyTests-724561728 None] Lock "cinder-quobyte-b65175c9-bbdc-4eb8-b06d-15953654223e" acquired by "delete_volume" :: waited 0.023s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:24:01 devstack sudo[105054]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:01 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-4da5f326-f4e5-43e7-8827-a64d105ff20d tempest-CreateVolumesFromSnapshotTest-1668273897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-902745cf-6e64-4c27-906c-6efba04100a6 -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-902745cf-6e64-4c27-906c-6efba04100a6.17f9fd5d-64c1-4974-82c0-56a2b5ec4a32" returned: 0 in 0.405s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:01 devstack cinder-volume[86890]: WARNING cinder.volume.drivers.remotefs [None req-4da5f326-f4e5-43e7-8827-a64d105ff20d tempest-CreateVolumesFromSnapshotTest-1668273897 None] /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-902745cf-6e64-4c27-906c-6efba04100a6.17f9fd5d-64c1-4974-82c0-56a2b5ec4a32 is being set with open permissions: ugo+rw Nov 02 10:24:01 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-4da5f326-f4e5-43e7-8827-a64d105ff20d tempest-CreateVolumesFromSnapshotTest-1668273897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-902745cf-6e64-4c27-906c-6efba04100a6.17f9fd5d-64c1-4974-82c0-56a2b5ec4a32 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:01 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[170d9b9d-e59f-4f1c-a605-398f186a13b7]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:24:01 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6a2e155c-5670-40ab-b286-10e4511cc5a5 tempest-VolumeDependencyTests-724561728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b65175c9-bbdc-4eb8-b06d-15953654223e {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:01 devstack sudo[105060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-902745cf-6e64-4c27-906c-6efba04100a6.17f9fd5d-64c1-4974-82c0-56a2b5ec4a32 Nov 02 10:24:01 devstack sudo[105060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:01 devstack sudo[105061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b65175c9-bbdc-4eb8-b06d-15953654223e Nov 02 10:24:01 devstack sudo[105061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:01 devstack sudo[105060]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:01 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-4da5f326-f4e5-43e7-8827-a64d105ff20d tempest-CreateVolumesFromSnapshotTest-1668273897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-902745cf-6e64-4c27-906c-6efba04100a6.17f9fd5d-64c1-4974-82c0-56a2b5ec4a32" returned: 0 in 0.323s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:01 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-4da5f326-f4e5-43e7-8827-a64d105ff20d tempest-CreateVolumesFromSnapshotTest-1668273897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-902745cf-6e64-4c27-906c-6efba04100a6.info {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:01 devstack sudo[105065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-902745cf-6e64-4c27-906c-6efba04100a6.info Nov 02 10:24:01 devstack sudo[105065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:01 devstack sudo[105061]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:01 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6a2e155c-5670-40ab-b286-10e4511cc5a5 tempest-VolumeDependencyTests-724561728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b65175c9-bbdc-4eb8-b06d-15953654223e" returned: 0 in 0.505s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:01 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6a2e155c-5670-40ab-b286-10e4511cc5a5 tempest-VolumeDependencyTests-724561728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b65175c9-bbdc-4eb8-b06d-15953654223e {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:01 devstack sudo[105071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b65175c9-bbdc-4eb8-b06d-15953654223e Nov 02 10:24:01 devstack sudo[105071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:01 devstack sudo[105065]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:01 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-4da5f326-f4e5-43e7-8827-a64d105ff20d tempest-CreateVolumesFromSnapshotTest-1668273897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-902745cf-6e64-4c27-906c-6efba04100a6.info" returned: 0 in 0.349s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:01 devstack cinder-volume[86890]: WARNING cinder.volume.drivers.remotefs [None req-4da5f326-f4e5-43e7-8827-a64d105ff20d tempest-CreateVolumesFromSnapshotTest-1668273897 None] /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-902745cf-6e64-4c27-906c-6efba04100a6.info is being set with open permissions: ugo+rw Nov 02 10:24:01 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-4da5f326-f4e5-43e7-8827-a64d105ff20d tempest-CreateVolumesFromSnapshotTest-1668273897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-902745cf-6e64-4c27-906c-6efba04100a6.info {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:01 devstack sudo[105074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-902745cf-6e64-4c27-906c-6efba04100a6.info Nov 02 10:24:01 devstack sudo[105074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:02 devstack sudo[105071]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:02 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6a2e155c-5670-40ab-b286-10e4511cc5a5 tempest-VolumeDependencyTests-724561728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b65175c9-bbdc-4eb8-b06d-15953654223e" returned: 0 in 0.320s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:02 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-6a2e155c-5670-40ab-b286-10e4511cc5a5 tempest-VolumeDependencyTests-724561728 None] Lock "cinder-quobyte-b65175c9-bbdc-4eb8-b06d-15953654223e" released by "delete_volume" :: held 0.923s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:24:02 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-6a2e155c-5670-40ab-b286-10e4511cc5a5 tempest-VolumeDependencyTests-724561728 None] Created reservations ['51bc318b-f815-4902-8924-5479ef854d41', '2c2b0508-232e-4a36-87a8-494668e2a84e', '202d885b-563c-4cc6-aea6-13e66e8f7928', 'b3e96fe5-0ae0-4217-8eac-77c02647c8ec'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:24:02 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-6a2e155c-5670-40ab-b286-10e4511cc5a5 tempest-VolumeDependencyTests-724561728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:24:02 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-6a2e155c-5670-40ab-b286-10e4511cc5a5 tempest-VolumeDependencyTests-724561728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:24:02 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-6a2e155c-5670-40ab-b286-10e4511cc5a5 tempest-VolumeDependencyTests-724561728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:24:02 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-6a2e155c-5670-40ab-b286-10e4511cc5a5 tempest-VolumeDependencyTests-724561728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:24:02 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-6a2e155c-5670-40ab-b286-10e4511cc5a5 tempest-VolumeDependencyTests-724561728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:24:02 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6a2e155c-5670-40ab-b286-10e4511cc5a5 tempest-VolumeDependencyTests-724561728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:02 devstack sudo[105074]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:02 devstack sudo[105078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:24:02 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-2d344598-b72f-4bd5-8d5c-6ad3d7159feb tempest-VolumeDependencyTests-724561728 None] Acquiring lock "cinder-16a919b3-4c6f-439b-b8cd-35118a9a3a83-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:24:02 devstack sudo[105078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:02 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-4da5f326-f4e5-43e7-8827-a64d105ff20d tempest-CreateVolumesFromSnapshotTest-1668273897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-902745cf-6e64-4c27-906c-6efba04100a6.info" returned: 0 in 0.402s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:02 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-4da5f326-f4e5-43e7-8827-a64d105ff20d tempest-CreateVolumesFromSnapshotTest-1668273897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.579s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:24:02 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-2d344598-b72f-4bd5-8d5c-6ad3d7159feb tempest-VolumeDependencyTests-724561728 None] Lock "cinder-16a919b3-4c6f-439b-b8cd-35118a9a3a83-delete_volume" acquired by "delete_volume" :: waited 0.122s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:24:02 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-ccd60e10-76de-4b1a-bb2a-418bd1d8fc4c tempest-ProjectAdminTests-9324426 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.772819519043, 'free_capacity_gb': 1773.772819519043, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86890) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 02 10:24:02 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-4da5f326-f4e5-43e7-8827-a64d105ff20d tempest-CreateVolumesFromSnapshotTest-1668273897 None] Create snapshot completed successfully Nov 02 10:24:02 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-2d344598-b72f-4bd5-8d5c-6ad3d7159feb tempest-VolumeDependencyTests-724561728 None] Acquiring lock "cinder-quobyte-16a919b3-4c6f-439b-b8cd-35118a9a3a83" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:24:02 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-2d344598-b72f-4bd5-8d5c-6ad3d7159feb tempest-VolumeDependencyTests-724561728 None] Lock "cinder-quobyte-16a919b3-4c6f-439b-b8cd-35118a9a3a83" acquired by "delete_volume" :: waited 0.034s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:24:02 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6e56dde-3e1a-400a-b27a-d88e8de9de74]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:24:02 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-2d344598-b72f-4bd5-8d5c-6ad3d7159feb tempest-VolumeDependencyTests-724561728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-16a919b3-4c6f-439b-b8cd-35118a9a3a83 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:02 devstack sudo[105080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-16a919b3-4c6f-439b-b8cd-35118a9a3a83 Nov 02 10:24:02 devstack sudo[105080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:02 devstack sudo[105078]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:02 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6a2e155c-5670-40ab-b286-10e4511cc5a5 tempest-VolumeDependencyTests-724561728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.509s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:02 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-6a2e155c-5670-40ab-b286-10e4511cc5a5 tempest-VolumeDependencyTests-724561728 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:24:02 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-6a2e155c-5670-40ab-b286-10e4511cc5a5 tempest-VolumeDependencyTests-724561728 None] Deleted volume successfully. Nov 02 10:24:02 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-6a2e155c-5670-40ab-b286-10e4511cc5a5 tempest-VolumeDependencyTests-724561728 None] Lock "cinder-b65175c9-bbdc-4eb8-b06d-15953654223e-delete_volume" released by "delete_volume" :: held 1.745s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:24:03 devstack sudo[105080]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:03 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-2d344598-b72f-4bd5-8d5c-6ad3d7159feb tempest-VolumeDependencyTests-724561728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-16a919b3-4c6f-439b-b8cd-35118a9a3a83" returned: 0 in 0.458s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:03 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-2d344598-b72f-4bd5-8d5c-6ad3d7159feb tempest-VolumeDependencyTests-724561728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-16a919b3-4c6f-439b-b8cd-35118a9a3a83 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:03 devstack sudo[105087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-16a919b3-4c6f-439b-b8cd-35118a9a3a83 Nov 02 10:24:03 devstack sudo[105087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:03 devstack sudo[105087]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:03 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-2d344598-b72f-4bd5-8d5c-6ad3d7159feb tempest-VolumeDependencyTests-724561728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-16a919b3-4c6f-439b-b8cd-35118a9a3a83" returned: 0 in 0.434s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:03 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-2d344598-b72f-4bd5-8d5c-6ad3d7159feb tempest-VolumeDependencyTests-724561728 None] Lock "cinder-quobyte-16a919b3-4c6f-439b-b8cd-35118a9a3a83" released by "delete_volume" :: held 0.983s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:24:03 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-2d344598-b72f-4bd5-8d5c-6ad3d7159feb tempest-VolumeDependencyTests-724561728 None] Created reservations ['97e6d70c-a339-4dbd-88be-ed6fc2874407', '765e9765-d1d1-45ce-b9ca-617957370305', 'c48507e5-d15d-400c-b8b7-39282cc7178e', 'c72fd446-02ec-4395-81b5-4c3215bb310c'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:24:03 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-39a088de-f4a3-4854-92af-1e8cccc89da3 tempest-CreateVolumesFromSnapshotTest-1668273897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:24:03 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-39a088de-f4a3-4854-92af-1e8cccc89da3 tempest-CreateVolumesFromSnapshotTest-1668273897 None] Flow 'volume_create_manager' (ba164125-0348-480a-bf6b-795a8fe10483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:24:03 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-39a088de-f4a3-4854-92af-1e8cccc89da3 tempest-CreateVolumesFromSnapshotTest-1668273897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5643a7c2-f0e5-4e39-85c4-5d8fa797c4bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:24:03 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-39a088de-f4a3-4854-92af-1e8cccc89da3 tempest-CreateVolumesFromSnapshotTest-1668273897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5643a7c2-f0e5-4e39-85c4-5d8fa797c4bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:24:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2019390064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=863f940c-4c00-4d7e-bb9b-4fe2be930be3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6f1f3d5cf4949fda7d4184bc66179a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:24:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:24:04Z,use_quota=True,user_id='fa4440951e5e4cf59a22b022c1db9263',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:24:03 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-39a088de-f4a3-4854-92af-1e8cccc89da3 tempest-CreateVolumesFromSnapshotTest-1668273897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a914b2df-780e-4245-8a4c-6d8dd247d408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:24:03 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-39a088de-f4a3-4854-92af-1e8cccc89da3 tempest-CreateVolumesFromSnapshotTest-1668273897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a914b2df-780e-4245-8a4c-6d8dd247d408) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:24:03 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-39a088de-f4a3-4854-92af-1e8cccc89da3 tempest-CreateVolumesFromSnapshotTest-1668273897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50a220ac-cae1-4dc5-bbc6-4da8319b097c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:24:03 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-39a088de-f4a3-4854-92af-1e8cccc89da3 tempest-CreateVolumesFromSnapshotTest-1668273897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50a220ac-cae1-4dc5-bbc6-4da8319b097c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '863f940c-4c00-4d7e-bb9b-4fe2be930be3', 'volume_name': 'volume-863f940c-4c00-4d7e-bb9b-4fe2be930be3', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:24:03 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-39a088de-f4a3-4854-92af-1e8cccc89da3 tempest-CreateVolumesFromSnapshotTest-1668273897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0d7d0ce-aae1-428d-b784-21e395764bcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:24:03 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-39a088de-f4a3-4854-92af-1e8cccc89da3 tempest-CreateVolumesFromSnapshotTest-1668273897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0d7d0ce-aae1-428d-b784-21e395764bcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:24:03 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-39a088de-f4a3-4854-92af-1e8cccc89da3 tempest-CreateVolumesFromSnapshotTest-1668273897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce59479b-c6ea-4311-bfec-464de6d616db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:24:03 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-39a088de-f4a3-4854-92af-1e8cccc89da3 tempest-CreateVolumesFromSnapshotTest-1668273897 None] Volume 863f940c-4c00-4d7e-bb9b-4fe2be930be3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-863f940c-4c00-4d7e-bb9b-4fe2be930be3', 'volume_size': 1} Nov 02 10:24:03 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-39a088de-f4a3-4854-92af-1e8cccc89da3 tempest-CreateVolumesFromSnapshotTest-1668273897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:24:03 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-39a088de-f4a3-4854-92af-1e8cccc89da3 tempest-CreateVolumesFromSnapshotTest-1668273897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:24:03 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-39a088de-f4a3-4854-92af-1e8cccc89da3 tempest-CreateVolumesFromSnapshotTest-1668273897 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:24:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2019390064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=863f940c-4c00-4d7e-bb9b-4fe2be930be3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6f1f3d5cf4949fda7d4184bc66179a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:24:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:24:04Z,use_quota=True,user_id='fa4440951e5e4cf59a22b022c1db9263',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:24:03 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-39a088de-f4a3-4854-92af-1e8cccc89da3 tempest-CreateVolumesFromSnapshotTest-1668273897 None] Creating volume 863f940c-4c00-4d7e-bb9b-4fe2be930be3 {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:24:03 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-39a088de-f4a3-4854-92af-1e8cccc89da3 tempest-CreateVolumesFromSnapshotTest-1668273897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:24:03 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-39a088de-f4a3-4854-92af-1e8cccc89da3 tempest-CreateVolumesFromSnapshotTest-1668273897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:24:03 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-39a088de-f4a3-4854-92af-1e8cccc89da3 tempest-CreateVolumesFromSnapshotTest-1668273897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:24:03 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-39a088de-f4a3-4854-92af-1e8cccc89da3 tempest-CreateVolumesFromSnapshotTest-1668273897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:24:03 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-39a088de-f4a3-4854-92af-1e8cccc89da3 tempest-CreateVolumesFromSnapshotTest-1668273897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:24:03 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-39a088de-f4a3-4854-92af-1e8cccc89da3 tempest-CreateVolumesFromSnapshotTest-1668273897 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:24:03 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-39a088de-f4a3-4854-92af-1e8cccc89da3 tempest-CreateVolumesFromSnapshotTest-1668273897 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:24:03 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-39a088de-f4a3-4854-92af-1e8cccc89da3 tempest-CreateVolumesFromSnapshotTest-1668273897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-863f940c-4c00-4d7e-bb9b-4fe2be930be3 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:03 devstack sudo[105090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-863f940c-4c00-4d7e-bb9b-4fe2be930be3 1073741824 Nov 02 10:24:03 devstack sudo[105090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:03 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-2d344598-b72f-4bd5-8d5c-6ad3d7159feb tempest-VolumeDependencyTests-724561728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:24:03 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-2d344598-b72f-4bd5-8d5c-6ad3d7159feb tempest-VolumeDependencyTests-724561728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:24:03 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-2d344598-b72f-4bd5-8d5c-6ad3d7159feb tempest-VolumeDependencyTests-724561728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:24:03 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-2d344598-b72f-4bd5-8d5c-6ad3d7159feb tempest-VolumeDependencyTests-724561728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:24:03 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-2d344598-b72f-4bd5-8d5c-6ad3d7159feb tempest-VolumeDependencyTests-724561728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:24:03 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-2d344598-b72f-4bd5-8d5c-6ad3d7159feb tempest-VolumeDependencyTests-724561728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:03 devstack sudo[105092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:24:03 devstack sudo[105092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:04 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecec0dc9-a65e-42e8-a351-f2e47d437e5f tempest-CreateVolumesFromSnapshotTest-1668273897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:24:04 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-ecec0dc9-a65e-42e8-a351-f2e47d437e5f tempest-CreateVolumesFromSnapshotTest-1668273897 None] Flow 'volume_create_manager' (1df833a6-3ffd-433c-a337-b13e60d6fe82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:24:04 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-ecec0dc9-a65e-42e8-a351-f2e47d437e5f tempest-CreateVolumesFromSnapshotTest-1668273897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0cbdc8c-bb22-4ad1-9259-d930fa4fb9a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:24:04 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-ecec0dc9-a65e-42e8-a351-f2e47d437e5f tempest-CreateVolumesFromSnapshotTest-1668273897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0cbdc8c-bb22-4ad1-9259-d930fa4fb9a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:24:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2127767045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6aebf7e8-5ce0-46c3-9b51-09d1f68585cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6f1f3d5cf4949fda7d4184bc66179a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:24:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:24:04Z,use_quota=True,user_id='fa4440951e5e4cf59a22b022c1db9263',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:24:04 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-ecec0dc9-a65e-42e8-a351-f2e47d437e5f tempest-CreateVolumesFromSnapshotTest-1668273897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dbdcca5-23f2-4caf-86a6-2206e7ea84bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:24:04 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-ecec0dc9-a65e-42e8-a351-f2e47d437e5f tempest-CreateVolumesFromSnapshotTest-1668273897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dbdcca5-23f2-4caf-86a6-2206e7ea84bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:24:04 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-ecec0dc9-a65e-42e8-a351-f2e47d437e5f tempest-CreateVolumesFromSnapshotTest-1668273897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc8f3a09-f7d0-49d8-9d11-00f6b786990d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:24:04 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-ecec0dc9-a65e-42e8-a351-f2e47d437e5f tempest-CreateVolumesFromSnapshotTest-1668273897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc8f3a09-f7d0-49d8-9d11-00f6b786990d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6aebf7e8-5ce0-46c3-9b51-09d1f68585cb', 'volume_name': 'volume-6aebf7e8-5ce0-46c3-9b51-09d1f68585cb', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:24:04 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-ecec0dc9-a65e-42e8-a351-f2e47d437e5f tempest-CreateVolumesFromSnapshotTest-1668273897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d807969-e208-43ba-970e-c472802f8d89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:24:04 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-ecec0dc9-a65e-42e8-a351-f2e47d437e5f tempest-CreateVolumesFromSnapshotTest-1668273897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d807969-e208-43ba-970e-c472802f8d89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:24:04 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-ecec0dc9-a65e-42e8-a351-f2e47d437e5f tempest-CreateVolumesFromSnapshotTest-1668273897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebf52ac4-cc9e-4dce-9e25-5601728cea18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:24:04 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-ecec0dc9-a65e-42e8-a351-f2e47d437e5f tempest-CreateVolumesFromSnapshotTest-1668273897 None] Volume 6aebf7e8-5ce0-46c3-9b51-09d1f68585cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6aebf7e8-5ce0-46c3-9b51-09d1f68585cb', 'volume_size': 1} Nov 02 10:24:04 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-ecec0dc9-a65e-42e8-a351-f2e47d437e5f tempest-CreateVolumesFromSnapshotTest-1668273897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:24:04 devstack sudo[105092]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:04 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-2d344598-b72f-4bd5-8d5c-6ad3d7159feb tempest-VolumeDependencyTests-724561728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.417s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:04 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-2d344598-b72f-4bd5-8d5c-6ad3d7159feb tempest-VolumeDependencyTests-724561728 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:24:04 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-2d344598-b72f-4bd5-8d5c-6ad3d7159feb tempest-VolumeDependencyTests-724561728 None] Deleted volume successfully. Nov 02 10:24:04 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-2d344598-b72f-4bd5-8d5c-6ad3d7159feb tempest-VolumeDependencyTests-724561728 None] Lock "cinder-16a919b3-4c6f-439b-b8cd-35118a9a3a83-delete_volume" released by "delete_volume" :: held 1.919s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:24:04 devstack sudo[105090]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:04 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-39a088de-f4a3-4854-92af-1e8cccc89da3 tempest-CreateVolumesFromSnapshotTest-1668273897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-863f940c-4c00-4d7e-bb9b-4fe2be930be3 1073741824" returned: 0 in 0.746s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:04 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-39a088de-f4a3-4854-92af-1e8cccc89da3 tempest-CreateVolumesFromSnapshotTest-1668273897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-863f940c-4c00-4d7e-bb9b-4fe2be930be3 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:04 devstack sudo[105100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-863f940c-4c00-4d7e-bb9b-4fe2be930be3 Nov 02 10:24:04 devstack sudo[105100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:04 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-abe15e64-e4a7-4281-8548-f6e3518ddccb tempest-CreateVolumesFromSnapshotTest-1668273897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:24:04 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-abe15e64-e4a7-4281-8548-f6e3518ddccb tempest-CreateVolumesFromSnapshotTest-1668273897 None] Flow 'volume_create_manager' (02740753-01c7-41de-958e-c8c3f950e18d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:24:05 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-abe15e64-e4a7-4281-8548-f6e3518ddccb tempest-CreateVolumesFromSnapshotTest-1668273897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ae4e1f9-d109-44c2-952b-33dbc2d2b1ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:24:05 devstack sudo[105100]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:05 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-39a088de-f4a3-4854-92af-1e8cccc89da3 tempest-CreateVolumesFromSnapshotTest-1668273897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-863f940c-4c00-4d7e-bb9b-4fe2be930be3" returned: 0 in 0.441s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:05 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-39a088de-f4a3-4854-92af-1e8cccc89da3 tempest-CreateVolumesFromSnapshotTest-1668273897 None] <== create_volume: return (1256ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:24:05 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-39a088de-f4a3-4854-92af-1e8cccc89da3 tempest-CreateVolumesFromSnapshotTest-1668273897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.260s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:24:05 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-ecec0dc9-a65e-42e8-a351-f2e47d437e5f tempest-CreateVolumesFromSnapshotTest-1668273897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.754s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:24:05 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-ecec0dc9-a65e-42e8-a351-f2e47d437e5f tempest-CreateVolumesFromSnapshotTest-1668273897 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:24:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2127767045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6aebf7e8-5ce0-46c3-9b51-09d1f68585cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6f1f3d5cf4949fda7d4184bc66179a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:24:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:24:04Z,use_quota=True,user_id='fa4440951e5e4cf59a22b022c1db9263',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:24:05 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-ecec0dc9-a65e-42e8-a351-f2e47d437e5f tempest-CreateVolumesFromSnapshotTest-1668273897 None] Creating volume 6aebf7e8-5ce0-46c3-9b51-09d1f68585cb {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:24:05 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-ecec0dc9-a65e-42e8-a351-f2e47d437e5f tempest-CreateVolumesFromSnapshotTest-1668273897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:24:05 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-ecec0dc9-a65e-42e8-a351-f2e47d437e5f tempest-CreateVolumesFromSnapshotTest-1668273897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:24:05 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-ecec0dc9-a65e-42e8-a351-f2e47d437e5f tempest-CreateVolumesFromSnapshotTest-1668273897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:24:05 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-ecec0dc9-a65e-42e8-a351-f2e47d437e5f tempest-CreateVolumesFromSnapshotTest-1668273897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:24:05 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-ecec0dc9-a65e-42e8-a351-f2e47d437e5f tempest-CreateVolumesFromSnapshotTest-1668273897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:24:05 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-ecec0dc9-a65e-42e8-a351-f2e47d437e5f tempest-CreateVolumesFromSnapshotTest-1668273897 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:24:05 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-ecec0dc9-a65e-42e8-a351-f2e47d437e5f tempest-CreateVolumesFromSnapshotTest-1668273897 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:24:05 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ecec0dc9-a65e-42e8-a351-f2e47d437e5f tempest-CreateVolumesFromSnapshotTest-1668273897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-6aebf7e8-5ce0-46c3-9b51-09d1f68585cb 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:05 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-abe15e64-e4a7-4281-8548-f6e3518ddccb tempest-CreateVolumesFromSnapshotTest-1668273897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ae4e1f9-d109-44c2-952b-33dbc2d2b1ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:24:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-492772393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65e502d8-eb5d-4759-98bb-3610b9272798,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6f1f3d5cf4949fda7d4184bc66179a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:24:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:24:05Z,use_quota=True,user_id='fa4440951e5e4cf59a22b022c1db9263',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:24:05 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-abe15e64-e4a7-4281-8548-f6e3518ddccb tempest-CreateVolumesFromSnapshotTest-1668273897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc253417-554a-4f0c-844c-f606833c144d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:24:05 devstack sudo[105103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-6aebf7e8-5ce0-46c3-9b51-09d1f68585cb 1073741824 Nov 02 10:24:05 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-abe15e64-e4a7-4281-8548-f6e3518ddccb tempest-CreateVolumesFromSnapshotTest-1668273897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc253417-554a-4f0c-844c-f606833c144d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:24:05 devstack sudo[105103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:05 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-abe15e64-e4a7-4281-8548-f6e3518ddccb tempest-CreateVolumesFromSnapshotTest-1668273897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (407c5fd5-dcc9-468b-84df-9b9f364be2f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:24:05 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-abe15e64-e4a7-4281-8548-f6e3518ddccb tempest-CreateVolumesFromSnapshotTest-1668273897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (407c5fd5-dcc9-468b-84df-9b9f364be2f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65e502d8-eb5d-4759-98bb-3610b9272798', 'volume_name': 'volume-65e502d8-eb5d-4759-98bb-3610b9272798', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:24:05 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-abe15e64-e4a7-4281-8548-f6e3518ddccb tempest-CreateVolumesFromSnapshotTest-1668273897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44e14fae-9919-405f-987c-e50832bfc807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:24:05 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-abe15e64-e4a7-4281-8548-f6e3518ddccb tempest-CreateVolumesFromSnapshotTest-1668273897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44e14fae-9919-405f-987c-e50832bfc807) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:24:05 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-abe15e64-e4a7-4281-8548-f6e3518ddccb tempest-CreateVolumesFromSnapshotTest-1668273897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57c1f477-940d-4fe6-933f-ec99e1dc9eed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:24:05 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-abe15e64-e4a7-4281-8548-f6e3518ddccb tempest-CreateVolumesFromSnapshotTest-1668273897 None] Volume 65e502d8-eb5d-4759-98bb-3610b9272798: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65e502d8-eb5d-4759-98bb-3610b9272798', 'volume_size': 1} Nov 02 10:24:05 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-abe15e64-e4a7-4281-8548-f6e3518ddccb tempest-CreateVolumesFromSnapshotTest-1668273897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:24:05 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-39a088de-f4a3-4854-92af-1e8cccc89da3 tempest-CreateVolumesFromSnapshotTest-1668273897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce59479b-c6ea-4311-bfec-464de6d616db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-863f940c-4c00-4d7e-bb9b-4fe2be930be3', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:24:05 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-39a088de-f4a3-4854-92af-1e8cccc89da3 tempest-CreateVolumesFromSnapshotTest-1668273897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e901016b-e28d-4a78-90e6-28b146a97a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:24:05 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-39a088de-f4a3-4854-92af-1e8cccc89da3 tempest-CreateVolumesFromSnapshotTest-1668273897 None] Volume volume-863f940c-4c00-4d7e-bb9b-4fe2be930be3 (863f940c-4c00-4d7e-bb9b-4fe2be930be3): created successfully Nov 02 10:24:05 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-39a088de-f4a3-4854-92af-1e8cccc89da3 tempest-CreateVolumesFromSnapshotTest-1668273897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e901016b-e28d-4a78-90e6-28b146a97a27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:24:05 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-39a088de-f4a3-4854-92af-1e8cccc89da3 tempest-CreateVolumesFromSnapshotTest-1668273897 None] Flow 'volume_create_manager' (ba164125-0348-480a-bf6b-795a8fe10483) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:24:05 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-39a088de-f4a3-4854-92af-1e8cccc89da3 tempest-CreateVolumesFromSnapshotTest-1668273897 None] Created volume successfully. Nov 02 10:24:05 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-8faa6266-1009-4a2d-8a7e-ea59bbbec7fc tempest-CreateVolumesFromSnapshotTest-1668273897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:24:05 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-8faa6266-1009-4a2d-8a7e-ea59bbbec7fc tempest-CreateVolumesFromSnapshotTest-1668273897 None] Flow 'volume_create_manager' (94e9676f-41a7-43ac-b853-eb1f0e99116d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:24:05 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-8faa6266-1009-4a2d-8a7e-ea59bbbec7fc tempest-CreateVolumesFromSnapshotTest-1668273897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5aec3cf7-4892-4f1c-9ee1-1eb67eaa6125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:24:05 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-8faa6266-1009-4a2d-8a7e-ea59bbbec7fc tempest-CreateVolumesFromSnapshotTest-1668273897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5aec3cf7-4892-4f1c-9ee1-1eb67eaa6125) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:24:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-182587209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=688ff28d-8e86-4acd-810e-e8da25fd3eca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6f1f3d5cf4949fda7d4184bc66179a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:24:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:24:05Z,use_quota=True,user_id='fa4440951e5e4cf59a22b022c1db9263',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:24:05 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-8faa6266-1009-4a2d-8a7e-ea59bbbec7fc tempest-CreateVolumesFromSnapshotTest-1668273897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76b159d8-327a-4824-840c-dd656057e98f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:24:05 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-8faa6266-1009-4a2d-8a7e-ea59bbbec7fc tempest-CreateVolumesFromSnapshotTest-1668273897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76b159d8-327a-4824-840c-dd656057e98f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:24:05 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-8faa6266-1009-4a2d-8a7e-ea59bbbec7fc tempest-CreateVolumesFromSnapshotTest-1668273897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7def3053-4dd6-40b2-b049-54b7387fb592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:24:05 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-8faa6266-1009-4a2d-8a7e-ea59bbbec7fc tempest-CreateVolumesFromSnapshotTest-1668273897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7def3053-4dd6-40b2-b049-54b7387fb592) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '688ff28d-8e86-4acd-810e-e8da25fd3eca', 'volume_name': 'volume-688ff28d-8e86-4acd-810e-e8da25fd3eca', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:24:05 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-8faa6266-1009-4a2d-8a7e-ea59bbbec7fc tempest-CreateVolumesFromSnapshotTest-1668273897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e104bb66-a124-4672-9095-62f0370edc59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:24:05 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-8faa6266-1009-4a2d-8a7e-ea59bbbec7fc tempest-CreateVolumesFromSnapshotTest-1668273897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e104bb66-a124-4672-9095-62f0370edc59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:24:05 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-8faa6266-1009-4a2d-8a7e-ea59bbbec7fc tempest-CreateVolumesFromSnapshotTest-1668273897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f08379cc-fa42-4b53-8f94-69eb446fb6a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:24:05 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-8faa6266-1009-4a2d-8a7e-ea59bbbec7fc tempest-CreateVolumesFromSnapshotTest-1668273897 None] Volume 688ff28d-8e86-4acd-810e-e8da25fd3eca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-688ff28d-8e86-4acd-810e-e8da25fd3eca', 'volume_size': 1} Nov 02 10:24:05 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-8faa6266-1009-4a2d-8a7e-ea59bbbec7fc tempest-CreateVolumesFromSnapshotTest-1668273897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:24:05 devstack sudo[105103]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:05 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ecec0dc9-a65e-42e8-a351-f2e47d437e5f tempest-CreateVolumesFromSnapshotTest-1668273897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-6aebf7e8-5ce0-46c3-9b51-09d1f68585cb 1073741824" returned: 0 in 0.890s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:05 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a4f7c75-8518-40af-9384-34116c6f20bf tempest-CreateVolumesFromSnapshotTest-1668273897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:24:05 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-2a4f7c75-8518-40af-9384-34116c6f20bf tempest-CreateVolumesFromSnapshotTest-1668273897 None] Flow 'volume_create_manager' (b6363b54-50de-41d4-8a53-0cb59a8e6553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:24:05 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-2a4f7c75-8518-40af-9384-34116c6f20bf tempest-CreateVolumesFromSnapshotTest-1668273897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e1f4f6b-6160-4201-b531-c0a131f25837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:24:06 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-2a4f7c75-8518-40af-9384-34116c6f20bf tempest-CreateVolumesFromSnapshotTest-1668273897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e1f4f6b-6160-4201-b531-c0a131f25837) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:24:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1768609004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89b58340-612c-41fc-8a56-e147e4f650ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6f1f3d5cf4949fda7d4184bc66179a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:24:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:24:06Z,use_quota=True,user_id='fa4440951e5e4cf59a22b022c1db9263',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:24:06 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-2a4f7c75-8518-40af-9384-34116c6f20bf tempest-CreateVolumesFromSnapshotTest-1668273897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c15da433-0399-4f9e-99b2-3ecee810ec5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:24:06 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-2a4f7c75-8518-40af-9384-34116c6f20bf tempest-CreateVolumesFromSnapshotTest-1668273897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c15da433-0399-4f9e-99b2-3ecee810ec5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:24:06 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-2a4f7c75-8518-40af-9384-34116c6f20bf tempest-CreateVolumesFromSnapshotTest-1668273897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77d26a4b-edb2-4dc3-bca0-61917e3a9f6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:24:06 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-2a4f7c75-8518-40af-9384-34116c6f20bf tempest-CreateVolumesFromSnapshotTest-1668273897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77d26a4b-edb2-4dc3-bca0-61917e3a9f6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89b58340-612c-41fc-8a56-e147e4f650ba', 'volume_name': 'volume-89b58340-612c-41fc-8a56-e147e4f650ba', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:24:06 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-2a4f7c75-8518-40af-9384-34116c6f20bf tempest-CreateVolumesFromSnapshotTest-1668273897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c062e5e6-1ba5-42d3-9830-73b538940636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:24:06 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-2a4f7c75-8518-40af-9384-34116c6f20bf tempest-CreateVolumesFromSnapshotTest-1668273897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c062e5e6-1ba5-42d3-9830-73b538940636) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:24:06 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-2a4f7c75-8518-40af-9384-34116c6f20bf tempest-CreateVolumesFromSnapshotTest-1668273897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c93e096c-62a9-4b82-b505-f690892f1cd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:24:06 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-2a4f7c75-8518-40af-9384-34116c6f20bf tempest-CreateVolumesFromSnapshotTest-1668273897 None] Volume 89b58340-612c-41fc-8a56-e147e4f650ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89b58340-612c-41fc-8a56-e147e4f650ba', 'volume_size': 1} Nov 02 10:24:06 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-2a4f7c75-8518-40af-9384-34116c6f20bf tempest-CreateVolumesFromSnapshotTest-1668273897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:24:06 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ecec0dc9-a65e-42e8-a351-f2e47d437e5f tempest-CreateVolumesFromSnapshotTest-1668273897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-6aebf7e8-5ce0-46c3-9b51-09d1f68585cb {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:06 devstack sudo[105109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-6aebf7e8-5ce0-46c3-9b51-09d1f68585cb Nov 02 10:24:06 devstack sudo[105109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:06 devstack sudo[105109]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:06 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ecec0dc9-a65e-42e8-a351-f2e47d437e5f tempest-CreateVolumesFromSnapshotTest-1668273897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-6aebf7e8-5ce0-46c3-9b51-09d1f68585cb" returned: 0 in 0.360s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:06 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-ecec0dc9-a65e-42e8-a351-f2e47d437e5f tempest-CreateVolumesFromSnapshotTest-1668273897 None] <== create_volume: return (1415ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:24:06 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-ecec0dc9-a65e-42e8-a351-f2e47d437e5f tempest-CreateVolumesFromSnapshotTest-1668273897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.421s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:24:06 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-abe15e64-e4a7-4281-8548-f6e3518ddccb tempest-CreateVolumesFromSnapshotTest-1668273897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.291s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:24:06 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-abe15e64-e4a7-4281-8548-f6e3518ddccb tempest-CreateVolumesFromSnapshotTest-1668273897 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:24:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-492772393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65e502d8-eb5d-4759-98bb-3610b9272798,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6f1f3d5cf4949fda7d4184bc66179a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:24:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:24:05Z,use_quota=True,user_id='fa4440951e5e4cf59a22b022c1db9263',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:24:06 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-abe15e64-e4a7-4281-8548-f6e3518ddccb tempest-CreateVolumesFromSnapshotTest-1668273897 None] Creating volume 65e502d8-eb5d-4759-98bb-3610b9272798 {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:24:06 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-abe15e64-e4a7-4281-8548-f6e3518ddccb tempest-CreateVolumesFromSnapshotTest-1668273897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:24:06 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-abe15e64-e4a7-4281-8548-f6e3518ddccb tempest-CreateVolumesFromSnapshotTest-1668273897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:24:06 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-abe15e64-e4a7-4281-8548-f6e3518ddccb tempest-CreateVolumesFromSnapshotTest-1668273897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:24:06 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-abe15e64-e4a7-4281-8548-f6e3518ddccb tempest-CreateVolumesFromSnapshotTest-1668273897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:24:06 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-abe15e64-e4a7-4281-8548-f6e3518ddccb tempest-CreateVolumesFromSnapshotTest-1668273897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:24:06 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-abe15e64-e4a7-4281-8548-f6e3518ddccb tempest-CreateVolumesFromSnapshotTest-1668273897 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:24:06 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-abe15e64-e4a7-4281-8548-f6e3518ddccb tempest-CreateVolumesFromSnapshotTest-1668273897 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:24:06 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-abe15e64-e4a7-4281-8548-f6e3518ddccb tempest-CreateVolumesFromSnapshotTest-1668273897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-65e502d8-eb5d-4759-98bb-3610b9272798 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:06 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-ecec0dc9-a65e-42e8-a351-f2e47d437e5f tempest-CreateVolumesFromSnapshotTest-1668273897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebf52ac4-cc9e-4dce-9e25-5601728cea18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6aebf7e8-5ce0-46c3-9b51-09d1f68585cb', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:24:06 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-ecec0dc9-a65e-42e8-a351-f2e47d437e5f tempest-CreateVolumesFromSnapshotTest-1668273897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e72f5d2f-b14f-4a8f-96c0-788caa6a2808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:24:06 devstack sudo[105112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-65e502d8-eb5d-4759-98bb-3610b9272798 1073741824 Nov 02 10:24:06 devstack sudo[105112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:06 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-ecec0dc9-a65e-42e8-a351-f2e47d437e5f tempest-CreateVolumesFromSnapshotTest-1668273897 None] Volume volume-6aebf7e8-5ce0-46c3-9b51-09d1f68585cb (6aebf7e8-5ce0-46c3-9b51-09d1f68585cb): created successfully Nov 02 10:24:06 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-ecec0dc9-a65e-42e8-a351-f2e47d437e5f tempest-CreateVolumesFromSnapshotTest-1668273897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e72f5d2f-b14f-4a8f-96c0-788caa6a2808) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:24:06 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-ecec0dc9-a65e-42e8-a351-f2e47d437e5f tempest-CreateVolumesFromSnapshotTest-1668273897 None] Flow 'volume_create_manager' (1df833a6-3ffd-433c-a337-b13e60d6fe82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:24:06 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-ecec0dc9-a65e-42e8-a351-f2e47d437e5f tempest-CreateVolumesFromSnapshotTest-1668273897 None] Created volume successfully. Nov 02 10:24:07 devstack sudo[105112]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:07 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-abe15e64-e4a7-4281-8548-f6e3518ddccb tempest-CreateVolumesFromSnapshotTest-1668273897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-65e502d8-eb5d-4759-98bb-3610b9272798 1073741824" returned: 0 in 0.647s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:07 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-abe15e64-e4a7-4281-8548-f6e3518ddccb tempest-CreateVolumesFromSnapshotTest-1668273897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-65e502d8-eb5d-4759-98bb-3610b9272798 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:07 devstack sudo[105118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-65e502d8-eb5d-4759-98bb-3610b9272798 Nov 02 10:24:07 devstack sudo[105118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:07 devstack sudo[105118]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:07 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-abe15e64-e4a7-4281-8548-f6e3518ddccb tempest-CreateVolumesFromSnapshotTest-1668273897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-65e502d8-eb5d-4759-98bb-3610b9272798" returned: 0 in 0.304s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:07 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-abe15e64-e4a7-4281-8548-f6e3518ddccb tempest-CreateVolumesFromSnapshotTest-1668273897 None] <== create_volume: return (1004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:24:07 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-abe15e64-e4a7-4281-8548-f6e3518ddccb tempest-CreateVolumesFromSnapshotTest-1668273897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.008s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:24:07 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-8faa6266-1009-4a2d-8a7e-ea59bbbec7fc tempest-CreateVolumesFromSnapshotTest-1668273897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.854s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:24:07 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-8faa6266-1009-4a2d-8a7e-ea59bbbec7fc tempest-CreateVolumesFromSnapshotTest-1668273897 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:24:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-182587209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=688ff28d-8e86-4acd-810e-e8da25fd3eca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6f1f3d5cf4949fda7d4184bc66179a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:24:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:24:05Z,use_quota=True,user_id='fa4440951e5e4cf59a22b022c1db9263',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:24:07 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-8faa6266-1009-4a2d-8a7e-ea59bbbec7fc tempest-CreateVolumesFromSnapshotTest-1668273897 None] Creating volume 688ff28d-8e86-4acd-810e-e8da25fd3eca {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:24:07 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-8faa6266-1009-4a2d-8a7e-ea59bbbec7fc tempest-CreateVolumesFromSnapshotTest-1668273897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:24:07 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-8faa6266-1009-4a2d-8a7e-ea59bbbec7fc tempest-CreateVolumesFromSnapshotTest-1668273897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:24:07 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-8faa6266-1009-4a2d-8a7e-ea59bbbec7fc tempest-CreateVolumesFromSnapshotTest-1668273897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:24:07 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-8faa6266-1009-4a2d-8a7e-ea59bbbec7fc tempest-CreateVolumesFromSnapshotTest-1668273897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:24:07 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-8faa6266-1009-4a2d-8a7e-ea59bbbec7fc tempest-CreateVolumesFromSnapshotTest-1668273897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:24:07 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-8faa6266-1009-4a2d-8a7e-ea59bbbec7fc tempest-CreateVolumesFromSnapshotTest-1668273897 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:24:07 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-8faa6266-1009-4a2d-8a7e-ea59bbbec7fc tempest-CreateVolumesFromSnapshotTest-1668273897 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:24:07 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8faa6266-1009-4a2d-8a7e-ea59bbbec7fc tempest-CreateVolumesFromSnapshotTest-1668273897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-688ff28d-8e86-4acd-810e-e8da25fd3eca 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:07 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-abe15e64-e4a7-4281-8548-f6e3518ddccb tempest-CreateVolumesFromSnapshotTest-1668273897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57c1f477-940d-4fe6-933f-ec99e1dc9eed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65e502d8-eb5d-4759-98bb-3610b9272798', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:24:07 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-abe15e64-e4a7-4281-8548-f6e3518ddccb tempest-CreateVolumesFromSnapshotTest-1668273897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1c82d5a-ff1e-4ec3-bce4-c7166dc58539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:24:07 devstack sudo[105121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-688ff28d-8e86-4acd-810e-e8da25fd3eca 1073741824 Nov 02 10:24:07 devstack sudo[105121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:07 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-abe15e64-e4a7-4281-8548-f6e3518ddccb tempest-CreateVolumesFromSnapshotTest-1668273897 None] Volume volume-65e502d8-eb5d-4759-98bb-3610b9272798 (65e502d8-eb5d-4759-98bb-3610b9272798): created successfully Nov 02 10:24:07 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-abe15e64-e4a7-4281-8548-f6e3518ddccb tempest-CreateVolumesFromSnapshotTest-1668273897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1c82d5a-ff1e-4ec3-bce4-c7166dc58539) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:24:07 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-abe15e64-e4a7-4281-8548-f6e3518ddccb tempest-CreateVolumesFromSnapshotTest-1668273897 None] Flow 'volume_create_manager' (02740753-01c7-41de-958e-c8c3f950e18d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:24:07 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-abe15e64-e4a7-4281-8548-f6e3518ddccb tempest-CreateVolumesFromSnapshotTest-1668273897 None] Created volume successfully. Nov 02 10:24:08 devstack sudo[105121]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:08 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8faa6266-1009-4a2d-8a7e-ea59bbbec7fc tempest-CreateVolumesFromSnapshotTest-1668273897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-688ff28d-8e86-4acd-810e-e8da25fd3eca 1073741824" returned: 0 in 0.662s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:08 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8faa6266-1009-4a2d-8a7e-ea59bbbec7fc tempest-CreateVolumesFromSnapshotTest-1668273897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-688ff28d-8e86-4acd-810e-e8da25fd3eca {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:08 devstack sudo[105127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-688ff28d-8e86-4acd-810e-e8da25fd3eca Nov 02 10:24:08 devstack sudo[105127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:08 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed24c3d7-6f27-4781-933a-96521dab244c tempest-VolumeImageDependencyTests-2074229970 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:24:08 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-ed24c3d7-6f27-4781-933a-96521dab244c tempest-VolumeImageDependencyTests-2074229970 None] Flow 'volume_create_manager' (2311de9f-cf5e-4842-bf7b-d4c3e14c44ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:24:08 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-ed24c3d7-6f27-4781-933a-96521dab244c tempest-VolumeImageDependencyTests-2074229970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12399ba4-793d-431d-a650-16cb44dcf4cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:24:08 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-ed24c3d7-6f27-4781-933a-96521dab244c tempest-VolumeImageDependencyTests-2074229970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12399ba4-793d-431d-a650-16cb44dcf4cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:24:08Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dce53dfd-5741-4b19-9fd6-2f5871ef8c2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='337878924f594d00b18cde732953f10a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:24:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:24:08Z,use_quota=True,user_id='8dc27851b1af454681f3449bd34a445b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:24:08 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-ed24c3d7-6f27-4781-933a-96521dab244c tempest-VolumeImageDependencyTests-2074229970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d82a835c-7ed3-4ad8-8265-c69b7ddc2f43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:24:08 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-ed24c3d7-6f27-4781-933a-96521dab244c tempest-VolumeImageDependencyTests-2074229970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d82a835c-7ed3-4ad8-8265-c69b7ddc2f43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:24:08 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-ed24c3d7-6f27-4781-933a-96521dab244c tempest-VolumeImageDependencyTests-2074229970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (348d58d6-12f9-49c0-a6d7-1901e37c2f76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:24:08 devstack cinder-volume[86890]: DEBUG cinder.image.glance [None req-ed24c3d7-6f27-4781-933a-96521dab244c tempest-VolumeImageDependencyTests-2074229970 None] Creating Keystone auth plugin from conf {{(pid=86890) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 10:24:08 devstack sudo[105127]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:08 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8faa6266-1009-4a2d-8a7e-ea59bbbec7fc tempest-CreateVolumesFromSnapshotTest-1668273897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-688ff28d-8e86-4acd-810e-e8da25fd3eca" returned: 0 in 0.377s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:08 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-8faa6266-1009-4a2d-8a7e-ea59bbbec7fc tempest-CreateVolumesFromSnapshotTest-1668273897 None] <== create_volume: return (1124ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:24:08 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-8faa6266-1009-4a2d-8a7e-ea59bbbec7fc tempest-CreateVolumesFromSnapshotTest-1668273897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.128s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:24:08 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-2a4f7c75-8518-40af-9384-34116c6f20bf tempest-CreateVolumesFromSnapshotTest-1668273897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.522s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:24:08 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-2a4f7c75-8518-40af-9384-34116c6f20bf tempest-CreateVolumesFromSnapshotTest-1668273897 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:24:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1768609004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89b58340-612c-41fc-8a56-e147e4f650ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6f1f3d5cf4949fda7d4184bc66179a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:24:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:24:06Z,use_quota=True,user_id='fa4440951e5e4cf59a22b022c1db9263',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:24:08 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-2a4f7c75-8518-40af-9384-34116c6f20bf tempest-CreateVolumesFromSnapshotTest-1668273897 None] Creating volume 89b58340-612c-41fc-8a56-e147e4f650ba {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:24:08 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-2a4f7c75-8518-40af-9384-34116c6f20bf tempest-CreateVolumesFromSnapshotTest-1668273897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:24:08 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-2a4f7c75-8518-40af-9384-34116c6f20bf tempest-CreateVolumesFromSnapshotTest-1668273897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:24:08 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-2a4f7c75-8518-40af-9384-34116c6f20bf tempest-CreateVolumesFromSnapshotTest-1668273897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:24:08 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-2a4f7c75-8518-40af-9384-34116c6f20bf tempest-CreateVolumesFromSnapshotTest-1668273897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:24:08 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-2a4f7c75-8518-40af-9384-34116c6f20bf tempest-CreateVolumesFromSnapshotTest-1668273897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:24:08 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-2a4f7c75-8518-40af-9384-34116c6f20bf tempest-CreateVolumesFromSnapshotTest-1668273897 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:24:08 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-2a4f7c75-8518-40af-9384-34116c6f20bf tempest-CreateVolumesFromSnapshotTest-1668273897 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:24:08 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-2a4f7c75-8518-40af-9384-34116c6f20bf tempest-CreateVolumesFromSnapshotTest-1668273897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-89b58340-612c-41fc-8a56-e147e4f650ba 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:08 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-8faa6266-1009-4a2d-8a7e-ea59bbbec7fc tempest-CreateVolumesFromSnapshotTest-1668273897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f08379cc-fa42-4b53-8f94-69eb446fb6a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-688ff28d-8e86-4acd-810e-e8da25fd3eca', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:24:08 devstack sudo[105130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-89b58340-612c-41fc-8a56-e147e4f650ba 1073741824 Nov 02 10:24:08 devstack sudo[105130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:08 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-8faa6266-1009-4a2d-8a7e-ea59bbbec7fc tempest-CreateVolumesFromSnapshotTest-1668273897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d948e384-a137-4059-be92-61a2add23d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:24:08 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-8faa6266-1009-4a2d-8a7e-ea59bbbec7fc tempest-CreateVolumesFromSnapshotTest-1668273897 None] Volume volume-688ff28d-8e86-4acd-810e-e8da25fd3eca (688ff28d-8e86-4acd-810e-e8da25fd3eca): created successfully Nov 02 10:24:08 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-8faa6266-1009-4a2d-8a7e-ea59bbbec7fc tempest-CreateVolumesFromSnapshotTest-1668273897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d948e384-a137-4059-be92-61a2add23d97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:24:08 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-8faa6266-1009-4a2d-8a7e-ea59bbbec7fc tempest-CreateVolumesFromSnapshotTest-1668273897 None] Flow 'volume_create_manager' (94e9676f-41a7-43ac-b853-eb1f0e99116d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:24:08 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-8faa6266-1009-4a2d-8a7e-ea59bbbec7fc tempest-CreateVolumesFromSnapshotTest-1668273897 None] Created volume successfully. Nov 02 10:24:09 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-ed24c3d7-6f27-4781-933a-96521dab244c tempest-VolumeImageDependencyTests-2074229970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (348d58d6-12f9-49c0-a6d7-1901e37c2f76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'dce53dfd-5741-4b19-9fd6-2f5871ef8c2d', 'volume_name': 'volume-dce53dfd-5741-4b19-9fd6-2f5871ef8c2d', 'volume_size': 1, 'image_id': '45896368-2a22-4791-be8c-732ba370d3be', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/45896368-2a22-4791-be8c-732ba370d3be', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c44e9d0a6e4b3dfc96697de509e2e25d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '337878924f594d00b18cde732953f10a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0e7803c6580e15557a672cab6d59468dde7600414bf9b6ff030da1270ee5b5014c2e2932795f8a2a1787c7a0f7546bc7b6a22a390b5260018998b06a4c2e87a3', 'id': '45896368-2a22-4791-be8c-732ba370d3be', 'created_at': datetime.datetime(2026, 11, 2, 9, 24, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 24, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/45896368-2a22-4791-be8c-732ba370d3be/file', 'properties': {}}, 'image_service': }' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:24:09 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-ed24c3d7-6f27-4781-933a-96521dab244c tempest-VolumeImageDependencyTests-2074229970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f3f7ad4-ed37-4e83-af12-824d38ca465c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:24:09 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-ed24c3d7-6f27-4781-933a-96521dab244c tempest-VolumeImageDependencyTests-2074229970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f3f7ad4-ed37-4e83-af12-824d38ca465c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:24:09 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-ed24c3d7-6f27-4781-933a-96521dab244c tempest-VolumeImageDependencyTests-2074229970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d870fb5-9fa8-459a-95cd-05c32c7875e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:24:09 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-ed24c3d7-6f27-4781-933a-96521dab244c tempest-VolumeImageDependencyTests-2074229970 None] Volume dce53dfd-5741-4b19-9fd6-2f5871ef8c2d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-dce53dfd-5741-4b19-9fd6-2f5871ef8c2d', 'volume_size': 1, 'image_id': '45896368-2a22-4791-be8c-732ba370d3be', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/45896368-2a22-4791-be8c-732ba370d3be', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c44e9d0a6e4b3dfc96697de509e2e25d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '337878924f594d00b18cde732953f10a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0e7803c6580e15557a672cab6d59468dde7600414bf9b6ff030da1270ee5b5014c2e2932795f8a2a1787c7a0f7546bc7b6a22a390b5260018998b06a4c2e87a3', 'id': '45896368-2a22-4791-be8c-732ba370d3be', 'created_at': datetime.datetime(2026, 11, 2, 9, 24, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 24, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/45896368-2a22-4791-be8c-732ba370d3be/file', 'properties': {}}, 'image_service': } Nov 02 10:24:09 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed24c3d7-6f27-4781-933a-96521dab244c tempest-VolumeImageDependencyTests-2074229970 None] Trying to clone dce53dfd-5741-4b19-9fd6-2f5871ef8c2d from image 45896368-2a22-4791-be8c-732ba370d3be at location (None, [{'url': 'file:///opt/stack/data/glance/images/45896368-2a22-4791-be8c-732ba370d3be', 'metadata': {}}]). {{(pid=86890) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 02 10:24:09 devstack cinder-volume[86890]: DEBUG cinder.image.image_utils [None req-ed24c3d7-6f27-4781-933a-96521dab244c tempest-VolumeImageDependencyTests-2074229970 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_45896368-2a22-4791-be8c-732ba370d3be_q8b3y4kydevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86890) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 02 10:24:09 devstack sudo[105130]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:09 devstack cinder-volume[86890]: INFO cinder.image.image_utils [None req-ed24c3d7-6f27-4781-933a-96521dab244c tempest-VolumeImageDependencyTests-2074229970 None] Image download 0.00 MB at 0.00 MB/s Nov 02 10:24:09 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-2a4f7c75-8518-40af-9384-34116c6f20bf tempest-CreateVolumesFromSnapshotTest-1668273897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-89b58340-612c-41fc-8a56-e147e4f650ba 1073741824" returned: 0 in 0.572s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:09 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-2a4f7c75-8518-40af-9384-34116c6f20bf tempest-CreateVolumesFromSnapshotTest-1668273897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-89b58340-612c-41fc-8a56-e147e4f650ba {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:09 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[db698f08-20b4-4ea6-97f7-3fe37a263858]: (4, 'raw') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:24:09 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ed24c3d7-6f27-4781-933a-96521dab244c tempest-VolumeImageDependencyTests-2074229970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_45896368-2a22-4791-be8c-732ba370d3be_q8b3y4kydevstack@QuobyteHD {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:09 devstack sudo[105136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-89b58340-612c-41fc-8a56-e147e4f650ba Nov 02 10:24:09 devstack sudo[105136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:09 devstack sudo[105137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_45896368-2a22-4791-be8c-732ba370d3be_q8b3y4kydevstack@QuobyteHD Nov 02 10:24:09 devstack sudo[105137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:09 devstack sudo[105136]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:09 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-2a4f7c75-8518-40af-9384-34116c6f20bf tempest-CreateVolumesFromSnapshotTest-1668273897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-89b58340-612c-41fc-8a56-e147e4f650ba" returned: 0 in 0.414s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:09 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-2a4f7c75-8518-40af-9384-34116c6f20bf tempest-CreateVolumesFromSnapshotTest-1668273897 None] <== create_volume: return (1047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:24:09 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-2a4f7c75-8518-40af-9384-34116c6f20bf tempest-CreateVolumesFromSnapshotTest-1668273897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.053s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:24:09 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-2a4f7c75-8518-40af-9384-34116c6f20bf tempest-CreateVolumesFromSnapshotTest-1668273897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c93e096c-62a9-4b82-b505-f690892f1cd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89b58340-612c-41fc-8a56-e147e4f650ba', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:24:09 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-2a4f7c75-8518-40af-9384-34116c6f20bf tempest-CreateVolumesFromSnapshotTest-1668273897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0f2ba99-8f11-44de-949b-e7bd8bf8748e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:24:09 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-2a4f7c75-8518-40af-9384-34116c6f20bf tempest-CreateVolumesFromSnapshotTest-1668273897 None] Volume volume-89b58340-612c-41fc-8a56-e147e4f650ba (89b58340-612c-41fc-8a56-e147e4f650ba): created successfully Nov 02 10:24:09 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-2a4f7c75-8518-40af-9384-34116c6f20bf tempest-CreateVolumesFromSnapshotTest-1668273897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0f2ba99-8f11-44de-949b-e7bd8bf8748e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:24:09 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-2a4f7c75-8518-40af-9384-34116c6f20bf tempest-CreateVolumesFromSnapshotTest-1668273897 None] Flow 'volume_create_manager' (b6363b54-50de-41d4-8a53-0cb59a8e6553) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:24:09 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-2a4f7c75-8518-40af-9384-34116c6f20bf tempest-CreateVolumesFromSnapshotTest-1668273897 None] Created volume successfully. Nov 02 10:24:09 devstack sudo[105137]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:09 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ed24c3d7-6f27-4781-933a-96521dab244c tempest-VolumeImageDependencyTests-2074229970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_45896368-2a22-4791-be8c-732ba370d3be_q8b3y4kydevstack@QuobyteHD" returned: 0 in 0.475s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:09 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ed24c3d7-6f27-4781-933a-96521dab244c tempest-VolumeImageDependencyTests-2074229970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_45896368-2a22-4791-be8c-732ba370d3be_q8b3y4kydevstack@QuobyteHD {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:09 devstack sudo[105143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_45896368-2a22-4791-be8c-732ba370d3be_q8b3y4kydevstack@QuobyteHD Nov 02 10:24:09 devstack sudo[105143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:10 devstack sudo[105143]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:10 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ed24c3d7-6f27-4781-933a-96521dab244c tempest-VolumeImageDependencyTests-2074229970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_45896368-2a22-4791-be8c-732ba370d3be_q8b3y4kydevstack@QuobyteHD" returned: 1 in 0.357s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:10 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ed24c3d7-6f27-4781-933a-96521dab244c tempest-VolumeImageDependencyTests-2074229970 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_45896368-2a22-4791-be8c-732ba370d3be_q8b3y4kydevstack@QuobyteHD' failed. Not Retrying. {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 10:24:10 devstack cinder-volume[86890]: DEBUG cinder.image.image_utils [None req-ed24c3d7-6f27-4781-933a-96521dab244c tempest-VolumeImageDependencyTests-2074229970 None] Temporary image 45896368-2a22-4791-be8c-732ba370d3be is fetched for user 8dc27851b1af454681f3449bd34a445b. {{(pid=86890) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 02 10:24:10 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bc58f5e-33cb-4567-a93a-343e09ddc62e]: (4, 'raw') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:24:10 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ed24c3d7-6f27-4781-933a-96521dab244c tempest-VolumeImageDependencyTests-2074229970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_45896368-2a22-4791-be8c-732ba370d3be_q8b3y4kydevstack@QuobyteHD {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:10 devstack sudo[105148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_45896368-2a22-4791-be8c-732ba370d3be_q8b3y4kydevstack@QuobyteHD Nov 02 10:24:10 devstack sudo[105148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:10 devstack sudo[105148]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:10 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ed24c3d7-6f27-4781-933a-96521dab244c tempest-VolumeImageDependencyTests-2074229970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_45896368-2a22-4791-be8c-732ba370d3be_q8b3y4kydevstack@QuobyteHD" returned: 0 in 0.381s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:10 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ed24c3d7-6f27-4781-933a-96521dab244c tempest-VolumeImageDependencyTests-2074229970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_45896368-2a22-4791-be8c-732ba370d3be_q8b3y4kydevstack@QuobyteHD {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:10 devstack sudo[105152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_45896368-2a22-4791-be8c-732ba370d3be_q8b3y4kydevstack@QuobyteHD Nov 02 10:24:10 devstack sudo[105152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:10 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-0bcb417b-186e-4dd4-841f-c72ae8450d80 tempest-CreateVolumesFromSnapshotTest-1668273897 None] Acquiring lock "cinder-89b58340-612c-41fc-8a56-e147e4f650ba-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:24:10 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-0bcb417b-186e-4dd4-841f-c72ae8450d80 tempest-CreateVolumesFromSnapshotTest-1668273897 None] Lock "cinder-89b58340-612c-41fc-8a56-e147e4f650ba-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:24:10 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-0bcb417b-186e-4dd4-841f-c72ae8450d80 tempest-CreateVolumesFromSnapshotTest-1668273897 None] Acquiring lock "cinder-quobyte-89b58340-612c-41fc-8a56-e147e4f650ba" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:24:10 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-0bcb417b-186e-4dd4-841f-c72ae8450d80 tempest-CreateVolumesFromSnapshotTest-1668273897 None] Lock "cinder-quobyte-89b58340-612c-41fc-8a56-e147e4f650ba" acquired by "delete_volume" :: waited 0.026s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:24:10 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cb4e972-9ca9-4539-af83-71d653a1b644]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:24:10 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-0bcb417b-186e-4dd4-841f-c72ae8450d80 tempest-CreateVolumesFromSnapshotTest-1668273897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-89b58340-612c-41fc-8a56-e147e4f650ba {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:11 devstack sudo[105152]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:11 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ed24c3d7-6f27-4781-933a-96521dab244c tempest-VolumeImageDependencyTests-2074229970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_45896368-2a22-4791-be8c-732ba370d3be_q8b3y4kydevstack@QuobyteHD" returned: 1 in 0.502s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:11 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ed24c3d7-6f27-4781-933a-96521dab244c tempest-VolumeImageDependencyTests-2074229970 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_45896368-2a22-4791-be8c-732ba370d3be_q8b3y4kydevstack@QuobyteHD' failed. Not Retrying. {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 10:24:11 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-ed24c3d7-6f27-4781-933a-96521dab244c tempest-VolumeImageDependencyTests-2074229970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:24:11 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-ed24c3d7-6f27-4781-933a-96521dab244c tempest-VolumeImageDependencyTests-2074229970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:24:11 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-ed24c3d7-6f27-4781-933a-96521dab244c tempest-VolumeImageDependencyTests-2074229970 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:24:08Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dce53dfd-5741-4b19-9fd6-2f5871ef8c2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='337878924f594d00b18cde732953f10a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:24:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:24:08Z,use_quota=True,user_id='8dc27851b1af454681f3449bd34a445b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:24:11 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-ed24c3d7-6f27-4781-933a-96521dab244c tempest-VolumeImageDependencyTests-2074229970 None] Creating volume dce53dfd-5741-4b19-9fd6-2f5871ef8c2d {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:24:11 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-ed24c3d7-6f27-4781-933a-96521dab244c tempest-VolumeImageDependencyTests-2074229970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:24:11 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-ed24c3d7-6f27-4781-933a-96521dab244c tempest-VolumeImageDependencyTests-2074229970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:24:11 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-ed24c3d7-6f27-4781-933a-96521dab244c tempest-VolumeImageDependencyTests-2074229970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:24:11 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-ed24c3d7-6f27-4781-933a-96521dab244c tempest-VolumeImageDependencyTests-2074229970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:24:11 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-ed24c3d7-6f27-4781-933a-96521dab244c tempest-VolumeImageDependencyTests-2074229970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:24:11 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-ed24c3d7-6f27-4781-933a-96521dab244c tempest-VolumeImageDependencyTests-2074229970 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:24:11 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-ed24c3d7-6f27-4781-933a-96521dab244c tempest-VolumeImageDependencyTests-2074229970 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:24:11 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ed24c3d7-6f27-4781-933a-96521dab244c tempest-VolumeImageDependencyTests-2074229970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dce53dfd-5741-4b19-9fd6-2f5871ef8c2d 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:11 devstack sudo[105155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-89b58340-612c-41fc-8a56-e147e4f650ba Nov 02 10:24:11 devstack sudo[105155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:11 devstack sudo[105160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dce53dfd-5741-4b19-9fd6-2f5871ef8c2d 1073741824 Nov 02 10:24:11 devstack sudo[105160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:11 devstack sudo[105155]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:11 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-0bcb417b-186e-4dd4-841f-c72ae8450d80 tempest-CreateVolumesFromSnapshotTest-1668273897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-89b58340-612c-41fc-8a56-e147e4f650ba" returned: 0 in 0.453s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:11 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-0bcb417b-186e-4dd4-841f-c72ae8450d80 tempest-CreateVolumesFromSnapshotTest-1668273897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-89b58340-612c-41fc-8a56-e147e4f650ba {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:11 devstack sudo[105167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-89b58340-612c-41fc-8a56-e147e4f650ba Nov 02 10:24:11 devstack sudo[105167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:11 devstack sudo[105160]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:11 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ed24c3d7-6f27-4781-933a-96521dab244c tempest-VolumeImageDependencyTests-2074229970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dce53dfd-5741-4b19-9fd6-2f5871ef8c2d 1073741824" returned: 0 in 0.596s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:11 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ed24c3d7-6f27-4781-933a-96521dab244c tempest-VolumeImageDependencyTests-2074229970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dce53dfd-5741-4b19-9fd6-2f5871ef8c2d {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:11 devstack sudo[105167]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:11 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-0bcb417b-186e-4dd4-841f-c72ae8450d80 tempest-CreateVolumesFromSnapshotTest-1668273897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-89b58340-612c-41fc-8a56-e147e4f650ba" returned: 0 in 0.344s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:11 devstack sudo[105171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dce53dfd-5741-4b19-9fd6-2f5871ef8c2d Nov 02 10:24:11 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-0bcb417b-186e-4dd4-841f-c72ae8450d80 tempest-CreateVolumesFromSnapshotTest-1668273897 None] Lock "cinder-quobyte-89b58340-612c-41fc-8a56-e147e4f650ba" released by "delete_volume" :: held 0.890s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:24:11 devstack sudo[105171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:11 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-0bcb417b-186e-4dd4-841f-c72ae8450d80 tempest-CreateVolumesFromSnapshotTest-1668273897 None] Created reservations ['320bc49b-d570-4e46-9f58-f0ac71851486', '1700356e-17ee-4937-b679-b2cbc28225d1', '340edae9-ac92-482c-89df-6719313c9d35', '35c00332-1efd-4ff5-b14f-77a018247f5f'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:24:11 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-0bcb417b-186e-4dd4-841f-c72ae8450d80 tempest-CreateVolumesFromSnapshotTest-1668273897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:24:11 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-0bcb417b-186e-4dd4-841f-c72ae8450d80 tempest-CreateVolumesFromSnapshotTest-1668273897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:24:11 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-0bcb417b-186e-4dd4-841f-c72ae8450d80 tempest-CreateVolumesFromSnapshotTest-1668273897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:24:11 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-0bcb417b-186e-4dd4-841f-c72ae8450d80 tempest-CreateVolumesFromSnapshotTest-1668273897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:24:11 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-0bcb417b-186e-4dd4-841f-c72ae8450d80 tempest-CreateVolumesFromSnapshotTest-1668273897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:24:11 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-0bcb417b-186e-4dd4-841f-c72ae8450d80 tempest-CreateVolumesFromSnapshotTest-1668273897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:12 devstack sudo[105174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:24:12 devstack sudo[105174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:12 devstack sudo[105171]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:12 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ed24c3d7-6f27-4781-933a-96521dab244c tempest-VolumeImageDependencyTests-2074229970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dce53dfd-5741-4b19-9fd6-2f5871ef8c2d" returned: 0 in 0.308s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:12 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-ed24c3d7-6f27-4781-933a-96521dab244c tempest-VolumeImageDependencyTests-2074229970 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:24:12 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-ed24c3d7-6f27-4781-933a-96521dab244c tempest-VolumeImageDependencyTests-2074229970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.963s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:24:12 devstack cinder-volume[86890]: DEBUG cinder.volume.volume_utils [None req-ed24c3d7-6f27-4781-933a-96521dab244c tempest-VolumeImageDependencyTests-2074229970 None] Attempting download of 45896368-2a22-4791-be8c-732ba370d3be ((None, [{'url': 'file:///opt/stack/data/glance/images/45896368-2a22-4791-be8c-732ba370d3be', 'metadata': {}}])) to volume dce53dfd-5741-4b19-9fd6-2f5871ef8c2d. {{(pid=86890) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 02 10:24:12 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[a181c5ca-1136-4c8c-8e5d-0e43897dbba2]: (4, 'raw') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:24:12 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ed24c3d7-6f27-4781-933a-96521dab244c tempest-VolumeImageDependencyTests-2074229970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_45896368-2a22-4791-be8c-732ba370d3be_4lmgd_na {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:12 devstack sudo[105176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_45896368-2a22-4791-be8c-732ba370d3be_4lmgd_na Nov 02 10:24:12 devstack sudo[105176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:12 devstack sudo[105174]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:12 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-0bcb417b-186e-4dd4-841f-c72ae8450d80 tempest-CreateVolumesFromSnapshotTest-1668273897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.340s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:12 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-0bcb417b-186e-4dd4-841f-c72ae8450d80 tempest-CreateVolumesFromSnapshotTest-1668273897 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:24:12 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-0bcb417b-186e-4dd4-841f-c72ae8450d80 tempest-CreateVolumesFromSnapshotTest-1668273897 None] Deleted volume successfully. Nov 02 10:24:12 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-0bcb417b-186e-4dd4-841f-c72ae8450d80 tempest-CreateVolumesFromSnapshotTest-1668273897 None] Lock "cinder-89b58340-612c-41fc-8a56-e147e4f650ba-delete_volume" released by "delete_volume" :: held 1.602s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:24:12 devstack sudo[105176]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:12 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ed24c3d7-6f27-4781-933a-96521dab244c tempest-VolumeImageDependencyTests-2074229970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_45896368-2a22-4791-be8c-732ba370d3be_4lmgd_na" returned: 0 in 0.455s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:12 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ed24c3d7-6f27-4781-933a-96521dab244c tempest-VolumeImageDependencyTests-2074229970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_45896368-2a22-4791-be8c-732ba370d3be_4lmgd_na {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:12 devstack sudo[105181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_45896368-2a22-4791-be8c-732ba370d3be_4lmgd_na Nov 02 10:24:12 devstack sudo[105181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:12 devstack sudo[105181]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:12 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ed24c3d7-6f27-4781-933a-96521dab244c tempest-VolumeImageDependencyTests-2074229970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_45896368-2a22-4791-be8c-732ba370d3be_4lmgd_na" returned: 1 in 0.369s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:12 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ed24c3d7-6f27-4781-933a-96521dab244c tempest-VolumeImageDependencyTests-2074229970 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_45896368-2a22-4791-be8c-732ba370d3be_4lmgd_na' failed. Not Retrying. {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 10:24:12 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[19e0aae0-e8c5-4d80-8192-0b65ce86df9f]: (4, 'raw') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:24:12 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ed24c3d7-6f27-4781-933a-96521dab244c tempest-VolumeImageDependencyTests-2074229970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_45896368-2a22-4791-be8c-732ba370d3be_q8b3y4kydevstack@QuobyteHD {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:13 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-50d0e0f8-7580-41ac-84dd-9159a6107aeb tempest-CreateVolumesFromSnapshotTest-1668273897 None] Acquiring lock "cinder-688ff28d-8e86-4acd-810e-e8da25fd3eca-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:24:13 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-50d0e0f8-7580-41ac-84dd-9159a6107aeb tempest-CreateVolumesFromSnapshotTest-1668273897 None] Lock "cinder-688ff28d-8e86-4acd-810e-e8da25fd3eca-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:24:13 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-50d0e0f8-7580-41ac-84dd-9159a6107aeb tempest-CreateVolumesFromSnapshotTest-1668273897 None] Acquiring lock "cinder-quobyte-688ff28d-8e86-4acd-810e-e8da25fd3eca" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:24:13 devstack sudo[105185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_45896368-2a22-4791-be8c-732ba370d3be_q8b3y4kydevstack@QuobyteHD Nov 02 10:24:13 devstack sudo[105185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:13 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-50d0e0f8-7580-41ac-84dd-9159a6107aeb tempest-CreateVolumesFromSnapshotTest-1668273897 None] Lock "cinder-quobyte-688ff28d-8e86-4acd-810e-e8da25fd3eca" acquired by "delete_volume" :: waited 0.021s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:24:13 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[0436d8e7-5e0a-4958-a910-ef1e2d0bdafa]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:24:13 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-50d0e0f8-7580-41ac-84dd-9159a6107aeb tempest-CreateVolumesFromSnapshotTest-1668273897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-688ff28d-8e86-4acd-810e-e8da25fd3eca {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:13 devstack sudo[105187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-688ff28d-8e86-4acd-810e-e8da25fd3eca Nov 02 10:24:13 devstack sudo[105187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:13 devstack sudo[105185]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:13 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ed24c3d7-6f27-4781-933a-96521dab244c tempest-VolumeImageDependencyTests-2074229970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_45896368-2a22-4791-be8c-732ba370d3be_q8b3y4kydevstack@QuobyteHD" returned: 0 in 0.471s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:13 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ed24c3d7-6f27-4781-933a-96521dab244c tempest-VolumeImageDependencyTests-2074229970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_45896368-2a22-4791-be8c-732ba370d3be_q8b3y4kydevstack@QuobyteHD {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:13 devstack sudo[105191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_45896368-2a22-4791-be8c-732ba370d3be_q8b3y4kydevstack@QuobyteHD Nov 02 10:24:13 devstack sudo[105191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:13 devstack sudo[105187]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:13 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-50d0e0f8-7580-41ac-84dd-9159a6107aeb tempest-CreateVolumesFromSnapshotTest-1668273897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-688ff28d-8e86-4acd-810e-e8da25fd3eca" returned: 0 in 0.446s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:13 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-50d0e0f8-7580-41ac-84dd-9159a6107aeb tempest-CreateVolumesFromSnapshotTest-1668273897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-688ff28d-8e86-4acd-810e-e8da25fd3eca {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:13 devstack sudo[105196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-688ff28d-8e86-4acd-810e-e8da25fd3eca Nov 02 10:24:13 devstack sudo[105196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:13 devstack sudo[105191]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:13 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ed24c3d7-6f27-4781-933a-96521dab244c tempest-VolumeImageDependencyTests-2074229970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_45896368-2a22-4791-be8c-732ba370d3be_q8b3y4kydevstack@QuobyteHD" returned: 1 in 0.347s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:13 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ed24c3d7-6f27-4781-933a-96521dab244c tempest-VolumeImageDependencyTests-2074229970 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_45896368-2a22-4791-be8c-732ba370d3be_q8b3y4kydevstack@QuobyteHD' failed. Not Retrying. {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 10:24:13 devstack cinder-volume[86890]: DEBUG cinder.image.image_utils [None req-ed24c3d7-6f27-4781-933a-96521dab244c tempest-VolumeImageDependencyTests-2074229970 None] 45896368-2a22-4791-be8c-732ba370d3be was raw, converting to qcow2 {{(pid=86890) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 02 10:24:13 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ed24c3d7-6f27-4781-933a-96521dab244c tempest-VolumeImageDependencyTests-2074229970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_45896368-2a22-4791-be8c-732ba370d3be_q8b3y4kydevstack@QuobyteHD /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dce53dfd-5741-4b19-9fd6-2f5871ef8c2d {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:13 devstack sudo[105201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_45896368-2a22-4791-be8c-732ba370d3be_q8b3y4kydevstack@QuobyteHD /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dce53dfd-5741-4b19-9fd6-2f5871ef8c2d Nov 02 10:24:13 devstack sudo[105201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:13 devstack sudo[105196]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:13 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-50d0e0f8-7580-41ac-84dd-9159a6107aeb tempest-CreateVolumesFromSnapshotTest-1668273897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-688ff28d-8e86-4acd-810e-e8da25fd3eca" returned: 0 in 0.257s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:13 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-50d0e0f8-7580-41ac-84dd-9159a6107aeb tempest-CreateVolumesFromSnapshotTest-1668273897 None] Lock "cinder-quobyte-688ff28d-8e86-4acd-810e-e8da25fd3eca" released by "delete_volume" :: held 0.770s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:24:14 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-50d0e0f8-7580-41ac-84dd-9159a6107aeb tempest-CreateVolumesFromSnapshotTest-1668273897 None] Created reservations ['fdc30147-e81f-45a8-8d87-f4804a9f282e', '5309285d-e1af-4fe6-a0b3-4d73f0d9b4ad', '45d51176-2c4a-441b-a2c7-7460b7710f61', '0e3fb617-ca62-406a-a4de-c3817eb3a5a6'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:24:14 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-50d0e0f8-7580-41ac-84dd-9159a6107aeb tempest-CreateVolumesFromSnapshotTest-1668273897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:24:14 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-50d0e0f8-7580-41ac-84dd-9159a6107aeb tempest-CreateVolumesFromSnapshotTest-1668273897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:24:14 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-50d0e0f8-7580-41ac-84dd-9159a6107aeb tempest-CreateVolumesFromSnapshotTest-1668273897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:24:14 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-50d0e0f8-7580-41ac-84dd-9159a6107aeb tempest-CreateVolumesFromSnapshotTest-1668273897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:24:14 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-50d0e0f8-7580-41ac-84dd-9159a6107aeb tempest-CreateVolumesFromSnapshotTest-1668273897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:24:14 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-50d0e0f8-7580-41ac-84dd-9159a6107aeb tempest-CreateVolumesFromSnapshotTest-1668273897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:14 devstack sudo[105209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:24:14 devstack sudo[105209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:14 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-716f9cd0-22af-476a-a10f-2983267d733d tempest-CreateVolumesFromSnapshotTest-1668273897 None] Acquiring lock "cinder-65e502d8-eb5d-4759-98bb-3610b9272798-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:24:14 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-716f9cd0-22af-476a-a10f-2983267d733d tempest-CreateVolumesFromSnapshotTest-1668273897 None] Lock "cinder-65e502d8-eb5d-4759-98bb-3610b9272798-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:24:14 devstack sudo[105209]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:14 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-716f9cd0-22af-476a-a10f-2983267d733d tempest-CreateVolumesFromSnapshotTest-1668273897 None] Acquiring lock "cinder-quobyte-65e502d8-eb5d-4759-98bb-3610b9272798" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:24:14 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-50d0e0f8-7580-41ac-84dd-9159a6107aeb tempest-CreateVolumesFromSnapshotTest-1668273897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.351s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:14 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-50d0e0f8-7580-41ac-84dd-9159a6107aeb tempest-CreateVolumesFromSnapshotTest-1668273897 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:24:14 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-50d0e0f8-7580-41ac-84dd-9159a6107aeb tempest-CreateVolumesFromSnapshotTest-1668273897 None] Deleted volume successfully. Nov 02 10:24:14 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-716f9cd0-22af-476a-a10f-2983267d733d tempest-CreateVolumesFromSnapshotTest-1668273897 None] Lock "cinder-quobyte-65e502d8-eb5d-4759-98bb-3610b9272798" acquired by "delete_volume" :: waited 0.030s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:24:14 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3f5b240-201e-4abb-aeb7-1402b14b8421 tempest-ProjectReaderTests-1337323374 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:24:14 devstack sudo[105201]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:14 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c3f5b240-201e-4abb-aeb7-1402b14b8421 tempest-ProjectReaderTests-1337323374 None] Flow 'volume_create_manager' (09d4127c-29dc-49aa-a751-1a7debbb1e95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:24:14 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c3f5b240-201e-4abb-aeb7-1402b14b8421 tempest-ProjectReaderTests-1337323374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3d00af2-14af-4ccd-b186-acb4db5cdf24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:24:14 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[92717d71-5081-4849-aa7e-d1f989bf71d9]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:24:14 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-716f9cd0-22af-476a-a10f-2983267d733d tempest-CreateVolumesFromSnapshotTest-1668273897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-65e502d8-eb5d-4759-98bb-3610b9272798 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:14 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-50d0e0f8-7580-41ac-84dd-9159a6107aeb tempest-CreateVolumesFromSnapshotTest-1668273897 None] Lock "cinder-688ff28d-8e86-4acd-810e-e8da25fd3eca-delete_volume" released by "delete_volume" :: held 1.479s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:24:14 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ed24c3d7-6f27-4781-933a-96521dab244c tempest-VolumeImageDependencyTests-2074229970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_45896368-2a22-4791-be8c-732ba370d3be_q8b3y4kydevstack@QuobyteHD /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dce53dfd-5741-4b19-9fd6-2f5871ef8c2d" returned: 0 in 0.760s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:14 devstack cinder-volume[86890]: DEBUG cinder.image.image_utils [None req-ed24c3d7-6f27-4781-933a-96521dab244c tempest-VolumeImageDependencyTests-2074229970 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_45896368-2a22-4791-be8c-732ba370d3be_q8b3y4kydevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dce53dfd-5741-4b19-9fd6-2f5871ef8c2d {{(pid=86890) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 10:24:14 devstack cinder-volume[86890]: INFO cinder.image.image_utils [None req-ed24c3d7-6f27-4781-933a-96521dab244c tempest-VolumeImageDependencyTests-2074229970 None] Converted 0.00 MB image at 0.00 MB/s Nov 02 10:24:14 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ed24c3d7-6f27-4781-933a-96521dab244c tempest-VolumeImageDependencyTests-2074229970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dce53dfd-5741-4b19-9fd6-2f5871ef8c2d 1G {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:14 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c3f5b240-201e-4abb-aeb7-1402b14b8421 tempest-ProjectReaderTests-1337323374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3d00af2-14af-4ccd-b186-acb4db5cdf24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:24:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-264447531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6144f92-9ed4-4220-a0c7-f9d2d755866b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f943b1166bb4dab9825bd3ec005dc84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:24:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:24:14Z,use_quota=True,user_id='1411ac248364442a86c928ebb27fbd88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:24:14 devstack sudo[105213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dce53dfd-5741-4b19-9fd6-2f5871ef8c2d 1G Nov 02 10:24:14 devstack sudo[105213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:14 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c3f5b240-201e-4abb-aeb7-1402b14b8421 tempest-ProjectReaderTests-1337323374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2aa64185-3a2a-4e47-b6cc-ccff65de441a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:24:14 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c3f5b240-201e-4abb-aeb7-1402b14b8421 tempest-ProjectReaderTests-1337323374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2aa64185-3a2a-4e47-b6cc-ccff65de441a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:24:14 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c3f5b240-201e-4abb-aeb7-1402b14b8421 tempest-ProjectReaderTests-1337323374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15172fa9-3f78-4ad7-aa5e-adb9af4cebaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:24:14 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c3f5b240-201e-4abb-aeb7-1402b14b8421 tempest-ProjectReaderTests-1337323374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15172fa9-3f78-4ad7-aa5e-adb9af4cebaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6144f92-9ed4-4220-a0c7-f9d2d755866b', 'volume_name': 'volume-b6144f92-9ed4-4220-a0c7-f9d2d755866b', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:24:14 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c3f5b240-201e-4abb-aeb7-1402b14b8421 tempest-ProjectReaderTests-1337323374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c111dfa6-932d-4ddd-b2da-a29ed3b5268d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:24:14 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c3f5b240-201e-4abb-aeb7-1402b14b8421 tempest-ProjectReaderTests-1337323374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c111dfa6-932d-4ddd-b2da-a29ed3b5268d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:24:14 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c3f5b240-201e-4abb-aeb7-1402b14b8421 tempest-ProjectReaderTests-1337323374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66f64267-754f-4efe-a170-149c4554dbf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:24:14 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-c3f5b240-201e-4abb-aeb7-1402b14b8421 tempest-ProjectReaderTests-1337323374 None] Volume b6144f92-9ed4-4220-a0c7-f9d2d755866b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6144f92-9ed4-4220-a0c7-f9d2d755866b', 'volume_size': 1} Nov 02 10:24:14 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c3f5b240-201e-4abb-aeb7-1402b14b8421 tempest-ProjectReaderTests-1337323374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:24:14 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c3f5b240-201e-4abb-aeb7-1402b14b8421 tempest-ProjectReaderTests-1337323374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:24:14 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c3f5b240-201e-4abb-aeb7-1402b14b8421 tempest-ProjectReaderTests-1337323374 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:24:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-264447531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6144f92-9ed4-4220-a0c7-f9d2d755866b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f943b1166bb4dab9825bd3ec005dc84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:24:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:24:14Z,use_quota=True,user_id='1411ac248364442a86c928ebb27fbd88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:24:14 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-c3f5b240-201e-4abb-aeb7-1402b14b8421 tempest-ProjectReaderTests-1337323374 None] Creating volume b6144f92-9ed4-4220-a0c7-f9d2d755866b {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:24:14 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c3f5b240-201e-4abb-aeb7-1402b14b8421 tempest-ProjectReaderTests-1337323374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:24:14 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c3f5b240-201e-4abb-aeb7-1402b14b8421 tempest-ProjectReaderTests-1337323374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:24:14 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c3f5b240-201e-4abb-aeb7-1402b14b8421 tempest-ProjectReaderTests-1337323374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:24:14 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c3f5b240-201e-4abb-aeb7-1402b14b8421 tempest-ProjectReaderTests-1337323374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:24:14 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c3f5b240-201e-4abb-aeb7-1402b14b8421 tempest-ProjectReaderTests-1337323374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:24:14 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c3f5b240-201e-4abb-aeb7-1402b14b8421 tempest-ProjectReaderTests-1337323374 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:24:14 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-c3f5b240-201e-4abb-aeb7-1402b14b8421 tempest-ProjectReaderTests-1337323374 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:24:14 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c3f5b240-201e-4abb-aeb7-1402b14b8421 tempest-ProjectReaderTests-1337323374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b6144f92-9ed4-4220-a0c7-f9d2d755866b 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:14 devstack sudo[105215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b6144f92-9ed4-4220-a0c7-f9d2d755866b 1073741824 Nov 02 10:24:14 devstack sudo[105215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:14 devstack sudo[105212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-65e502d8-eb5d-4759-98bb-3610b9272798 Nov 02 10:24:14 devstack sudo[105212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:14 devstack sudo[105213]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:14 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ed24c3d7-6f27-4781-933a-96521dab244c tempest-VolumeImageDependencyTests-2074229970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dce53dfd-5741-4b19-9fd6-2f5871ef8c2d 1G" returned: 0 in 0.422s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:14 devstack cinder-volume[86890]: DEBUG cinder.volume.volume_utils [None req-ed24c3d7-6f27-4781-933a-96521dab244c tempest-VolumeImageDependencyTests-2074229970 None] Downloaded image 45896368-2a22-4791-be8c-732ba370d3be ((None, [{'url': 'file:///opt/stack/data/glance/images/45896368-2a22-4791-be8c-732ba370d3be', 'metadata': {}}])) to volume dce53dfd-5741-4b19-9fd6-2f5871ef8c2d successfully. {{(pid=86890) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 02 10:24:14 devstack cinder-volume[86890]: DEBUG cinder.image.image_utils [None req-ed24c3d7-6f27-4781-933a-96521dab244c tempest-VolumeImageDependencyTests-2074229970 None] Temporary image 45896368-2a22-4791-be8c-732ba370d3be for user 8dc27851b1af454681f3449bd34a445b is deleted. {{(pid=86890) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 02 10:24:14 devstack cinder-volume[86890]: DEBUG cinder.volume.volume_utils [None req-ed24c3d7-6f27-4781-933a-96521dab244c tempest-VolumeImageDependencyTests-2074229970 None] Marking volume dce53dfd-5741-4b19-9fd6-2f5871ef8c2d as bootable. {{(pid=86890) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 02 10:24:15 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed24c3d7-6f27-4781-933a-96521dab244c tempest-VolumeImageDependencyTests-2074229970 None] Copying metadata from image 45896368-2a22-4791-be8c-732ba370d3be to dce53dfd-5741-4b19-9fd6-2f5871ef8c2d. {{(pid=86890) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 10:24:15 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed24c3d7-6f27-4781-933a-96521dab244c tempest-VolumeImageDependencyTests-2074229970 None] Creating volume glance metadata for volume dce53dfd-5741-4b19-9fd6-2f5871ef8c2d backed by image 45896368-2a22-4791-be8c-732ba370d3be with: {'image_id': '45896368-2a22-4791-be8c-732ba370d3be', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'c44e9d0a6e4b3dfc96697de509e2e25d', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86890) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 10:24:15 devstack sudo[105212]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:15 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-716f9cd0-22af-476a-a10f-2983267d733d tempest-CreateVolumesFromSnapshotTest-1668273897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-65e502d8-eb5d-4759-98bb-3610b9272798" returned: 0 in 0.524s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:15 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-716f9cd0-22af-476a-a10f-2983267d733d tempest-CreateVolumesFromSnapshotTest-1668273897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-65e502d8-eb5d-4759-98bb-3610b9272798 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:15 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-ed24c3d7-6f27-4781-933a-96521dab244c tempest-VolumeImageDependencyTests-2074229970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d870fb5-9fa8-459a-95cd-05c32c7875e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dce53dfd-5741-4b19-9fd6-2f5871ef8c2d', 'volume_size': 1, 'image_id': '45896368-2a22-4791-be8c-732ba370d3be', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/45896368-2a22-4791-be8c-732ba370d3be', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c44e9d0a6e4b3dfc96697de509e2e25d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '337878924f594d00b18cde732953f10a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0e7803c6580e15557a672cab6d59468dde7600414bf9b6ff030da1270ee5b5014c2e2932795f8a2a1787c7a0f7546bc7b6a22a390b5260018998b06a4c2e87a3', 'id': '45896368-2a22-4791-be8c-732ba370d3be', 'created_at': datetime.datetime(2026, 11, 2, 9, 24, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 24, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/45896368-2a22-4791-be8c-732ba370d3be/file', 'properties': {}}, 'image_service': }' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:24:15 devstack sudo[105228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-65e502d8-eb5d-4759-98bb-3610b9272798 Nov 02 10:24:15 devstack sudo[105228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:15 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-ed24c3d7-6f27-4781-933a-96521dab244c tempest-VolumeImageDependencyTests-2074229970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3af8f11-0b52-4439-bd7b-093f59d3d042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:24:15 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-ed24c3d7-6f27-4781-933a-96521dab244c tempest-VolumeImageDependencyTests-2074229970 None] Volume volume-dce53dfd-5741-4b19-9fd6-2f5871ef8c2d (dce53dfd-5741-4b19-9fd6-2f5871ef8c2d): created successfully Nov 02 10:24:15 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-ed24c3d7-6f27-4781-933a-96521dab244c tempest-VolumeImageDependencyTests-2074229970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3af8f11-0b52-4439-bd7b-093f59d3d042) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:24:15 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-ed24c3d7-6f27-4781-933a-96521dab244c tempest-VolumeImageDependencyTests-2074229970 None] Flow 'volume_create_manager' (2311de9f-cf5e-4842-bf7b-d4c3e14c44ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:24:15 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-ed24c3d7-6f27-4781-933a-96521dab244c tempest-VolumeImageDependencyTests-2074229970 None] Created volume successfully. Nov 02 10:24:15 devstack sudo[105215]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:15 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c3f5b240-201e-4abb-aeb7-1402b14b8421 tempest-ProjectReaderTests-1337323374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b6144f92-9ed4-4220-a0c7-f9d2d755866b 1073741824" returned: 0 in 0.600s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:15 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c3f5b240-201e-4abb-aeb7-1402b14b8421 tempest-ProjectReaderTests-1337323374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b6144f92-9ed4-4220-a0c7-f9d2d755866b {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:15 devstack sudo[105231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b6144f92-9ed4-4220-a0c7-f9d2d755866b Nov 02 10:24:15 devstack sudo[105231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:15 devstack sudo[105228]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:15 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-716f9cd0-22af-476a-a10f-2983267d733d tempest-CreateVolumesFromSnapshotTest-1668273897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-65e502d8-eb5d-4759-98bb-3610b9272798" returned: 0 in 0.372s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:15 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-716f9cd0-22af-476a-a10f-2983267d733d tempest-CreateVolumesFromSnapshotTest-1668273897 None] Lock "cinder-quobyte-65e502d8-eb5d-4759-98bb-3610b9272798" released by "delete_volume" :: held 0.973s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:24:15 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-716f9cd0-22af-476a-a10f-2983267d733d tempest-CreateVolumesFromSnapshotTest-1668273897 None] Created reservations ['f1a172ec-a250-4124-a32c-c192e3520613', '04e713ab-ddfc-4fd0-a333-8e10875d5f28', '0187190e-dc34-4456-a82f-c0b82d3a56e8', 'a001fce1-1956-4f1b-bffd-24f9b84ad61e'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:24:15 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-716f9cd0-22af-476a-a10f-2983267d733d tempest-CreateVolumesFromSnapshotTest-1668273897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:24:15 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-716f9cd0-22af-476a-a10f-2983267d733d tempest-CreateVolumesFromSnapshotTest-1668273897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:24:15 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-716f9cd0-22af-476a-a10f-2983267d733d tempest-CreateVolumesFromSnapshotTest-1668273897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:24:15 devstack sudo[105231]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:15 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-716f9cd0-22af-476a-a10f-2983267d733d tempest-CreateVolumesFromSnapshotTest-1668273897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:24:15 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-716f9cd0-22af-476a-a10f-2983267d733d tempest-CreateVolumesFromSnapshotTest-1668273897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:24:15 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-716f9cd0-22af-476a-a10f-2983267d733d tempest-CreateVolumesFromSnapshotTest-1668273897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:15 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c3f5b240-201e-4abb-aeb7-1402b14b8421 tempest-ProjectReaderTests-1337323374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b6144f92-9ed4-4220-a0c7-f9d2d755866b" returned: 0 in 0.337s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:15 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c3f5b240-201e-4abb-aeb7-1402b14b8421 tempest-ProjectReaderTests-1337323374 None] <== create_volume: return (988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:24:15 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c3f5b240-201e-4abb-aeb7-1402b14b8421 tempest-ProjectReaderTests-1337323374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.990s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:24:15 devstack sudo[105235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:24:15 devstack sudo[105235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:15 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c3f5b240-201e-4abb-aeb7-1402b14b8421 tempest-ProjectReaderTests-1337323374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66f64267-754f-4efe-a170-149c4554dbf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6144f92-9ed4-4220-a0c7-f9d2d755866b', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:24:15 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c3f5b240-201e-4abb-aeb7-1402b14b8421 tempest-ProjectReaderTests-1337323374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b2974c7-fa6a-417a-be06-1c839d4ec17f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:24:15 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-c3f5b240-201e-4abb-aeb7-1402b14b8421 tempest-ProjectReaderTests-1337323374 None] Volume volume-b6144f92-9ed4-4220-a0c7-f9d2d755866b (b6144f92-9ed4-4220-a0c7-f9d2d755866b): created successfully Nov 02 10:24:15 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c3f5b240-201e-4abb-aeb7-1402b14b8421 tempest-ProjectReaderTests-1337323374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b2974c7-fa6a-417a-be06-1c839d4ec17f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:24:15 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c3f5b240-201e-4abb-aeb7-1402b14b8421 tempest-ProjectReaderTests-1337323374 None] Flow 'volume_create_manager' (09d4127c-29dc-49aa-a751-1a7debbb1e95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:24:15 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-c3f5b240-201e-4abb-aeb7-1402b14b8421 tempest-ProjectReaderTests-1337323374 None] Created volume successfully. Nov 02 10:24:15 devstack sudo[105235]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:15 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-716f9cd0-22af-476a-a10f-2983267d733d tempest-CreateVolumesFromSnapshotTest-1668273897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.257s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:15 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-716f9cd0-22af-476a-a10f-2983267d733d tempest-CreateVolumesFromSnapshotTest-1668273897 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:24:15 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-716f9cd0-22af-476a-a10f-2983267d733d tempest-CreateVolumesFromSnapshotTest-1668273897 None] Deleted volume successfully. Nov 02 10:24:15 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-716f9cd0-22af-476a-a10f-2983267d733d tempest-CreateVolumesFromSnapshotTest-1668273897 None] Lock "cinder-65e502d8-eb5d-4759-98bb-3610b9272798-delete_volume" released by "delete_volume" :: held 1.585s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:24:15 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-02dc624e-0450-4660-91dc-2c03bfd188e2 tempest-VolumeImageDependencyTests-2074229970 None] Acquiring lock "cinder-dce53dfd-5741-4b19-9fd6-2f5871ef8c2d-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:24:15 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-02dc624e-0450-4660-91dc-2c03bfd188e2 tempest-VolumeImageDependencyTests-2074229970 None] Lock "cinder-dce53dfd-5741-4b19-9fd6-2f5871ef8c2d-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:24:16 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-02dc624e-0450-4660-91dc-2c03bfd188e2 tempest-VolumeImageDependencyTests-2074229970 None] Acquiring lock "cinder-quobyte-dce53dfd-5741-4b19-9fd6-2f5871ef8c2d" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:24:16 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-02dc624e-0450-4660-91dc-2c03bfd188e2 tempest-VolumeImageDependencyTests-2074229970 None] Lock "cinder-quobyte-dce53dfd-5741-4b19-9fd6-2f5871ef8c2d" acquired by "delete_volume" :: waited 0.015s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:24:16 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[adbed949-a853-4cd0-b3fc-2a4b352535ef]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:24:16 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-02dc624e-0450-4660-91dc-2c03bfd188e2 tempest-VolumeImageDependencyTests-2074229970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dce53dfd-5741-4b19-9fd6-2f5871ef8c2d {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:16 devstack sudo[105238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dce53dfd-5741-4b19-9fd6-2f5871ef8c2d Nov 02 10:24:16 devstack sudo[105238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:16 devstack sudo[105238]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:16 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-02dc624e-0450-4660-91dc-2c03bfd188e2 tempest-VolumeImageDependencyTests-2074229970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dce53dfd-5741-4b19-9fd6-2f5871ef8c2d" returned: 0 in 0.376s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:16 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-02dc624e-0450-4660-91dc-2c03bfd188e2 tempest-VolumeImageDependencyTests-2074229970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dce53dfd-5741-4b19-9fd6-2f5871ef8c2d {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:16 devstack sudo[105243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dce53dfd-5741-4b19-9fd6-2f5871ef8c2d Nov 02 10:24:16 devstack sudo[105243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:16 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-e3629d86-4a56-4134-877a-38e20903b496 tempest-CreateVolumesFromSnapshotTest-1668273897 None] Acquiring lock "cinder-6aebf7e8-5ce0-46c3-9b51-09d1f68585cb-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:24:16 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-e3629d86-4a56-4134-877a-38e20903b496 tempest-CreateVolumesFromSnapshotTest-1668273897 None] Lock "cinder-6aebf7e8-5ce0-46c3-9b51-09d1f68585cb-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:24:16 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-e3629d86-4a56-4134-877a-38e20903b496 tempest-CreateVolumesFromSnapshotTest-1668273897 None] Acquiring lock "cinder-quobyte-6aebf7e8-5ce0-46c3-9b51-09d1f68585cb" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:24:16 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-e3629d86-4a56-4134-877a-38e20903b496 tempest-CreateVolumesFromSnapshotTest-1668273897 None] Lock "cinder-quobyte-6aebf7e8-5ce0-46c3-9b51-09d1f68585cb" acquired by "delete_volume" :: waited 0.019s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:24:16 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa42b47f-897b-4642-8c7d-c96da0b221d9]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:24:16 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-e3629d86-4a56-4134-877a-38e20903b496 tempest-CreateVolumesFromSnapshotTest-1668273897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-6aebf7e8-5ce0-46c3-9b51-09d1f68585cb {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:16 devstack sudo[105243]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:16 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-02dc624e-0450-4660-91dc-2c03bfd188e2 tempest-VolumeImageDependencyTests-2074229970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-dce53dfd-5741-4b19-9fd6-2f5871ef8c2d" returned: 0 in 0.336s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:16 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-02dc624e-0450-4660-91dc-2c03bfd188e2 tempest-VolumeImageDependencyTests-2074229970 None] Lock "cinder-quobyte-dce53dfd-5741-4b19-9fd6-2f5871ef8c2d" released by "delete_volume" :: held 0.773s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:24:16 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-0c0a0a21-74f9-4094-8248-3ec430a5e393 tempest-ProjectReaderTests-1337323374 None] Acquiring lock "cinder-b6144f92-9ed4-4220-a0c7-f9d2d755866b-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:24:16 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-0c0a0a21-74f9-4094-8248-3ec430a5e393 tempest-ProjectReaderTests-1337323374 None] Lock "cinder-b6144f92-9ed4-4220-a0c7-f9d2d755866b-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:24:16 devstack sudo[105248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-6aebf7e8-5ce0-46c3-9b51-09d1f68585cb Nov 02 10:24:16 devstack sudo[105248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:16 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-0c0a0a21-74f9-4094-8248-3ec430a5e393 tempest-ProjectReaderTests-1337323374 None] Acquiring lock "cinder-quobyte-b6144f92-9ed4-4220-a0c7-f9d2d755866b" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:24:16 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-02dc624e-0450-4660-91dc-2c03bfd188e2 tempest-VolumeImageDependencyTests-2074229970 None] Created reservations ['f006dd04-a257-4915-874b-d01d7f11f695', 'eea47dc1-23fe-461d-bd9c-eb3b3ae4350c', 'fdbebc98-7ab2-4659-aaa2-9f7f91f9f10b', '0bf98ca9-d384-4383-ab84-0b8d3280f02f'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:24:16 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-0c0a0a21-74f9-4094-8248-3ec430a5e393 tempest-ProjectReaderTests-1337323374 None] Lock "cinder-quobyte-b6144f92-9ed4-4220-a0c7-f9d2d755866b" acquired by "delete_volume" :: waited 0.039s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:24:17 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[25d2f0a1-9125-420e-99bd-a775ac87fe70]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:24:17 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-0c0a0a21-74f9-4094-8248-3ec430a5e393 tempest-ProjectReaderTests-1337323374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b6144f92-9ed4-4220-a0c7-f9d2d755866b {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:17 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-02dc624e-0450-4660-91dc-2c03bfd188e2 tempest-VolumeImageDependencyTests-2074229970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:24:17 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-02dc624e-0450-4660-91dc-2c03bfd188e2 tempest-VolumeImageDependencyTests-2074229970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:24:17 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-02dc624e-0450-4660-91dc-2c03bfd188e2 tempest-VolumeImageDependencyTests-2074229970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:24:17 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-02dc624e-0450-4660-91dc-2c03bfd188e2 tempest-VolumeImageDependencyTests-2074229970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:24:17 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-02dc624e-0450-4660-91dc-2c03bfd188e2 tempest-VolumeImageDependencyTests-2074229970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:24:17 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-02dc624e-0450-4660-91dc-2c03bfd188e2 tempest-VolumeImageDependencyTests-2074229970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:17 devstack sudo[105258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:24:17 devstack sudo[105258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:17 devstack sudo[105256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b6144f92-9ed4-4220-a0c7-f9d2d755866b Nov 02 10:24:17 devstack sudo[105256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:17 devstack sudo[105248]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:17 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-e3629d86-4a56-4134-877a-38e20903b496 tempest-CreateVolumesFromSnapshotTest-1668273897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-6aebf7e8-5ce0-46c3-9b51-09d1f68585cb" returned: 0 in 0.529s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:17 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-e3629d86-4a56-4134-877a-38e20903b496 tempest-CreateVolumesFromSnapshotTest-1668273897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-6aebf7e8-5ce0-46c3-9b51-09d1f68585cb {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:17 devstack sudo[105264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-6aebf7e8-5ce0-46c3-9b51-09d1f68585cb Nov 02 10:24:17 devstack sudo[105264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:17 devstack sudo[105258]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:17 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-02dc624e-0450-4660-91dc-2c03bfd188e2 tempest-VolumeImageDependencyTests-2074229970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.383s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:17 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-02dc624e-0450-4660-91dc-2c03bfd188e2 tempest-VolumeImageDependencyTests-2074229970 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:24:17 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-02dc624e-0450-4660-91dc-2c03bfd188e2 tempest-VolumeImageDependencyTests-2074229970 None] Deleted volume successfully. Nov 02 10:24:17 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-02dc624e-0450-4660-91dc-2c03bfd188e2 tempest-VolumeImageDependencyTests-2074229970 None] Lock "cinder-dce53dfd-5741-4b19-9fd6-2f5871ef8c2d-delete_volume" released by "delete_volume" :: held 1.557s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:24:17 devstack sudo[105264]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:17 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-e3629d86-4a56-4134-877a-38e20903b496 tempest-CreateVolumesFromSnapshotTest-1668273897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-6aebf7e8-5ce0-46c3-9b51-09d1f68585cb" returned: 0 in 0.350s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:17 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-e3629d86-4a56-4134-877a-38e20903b496 tempest-CreateVolumesFromSnapshotTest-1668273897 None] Lock "cinder-quobyte-6aebf7e8-5ce0-46c3-9b51-09d1f68585cb" released by "delete_volume" :: held 0.957s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:24:17 devstack sudo[105256]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:17 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-0c0a0a21-74f9-4094-8248-3ec430a5e393 tempest-ProjectReaderTests-1337323374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b6144f92-9ed4-4220-a0c7-f9d2d755866b" returned: 0 in 0.647s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:17 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-0c0a0a21-74f9-4094-8248-3ec430a5e393 tempest-ProjectReaderTests-1337323374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b6144f92-9ed4-4220-a0c7-f9d2d755866b {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:17 devstack sudo[105271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b6144f92-9ed4-4220-a0c7-f9d2d755866b Nov 02 10:24:17 devstack sudo[105271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:17 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-e3629d86-4a56-4134-877a-38e20903b496 tempest-CreateVolumesFromSnapshotTest-1668273897 None] Created reservations ['d4d10686-6d41-49d2-af49-271f2ff5eda8', '9b9f7ecc-2bc2-4bdb-bcfb-82f419dbccaa', '6ce022e2-85fa-44a7-b084-7cbb0acb0976', '5b71bd13-8153-4eec-ac21-3a0d8c2458cc'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:24:17 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-e3629d86-4a56-4134-877a-38e20903b496 tempest-CreateVolumesFromSnapshotTest-1668273897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:24:17 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-e3629d86-4a56-4134-877a-38e20903b496 tempest-CreateVolumesFromSnapshotTest-1668273897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:24:17 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-e3629d86-4a56-4134-877a-38e20903b496 tempest-CreateVolumesFromSnapshotTest-1668273897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:24:17 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-e3629d86-4a56-4134-877a-38e20903b496 tempest-CreateVolumesFromSnapshotTest-1668273897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:24:17 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-e3629d86-4a56-4134-877a-38e20903b496 tempest-CreateVolumesFromSnapshotTest-1668273897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:24:17 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-e3629d86-4a56-4134-877a-38e20903b496 tempest-CreateVolumesFromSnapshotTest-1668273897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:17 devstack sudo[105273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:24:17 devstack sudo[105273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:17 devstack sudo[105271]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:17 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-0c0a0a21-74f9-4094-8248-3ec430a5e393 tempest-ProjectReaderTests-1337323374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b6144f92-9ed4-4220-a0c7-f9d2d755866b" returned: 0 in 0.328s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:18 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-0c0a0a21-74f9-4094-8248-3ec430a5e393 tempest-ProjectReaderTests-1337323374 None] Lock "cinder-quobyte-b6144f92-9ed4-4220-a0c7-f9d2d755866b" released by "delete_volume" :: held 1.039s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:24:18 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-0c0a0a21-74f9-4094-8248-3ec430a5e393 tempest-ProjectReaderTests-1337323374 None] Created reservations ['da8ef7a0-b124-421e-9ee2-1c1814b365e0', '226e7850-b5a5-427e-9f50-aa5780851ee9', '89159202-91cc-4960-81cb-cd11aceeca2d', 'bc958cf9-6571-4a38-a56c-e84d1b1c0638'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:24:18 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-0c0a0a21-74f9-4094-8248-3ec430a5e393 tempest-ProjectReaderTests-1337323374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:24:18 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-0c0a0a21-74f9-4094-8248-3ec430a5e393 tempest-ProjectReaderTests-1337323374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:24:18 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-0c0a0a21-74f9-4094-8248-3ec430a5e393 tempest-ProjectReaderTests-1337323374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:24:18 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-0c0a0a21-74f9-4094-8248-3ec430a5e393 tempest-ProjectReaderTests-1337323374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:24:18 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-0c0a0a21-74f9-4094-8248-3ec430a5e393 tempest-ProjectReaderTests-1337323374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:24:18 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-0c0a0a21-74f9-4094-8248-3ec430a5e393 tempest-ProjectReaderTests-1337323374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:18 devstack sudo[105277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:24:18 devstack sudo[105277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:18 devstack sudo[105273]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:18 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-e3629d86-4a56-4134-877a-38e20903b496 tempest-CreateVolumesFromSnapshotTest-1668273897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.372s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:18 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-e3629d86-4a56-4134-877a-38e20903b496 tempest-CreateVolumesFromSnapshotTest-1668273897 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:24:18 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-e3629d86-4a56-4134-877a-38e20903b496 tempest-CreateVolumesFromSnapshotTest-1668273897 None] Deleted volume successfully. Nov 02 10:24:18 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-e3629d86-4a56-4134-877a-38e20903b496 tempest-CreateVolumesFromSnapshotTest-1668273897 None] Lock "cinder-6aebf7e8-5ce0-46c3-9b51-09d1f68585cb-delete_volume" released by "delete_volume" :: held 1.668s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:24:18 devstack sudo[105277]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:18 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-0c0a0a21-74f9-4094-8248-3ec430a5e393 tempest-ProjectReaderTests-1337323374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.318s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:18 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-0c0a0a21-74f9-4094-8248-3ec430a5e393 tempest-ProjectReaderTests-1337323374 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:24:18 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-0c0a0a21-74f9-4094-8248-3ec430a5e393 tempest-ProjectReaderTests-1337323374 None] Deleted volume successfully. Nov 02 10:24:18 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-0c0a0a21-74f9-4094-8248-3ec430a5e393 tempest-ProjectReaderTests-1337323374 None] Lock "cinder-b6144f92-9ed4-4220-a0c7-f9d2d755866b-delete_volume" released by "delete_volume" :: held 1.653s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:24:18 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-e11e8cef-f6de-4800-b592-ffd144f311f1 tempest-CreateVolumesFromSnapshotTest-1668273897 None] Acquiring lock "cinder-863f940c-4c00-4d7e-bb9b-4fe2be930be3-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:24:18 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-e11e8cef-f6de-4800-b592-ffd144f311f1 tempest-CreateVolumesFromSnapshotTest-1668273897 None] Lock "cinder-863f940c-4c00-4d7e-bb9b-4fe2be930be3-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:24:18 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-e11e8cef-f6de-4800-b592-ffd144f311f1 tempest-CreateVolumesFromSnapshotTest-1668273897 None] Acquiring lock "cinder-quobyte-863f940c-4c00-4d7e-bb9b-4fe2be930be3" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:24:19 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-e11e8cef-f6de-4800-b592-ffd144f311f1 tempest-CreateVolumesFromSnapshotTest-1668273897 None] Lock "cinder-quobyte-863f940c-4c00-4d7e-bb9b-4fe2be930be3" acquired by "delete_volume" :: waited 0.021s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:24:19 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[b19fd044-06ed-4a15-b7b2-d942f031614e]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:24:19 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-e11e8cef-f6de-4800-b592-ffd144f311f1 tempest-CreateVolumesFromSnapshotTest-1668273897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-863f940c-4c00-4d7e-bb9b-4fe2be930be3 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:19 devstack sudo[105280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-863f940c-4c00-4d7e-bb9b-4fe2be930be3 Nov 02 10:24:19 devstack sudo[105280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:19 devstack sudo[105280]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:19 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-e11e8cef-f6de-4800-b592-ffd144f311f1 tempest-CreateVolumesFromSnapshotTest-1668273897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-863f940c-4c00-4d7e-bb9b-4fe2be930be3" returned: 0 in 0.469s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:19 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-e11e8cef-f6de-4800-b592-ffd144f311f1 tempest-CreateVolumesFromSnapshotTest-1668273897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-863f940c-4c00-4d7e-bb9b-4fe2be930be3 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:19 devstack sudo[105285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-863f940c-4c00-4d7e-bb9b-4fe2be930be3 Nov 02 10:24:19 devstack sudo[105285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:19 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd149522-9c8a-4adb-a0c7-0b2c6df11487 tempest-ProjectReaderTests-1337323374 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:24:19 devstack sudo[105285]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:19 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-dd149522-9c8a-4adb-a0c7-0b2c6df11487 tempest-ProjectReaderTests-1337323374 None] Flow 'volume_create_manager' (25801769-0fc3-410b-9d42-7cd8afd7521e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:24:19 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-dd149522-9c8a-4adb-a0c7-0b2c6df11487 tempest-ProjectReaderTests-1337323374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2965a78e-9284-4bc3-af7c-bfde448300e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:24:19 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-e11e8cef-f6de-4800-b592-ffd144f311f1 tempest-CreateVolumesFromSnapshotTest-1668273897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-863f940c-4c00-4d7e-bb9b-4fe2be930be3" returned: 0 in 0.357s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:19 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-dd149522-9c8a-4adb-a0c7-0b2c6df11487 tempest-ProjectReaderTests-1337323374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2965a78e-9284-4bc3-af7c-bfde448300e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:24:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-960555735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e56ec2e-e54f-418a-9d46-c88569134970,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f943b1166bb4dab9825bd3ec005dc84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:24:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:24:20Z,use_quota=True,user_id='1411ac248364442a86c928ebb27fbd88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:24:19 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-dd149522-9c8a-4adb-a0c7-0b2c6df11487 tempest-ProjectReaderTests-1337323374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb12c10e-7088-4da5-9f61-d54e0101232b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:24:19 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-dd149522-9c8a-4adb-a0c7-0b2c6df11487 tempest-ProjectReaderTests-1337323374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb12c10e-7088-4da5-9f61-d54e0101232b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:24:19 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-dd149522-9c8a-4adb-a0c7-0b2c6df11487 tempest-ProjectReaderTests-1337323374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce1751ba-eccf-4901-b5c5-e32bd672a63a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:24:19 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-dd149522-9c8a-4adb-a0c7-0b2c6df11487 tempest-ProjectReaderTests-1337323374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce1751ba-eccf-4901-b5c5-e32bd672a63a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e56ec2e-e54f-418a-9d46-c88569134970', 'volume_name': 'volume-4e56ec2e-e54f-418a-9d46-c88569134970', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:24:19 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-dd149522-9c8a-4adb-a0c7-0b2c6df11487 tempest-ProjectReaderTests-1337323374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81bbe31b-b923-49ff-b35c-f9674e154bd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:24:19 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-dd149522-9c8a-4adb-a0c7-0b2c6df11487 tempest-ProjectReaderTests-1337323374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81bbe31b-b923-49ff-b35c-f9674e154bd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:24:19 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-dd149522-9c8a-4adb-a0c7-0b2c6df11487 tempest-ProjectReaderTests-1337323374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7c03acb-5e26-4316-bdb1-5c33dbbb1471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:24:19 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-dd149522-9c8a-4adb-a0c7-0b2c6df11487 tempest-ProjectReaderTests-1337323374 None] Volume 4e56ec2e-e54f-418a-9d46-c88569134970: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e56ec2e-e54f-418a-9d46-c88569134970', 'volume_size': 1} Nov 02 10:24:19 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-dd149522-9c8a-4adb-a0c7-0b2c6df11487 tempest-ProjectReaderTests-1337323374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:24:19 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-dd149522-9c8a-4adb-a0c7-0b2c6df11487 tempest-ProjectReaderTests-1337323374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:24:19 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-dd149522-9c8a-4adb-a0c7-0b2c6df11487 tempest-ProjectReaderTests-1337323374 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:24:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-960555735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e56ec2e-e54f-418a-9d46-c88569134970,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f943b1166bb4dab9825bd3ec005dc84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:24:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:24:20Z,use_quota=True,user_id='1411ac248364442a86c928ebb27fbd88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:24:19 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-dd149522-9c8a-4adb-a0c7-0b2c6df11487 tempest-ProjectReaderTests-1337323374 None] Creating volume 4e56ec2e-e54f-418a-9d46-c88569134970 {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:24:19 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-dd149522-9c8a-4adb-a0c7-0b2c6df11487 tempest-ProjectReaderTests-1337323374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:24:19 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-dd149522-9c8a-4adb-a0c7-0b2c6df11487 tempest-ProjectReaderTests-1337323374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:24:19 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-dd149522-9c8a-4adb-a0c7-0b2c6df11487 tempest-ProjectReaderTests-1337323374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:24:19 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-dd149522-9c8a-4adb-a0c7-0b2c6df11487 tempest-ProjectReaderTests-1337323374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:24:19 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-dd149522-9c8a-4adb-a0c7-0b2c6df11487 tempest-ProjectReaderTests-1337323374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:24:19 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-dd149522-9c8a-4adb-a0c7-0b2c6df11487 tempest-ProjectReaderTests-1337323374 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:24:19 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-dd149522-9c8a-4adb-a0c7-0b2c6df11487 tempest-ProjectReaderTests-1337323374 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:24:19 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-dd149522-9c8a-4adb-a0c7-0b2c6df11487 tempest-ProjectReaderTests-1337323374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-4e56ec2e-e54f-418a-9d46-c88569134970 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:19 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-e11e8cef-f6de-4800-b592-ffd144f311f1 tempest-CreateVolumesFromSnapshotTest-1668273897 None] Lock "cinder-quobyte-863f940c-4c00-4d7e-bb9b-4fe2be930be3" released by "delete_volume" :: held 0.956s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:24:19 devstack sudo[105288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-4e56ec2e-e54f-418a-9d46-c88569134970 1073741824 Nov 02 10:24:19 devstack sudo[105288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:20 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-e11e8cef-f6de-4800-b592-ffd144f311f1 tempest-CreateVolumesFromSnapshotTest-1668273897 None] Created reservations ['7956b695-d27d-4d83-9483-b27ef0a34046', '57faba61-15f0-47ce-9e68-95ff0a44713e', '5faa9462-f9fc-4da8-a713-5c2bac5ba1fd', '4e145859-238f-48a7-b51a-b563420eda43'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:24:20 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-e11e8cef-f6de-4800-b592-ffd144f311f1 tempest-CreateVolumesFromSnapshotTest-1668273897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:24:20 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-e11e8cef-f6de-4800-b592-ffd144f311f1 tempest-CreateVolumesFromSnapshotTest-1668273897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:24:20 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-e11e8cef-f6de-4800-b592-ffd144f311f1 tempest-CreateVolumesFromSnapshotTest-1668273897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:24:20 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-e11e8cef-f6de-4800-b592-ffd144f311f1 tempest-CreateVolumesFromSnapshotTest-1668273897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:24:20 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-e11e8cef-f6de-4800-b592-ffd144f311f1 tempest-CreateVolumesFromSnapshotTest-1668273897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:24:20 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-e11e8cef-f6de-4800-b592-ffd144f311f1 tempest-CreateVolumesFromSnapshotTest-1668273897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:20 devstack sudo[105304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:24:20 devstack sudo[105304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:20 devstack sudo[105304]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:20 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-e11e8cef-f6de-4800-b592-ffd144f311f1 tempest-CreateVolumesFromSnapshotTest-1668273897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.335s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:20 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-e11e8cef-f6de-4800-b592-ffd144f311f1 tempest-CreateVolumesFromSnapshotTest-1668273897 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:24:20 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-e11e8cef-f6de-4800-b592-ffd144f311f1 tempest-CreateVolumesFromSnapshotTest-1668273897 None] Deleted volume successfully. Nov 02 10:24:20 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-e11e8cef-f6de-4800-b592-ffd144f311f1 tempest-CreateVolumesFromSnapshotTest-1668273897 None] Lock "cinder-863f940c-4c00-4d7e-bb9b-4fe2be930be3-delete_volume" released by "delete_volume" :: held 1.595s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:24:20 devstack sudo[105288]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:20 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-dd149522-9c8a-4adb-a0c7-0b2c6df11487 tempest-ProjectReaderTests-1337323374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-4e56ec2e-e54f-418a-9d46-c88569134970 1073741824" returned: 0 in 0.586s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:20 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-dd149522-9c8a-4adb-a0c7-0b2c6df11487 tempest-ProjectReaderTests-1337323374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-4e56ec2e-e54f-418a-9d46-c88569134970 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:20 devstack sudo[105333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-4e56ec2e-e54f-418a-9d46-c88569134970 Nov 02 10:24:20 devstack sudo[105333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:20 devstack sudo[105333]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:20 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-dd149522-9c8a-4adb-a0c7-0b2c6df11487 tempest-ProjectReaderTests-1337323374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-4e56ec2e-e54f-418a-9d46-c88569134970" returned: 0 in 0.273s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:20 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-dd149522-9c8a-4adb-a0c7-0b2c6df11487 tempest-ProjectReaderTests-1337323374 None] <== create_volume: return (927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:24:20 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-dd149522-9c8a-4adb-a0c7-0b2c6df11487 tempest-ProjectReaderTests-1337323374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.930s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:24:20 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-dd149522-9c8a-4adb-a0c7-0b2c6df11487 tempest-ProjectReaderTests-1337323374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7c03acb-5e26-4316-bdb1-5c33dbbb1471) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e56ec2e-e54f-418a-9d46-c88569134970', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:24:20 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-dd149522-9c8a-4adb-a0c7-0b2c6df11487 tempest-ProjectReaderTests-1337323374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99115d8d-8767-40e4-93d1-9a54cbb8bce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:24:20 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-dd149522-9c8a-4adb-a0c7-0b2c6df11487 tempest-ProjectReaderTests-1337323374 None] Volume volume-4e56ec2e-e54f-418a-9d46-c88569134970 (4e56ec2e-e54f-418a-9d46-c88569134970): created successfully Nov 02 10:24:20 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-dd149522-9c8a-4adb-a0c7-0b2c6df11487 tempest-ProjectReaderTests-1337323374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99115d8d-8767-40e4-93d1-9a54cbb8bce0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:24:20 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-dd149522-9c8a-4adb-a0c7-0b2c6df11487 tempest-ProjectReaderTests-1337323374 None] Flow 'volume_create_manager' (25801769-0fc3-410b-9d42-7cd8afd7521e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:24:20 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-dd149522-9c8a-4adb-a0c7-0b2c6df11487 tempest-ProjectReaderTests-1337323374 None] Created volume successfully. Nov 02 10:24:21 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-a61ebc85-59b6-4162-bd83-cb02aaedf92c tempest-CreateVolumesFromSnapshotTest-1668273897 None] Acquiring lock "cinder-17f9fd5d-64c1-4974-82c0-56a2b5ec4a32-delete_snapshot" by "delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:24:21 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-a61ebc85-59b6-4162-bd83-cb02aaedf92c tempest-CreateVolumesFromSnapshotTest-1668273897 None] Lock "cinder-17f9fd5d-64c1-4974-82c0-56a2b5ec4a32-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:24:21 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-a61ebc85-59b6-4162-bd83-cb02aaedf92c tempest-CreateVolumesFromSnapshotTest-1668273897 None] Acquiring lock "cinder-quobyte-902745cf-6e64-4c27-906c-6efba04100a6" by "delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:24:21 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-a61ebc85-59b6-4162-bd83-cb02aaedf92c tempest-CreateVolumesFromSnapshotTest-1668273897 None] Lock "cinder-quobyte-902745cf-6e64-4c27-906c-6efba04100a6" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:24:21 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-a61ebc85-59b6-4162-bd83-cb02aaedf92c tempest-CreateVolumesFromSnapshotTest-1668273897 None] Acquiring lock "cinder-quobyte-17f9fd5d-64c1-4974-82c0-56a2b5ec4a32" by "_delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:24:21 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-a61ebc85-59b6-4162-bd83-cb02aaedf92c tempest-CreateVolumesFromSnapshotTest-1668273897 None] Lock "cinder-quobyte-17f9fd5d-64c1-4974-82c0-56a2b5ec4a32" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:24:21 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-a61ebc85-59b6-4162-bd83-cb02aaedf92c tempest-CreateVolumesFromSnapshotTest-1668273897 None] Deleting offline snapshot 17f9fd5d-64c1-4974-82c0-56a2b5ec4a32 of volume 902745cf-6e64-4c27-906c-6efba04100a6 {{(pid=86890) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:24:21 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-a61ebc85-59b6-4162-bd83-cb02aaedf92c tempest-CreateVolumesFromSnapshotTest-1668273897 None] snapshot_file for this snap is: volume-902745cf-6e64-4c27-906c-6efba04100a6.17f9fd5d-64c1-4974-82c0-56a2b5ec4a32 {{(pid=86890) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:24:21 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[3954a969-9e83-4eeb-b136-32ba9aa05c0a]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:24:21 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a61ebc85-59b6-4162-bd83-cb02aaedf92c tempest-CreateVolumesFromSnapshotTest-1668273897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-902745cf-6e64-4c27-906c-6efba04100a6.17f9fd5d-64c1-4974-82c0-56a2b5ec4a32 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:21 devstack sudo[105338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-902745cf-6e64-4c27-906c-6efba04100a6.17f9fd5d-64c1-4974-82c0-56a2b5ec4a32 Nov 02 10:24:21 devstack sudo[105338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:21 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1aeaf1a-df84-4028-a279-4de6bffbe832 tempest-CinderUnicodeTest-716392597 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:24:21 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c1aeaf1a-df84-4028-a279-4de6bffbe832 tempest-CinderUnicodeTest-716392597 None] Flow 'volume_create_manager' (6bbe7784-5e52-4bba-862a-35509b9cf8a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:24:21 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c1aeaf1a-df84-4028-a279-4de6bffbe832 tempest-CinderUnicodeTest-716392597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf649bec-7884-4851-bdf4-494f0b29ece2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:24:21 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c1aeaf1a-df84-4028-a279-4de6bffbe832 tempest-CinderUnicodeTest-716392597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf649bec-7884-4851-bdf4-494f0b29ece2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:24:21Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db25e36b-d804-4411-9d29-c6efa913564d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bc708121ba644278fff60fbb4a46ab4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:24:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:24:21Z,use_quota=True,user_id='5b24460d77c1417f8e4db4e87ca0e301',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:24:21 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c1aeaf1a-df84-4028-a279-4de6bffbe832 tempest-CinderUnicodeTest-716392597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (547a2f55-4d7a-4047-8974-81d7a77360d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:24:21 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c1aeaf1a-df84-4028-a279-4de6bffbe832 tempest-CinderUnicodeTest-716392597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (547a2f55-4d7a-4047-8974-81d7a77360d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:24:21 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c1aeaf1a-df84-4028-a279-4de6bffbe832 tempest-CinderUnicodeTest-716392597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57e5e32f-03cf-4023-b6ea-48de32733144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:24:21 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c1aeaf1a-df84-4028-a279-4de6bffbe832 tempest-CinderUnicodeTest-716392597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57e5e32f-03cf-4023-b6ea-48de32733144) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db25e36b-d804-4411-9d29-c6efa913564d', 'volume_name': 'volume-db25e36b-d804-4411-9d29-c6efa913564d', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:24:21 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c1aeaf1a-df84-4028-a279-4de6bffbe832 tempest-CinderUnicodeTest-716392597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e52283c9-e43d-499f-98da-80d391f00219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:24:21 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c1aeaf1a-df84-4028-a279-4de6bffbe832 tempest-CinderUnicodeTest-716392597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e52283c9-e43d-499f-98da-80d391f00219) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:24:21 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c1aeaf1a-df84-4028-a279-4de6bffbe832 tempest-CinderUnicodeTest-716392597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3aefb727-52de-46f1-bd4a-66530dd14f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:24:21 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-c1aeaf1a-df84-4028-a279-4de6bffbe832 tempest-CinderUnicodeTest-716392597 None] Volume db25e36b-d804-4411-9d29-c6efa913564d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db25e36b-d804-4411-9d29-c6efa913564d', 'volume_size': 1} Nov 02 10:24:21 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c1aeaf1a-df84-4028-a279-4de6bffbe832 tempest-CinderUnicodeTest-716392597 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:24:21 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c1aeaf1a-df84-4028-a279-4de6bffbe832 tempest-CinderUnicodeTest-716392597 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:24:21 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c1aeaf1a-df84-4028-a279-4de6bffbe832 tempest-CinderUnicodeTest-716392597 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:24:21Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db25e36b-d804-4411-9d29-c6efa913564d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bc708121ba644278fff60fbb4a46ab4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:24:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:24:21Z,use_quota=True,user_id='5b24460d77c1417f8e4db4e87ca0e301',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:24:21 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-c1aeaf1a-df84-4028-a279-4de6bffbe832 tempest-CinderUnicodeTest-716392597 None] Creating volume db25e36b-d804-4411-9d29-c6efa913564d {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:24:21 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c1aeaf1a-df84-4028-a279-4de6bffbe832 tempest-CinderUnicodeTest-716392597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:24:21 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c1aeaf1a-df84-4028-a279-4de6bffbe832 tempest-CinderUnicodeTest-716392597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:24:21 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c1aeaf1a-df84-4028-a279-4de6bffbe832 tempest-CinderUnicodeTest-716392597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:24:21 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c1aeaf1a-df84-4028-a279-4de6bffbe832 tempest-CinderUnicodeTest-716392597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:24:21 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c1aeaf1a-df84-4028-a279-4de6bffbe832 tempest-CinderUnicodeTest-716392597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:24:21 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c1aeaf1a-df84-4028-a279-4de6bffbe832 tempest-CinderUnicodeTest-716392597 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:24:21 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-c1aeaf1a-df84-4028-a279-4de6bffbe832 tempest-CinderUnicodeTest-716392597 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:24:21 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c1aeaf1a-df84-4028-a279-4de6bffbe832 tempest-CinderUnicodeTest-716392597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-db25e36b-d804-4411-9d29-c6efa913564d 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:21 devstack sudo[105342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-db25e36b-d804-4411-9d29-c6efa913564d 1073741824 Nov 02 10:24:21 devstack sudo[105342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:21 devstack sudo[105338]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:21 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a61ebc85-59b6-4162-bd83-cb02aaedf92c tempest-CreateVolumesFromSnapshotTest-1668273897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-902745cf-6e64-4c27-906c-6efba04100a6.17f9fd5d-64c1-4974-82c0-56a2b5ec4a32" returned: 0 in 0.430s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:21 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-a61ebc85-59b6-4162-bd83-cb02aaedf92c tempest-CreateVolumesFromSnapshotTest-1668273897 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-902745cf-6e64-4c27-906c-6efba04100a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86890) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:24:21 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[60a8cd3e-d500-44a2-958a-c873471342bb]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:24:21 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a61ebc85-59b6-4162-bd83-cb02aaedf92c tempest-CreateVolumesFromSnapshotTest-1668273897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-902745cf-6e64-4c27-906c-6efba04100a6 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:21 devstack sudo[105345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-902745cf-6e64-4c27-906c-6efba04100a6 Nov 02 10:24:21 devstack sudo[105345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:21 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-e0906e62-54f5-4870-a1ed-84ea47dfabc6 tempest-ProjectReaderTests-1337323374 None] Acquiring lock "cinder-4e56ec2e-e54f-418a-9d46-c88569134970-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:24:21 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-e0906e62-54f5-4870-a1ed-84ea47dfabc6 tempest-ProjectReaderTests-1337323374 None] Lock "cinder-4e56ec2e-e54f-418a-9d46-c88569134970-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:24:22 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-e0906e62-54f5-4870-a1ed-84ea47dfabc6 tempest-ProjectReaderTests-1337323374 None] Acquiring lock "cinder-quobyte-4e56ec2e-e54f-418a-9d46-c88569134970" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:24:22 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-e0906e62-54f5-4870-a1ed-84ea47dfabc6 tempest-ProjectReaderTests-1337323374 None] Lock "cinder-quobyte-4e56ec2e-e54f-418a-9d46-c88569134970" acquired by "delete_volume" :: waited 0.019s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:24:22 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac3e8bc1-9a12-4799-ac39-8c790bc1eb27]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:24:22 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-e0906e62-54f5-4870-a1ed-84ea47dfabc6 tempest-ProjectReaderTests-1337323374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-4e56ec2e-e54f-418a-9d46-c88569134970 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:22 devstack sudo[105345]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:22 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a61ebc85-59b6-4162-bd83-cb02aaedf92c tempest-CreateVolumesFromSnapshotTest-1668273897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-902745cf-6e64-4c27-906c-6efba04100a6" returned: 0 in 0.414s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:22 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a61ebc85-59b6-4162-bd83-cb02aaedf92c tempest-CreateVolumesFromSnapshotTest-1668273897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-902745cf-6e64-4c27-906c-6efba04100a6.17f9fd5d-64c1-4974-82c0-56a2b5ec4a32 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:22 devstack sudo[105342]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:22 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c1aeaf1a-df84-4028-a279-4de6bffbe832 tempest-CinderUnicodeTest-716392597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-db25e36b-d804-4411-9d29-c6efa913564d 1073741824" returned: 0 in 0.541s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:22 devstack sudo[105355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-902745cf-6e64-4c27-906c-6efba04100a6.17f9fd5d-64c1-4974-82c0-56a2b5ec4a32 Nov 02 10:24:22 devstack sudo[105355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:22 devstack sudo[105353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-4e56ec2e-e54f-418a-9d46-c88569134970 Nov 02 10:24:22 devstack sudo[105353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:22 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c1aeaf1a-df84-4028-a279-4de6bffbe832 tempest-CinderUnicodeTest-716392597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-db25e36b-d804-4411-9d29-c6efa913564d {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:22 devstack sudo[105358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-db25e36b-d804-4411-9d29-c6efa913564d Nov 02 10:24:22 devstack sudo[105358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:22 devstack sudo[105353]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:22 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-e0906e62-54f5-4870-a1ed-84ea47dfabc6 tempest-ProjectReaderTests-1337323374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-4e56ec2e-e54f-418a-9d46-c88569134970" returned: 0 in 0.422s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:22 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-e0906e62-54f5-4870-a1ed-84ea47dfabc6 tempest-ProjectReaderTests-1337323374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-4e56ec2e-e54f-418a-9d46-c88569134970 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:22 devstack sudo[105358]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:22 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c1aeaf1a-df84-4028-a279-4de6bffbe832 tempest-CinderUnicodeTest-716392597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-db25e36b-d804-4411-9d29-c6efa913564d" returned: 0 in 0.305s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:22 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c1aeaf1a-df84-4028-a279-4de6bffbe832 tempest-CinderUnicodeTest-716392597 None] <== create_volume: return (901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:24:22 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c1aeaf1a-df84-4028-a279-4de6bffbe832 tempest-CinderUnicodeTest-716392597 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:24:22 devstack sudo[105367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-4e56ec2e-e54f-418a-9d46-c88569134970 Nov 02 10:24:22 devstack sudo[105367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:22 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c1aeaf1a-df84-4028-a279-4de6bffbe832 tempest-CinderUnicodeTest-716392597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3aefb727-52de-46f1-bd4a-66530dd14f5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db25e36b-d804-4411-9d29-c6efa913564d', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:24:22 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c1aeaf1a-df84-4028-a279-4de6bffbe832 tempest-CinderUnicodeTest-716392597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4aab15d-4830-4134-96eb-5eccf751d08a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:24:22 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-c1aeaf1a-df84-4028-a279-4de6bffbe832 tempest-CinderUnicodeTest-716392597 None] Volume volume-db25e36b-d804-4411-9d29-c6efa913564d (db25e36b-d804-4411-9d29-c6efa913564d): created successfully Nov 02 10:24:22 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c1aeaf1a-df84-4028-a279-4de6bffbe832 tempest-CinderUnicodeTest-716392597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4aab15d-4830-4134-96eb-5eccf751d08a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:24:22 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c1aeaf1a-df84-4028-a279-4de6bffbe832 tempest-CinderUnicodeTest-716392597 None] Flow 'volume_create_manager' (6bbe7784-5e52-4bba-862a-35509b9cf8a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:24:22 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-c1aeaf1a-df84-4028-a279-4de6bffbe832 tempest-CinderUnicodeTest-716392597 None] Created volume successfully. Nov 02 10:24:22 devstack sudo[105355]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:22 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a61ebc85-59b6-4162-bd83-cb02aaedf92c tempest-CreateVolumesFromSnapshotTest-1668273897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-902745cf-6e64-4c27-906c-6efba04100a6.17f9fd5d-64c1-4974-82c0-56a2b5ec4a32" returned: 0 in 0.434s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:22 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a61ebc85-59b6-4162-bd83-cb02aaedf92c tempest-CreateVolumesFromSnapshotTest-1668273897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-902745cf-6e64-4c27-906c-6efba04100a6.17f9fd5d-64c1-4974-82c0-56a2b5ec4a32 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:22 devstack sudo[105369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-902745cf-6e64-4c27-906c-6efba04100a6.17f9fd5d-64c1-4974-82c0-56a2b5ec4a32 Nov 02 10:24:22 devstack sudo[105369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:22 devstack sudo[105367]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:22 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-e0906e62-54f5-4870-a1ed-84ea47dfabc6 tempest-ProjectReaderTests-1337323374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-4e56ec2e-e54f-418a-9d46-c88569134970" returned: 0 in 0.279s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:22 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-e0906e62-54f5-4870-a1ed-84ea47dfabc6 tempest-ProjectReaderTests-1337323374 None] Lock "cinder-quobyte-4e56ec2e-e54f-418a-9d46-c88569134970" released by "delete_volume" :: held 0.761s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:24:22 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-e0906e62-54f5-4870-a1ed-84ea47dfabc6 tempest-ProjectReaderTests-1337323374 None] Created reservations ['c5c09aad-f76a-4584-beab-30a55cf15321', '648fb5fe-1b51-4402-89b4-b8e918ff929d', '4cafa052-49a1-4793-b1bf-40a3e34de686', 'f36db5d6-8f5b-4731-a7e0-ad5c1eceddbb'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:24:22 devstack sudo[105369]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:22 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a61ebc85-59b6-4162-bd83-cb02aaedf92c tempest-CreateVolumesFromSnapshotTest-1668273897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-902745cf-6e64-4c27-906c-6efba04100a6.17f9fd5d-64c1-4974-82c0-56a2b5ec4a32" returned: 0 in 0.267s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:22 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-a61ebc85-59b6-4162-bd83-cb02aaedf92c tempest-CreateVolumesFromSnapshotTest-1668273897 None] Lock "cinder-quobyte-17f9fd5d-64c1-4974-82c0-56a2b5ec4a32" released by "_delete_snapshot" :: held 1.672s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:24:22 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-a61ebc85-59b6-4162-bd83-cb02aaedf92c tempest-CreateVolumesFromSnapshotTest-1668273897 None] Lock "cinder-quobyte-902745cf-6e64-4c27-906c-6efba04100a6" released by "delete_snapshot" :: held 1.700s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:24:22 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-e0906e62-54f5-4870-a1ed-84ea47dfabc6 tempest-ProjectReaderTests-1337323374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:24:22 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-e0906e62-54f5-4870-a1ed-84ea47dfabc6 tempest-ProjectReaderTests-1337323374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:24:22 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-e0906e62-54f5-4870-a1ed-84ea47dfabc6 tempest-ProjectReaderTests-1337323374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:24:22 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-e0906e62-54f5-4870-a1ed-84ea47dfabc6 tempest-ProjectReaderTests-1337323374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:24:22 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-e0906e62-54f5-4870-a1ed-84ea47dfabc6 tempest-ProjectReaderTests-1337323374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:24:22 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-e0906e62-54f5-4870-a1ed-84ea47dfabc6 tempest-ProjectReaderTests-1337323374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:22 devstack sudo[105373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:24:22 devstack sudo[105373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:22 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-a61ebc85-59b6-4162-bd83-cb02aaedf92c tempest-CreateVolumesFromSnapshotTest-1668273897 None] Created reservations ['b9f010d1-0714-4852-9129-ad73fd79c6ef', 'e6d96451-ed0e-4f5f-b2f0-6db7da9c3c88', 'c9904563-009e-411e-9b35-470f9b06e595', '91b1f105-fd41-4584-b285-621416340515'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:24:23 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-a61ebc85-59b6-4162-bd83-cb02aaedf92c tempest-CreateVolumesFromSnapshotTest-1668273897 None] Delete snapshot completed successfully. Nov 02 10:24:23 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-a61ebc85-59b6-4162-bd83-cb02aaedf92c tempest-CreateVolumesFromSnapshotTest-1668273897 None] Lock "cinder-17f9fd5d-64c1-4974-82c0-56a2b5ec4a32-delete_snapshot" released by "delete_snapshot" :: held 1.875s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:24:23 devstack sudo[105373]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:23 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-e0906e62-54f5-4870-a1ed-84ea47dfabc6 tempest-ProjectReaderTests-1337323374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.265s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:23 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-e0906e62-54f5-4870-a1ed-84ea47dfabc6 tempest-ProjectReaderTests-1337323374 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:24:23 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-e0906e62-54f5-4870-a1ed-84ea47dfabc6 tempest-ProjectReaderTests-1337323374 None] Deleted volume successfully. Nov 02 10:24:23 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-e0906e62-54f5-4870-a1ed-84ea47dfabc6 tempest-ProjectReaderTests-1337323374 None] Lock "cinder-4e56ec2e-e54f-418a-9d46-c88569134970-delete_volume" released by "delete_volume" :: held 1.271s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:24:23 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-809ff891-7e11-4577-9f07-329ec1d8a272 tempest-CreateVolumesFromSnapshotTest-1668273897 None] Acquiring lock "cinder-902745cf-6e64-4c27-906c-6efba04100a6-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:24:23 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-809ff891-7e11-4577-9f07-329ec1d8a272 tempest-CreateVolumesFromSnapshotTest-1668273897 None] Lock "cinder-902745cf-6e64-4c27-906c-6efba04100a6-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:24:23 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-809ff891-7e11-4577-9f07-329ec1d8a272 tempest-CreateVolumesFromSnapshotTest-1668273897 None] Acquiring lock "cinder-quobyte-902745cf-6e64-4c27-906c-6efba04100a6" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:24:23 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-809ff891-7e11-4577-9f07-329ec1d8a272 tempest-CreateVolumesFromSnapshotTest-1668273897 None] Lock "cinder-quobyte-902745cf-6e64-4c27-906c-6efba04100a6" acquired by "delete_volume" :: waited 0.014s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:24:23 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[71b927f2-8761-45ed-a0d6-b07ec3e45997]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:24:23 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-809ff891-7e11-4577-9f07-329ec1d8a272 tempest-CreateVolumesFromSnapshotTest-1668273897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-902745cf-6e64-4c27-906c-6efba04100a6 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:23 devstack sudo[105376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-902745cf-6e64-4c27-906c-6efba04100a6 Nov 02 10:24:23 devstack sudo[105376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:23 devstack sudo[105376]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:23 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-809ff891-7e11-4577-9f07-329ec1d8a272 tempest-CreateVolumesFromSnapshotTest-1668273897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-902745cf-6e64-4c27-906c-6efba04100a6" returned: 0 in 0.397s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:23 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-809ff891-7e11-4577-9f07-329ec1d8a272 tempest-CreateVolumesFromSnapshotTest-1668273897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-902745cf-6e64-4c27-906c-6efba04100a6 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:23 devstack sudo[105382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-902745cf-6e64-4c27-906c-6efba04100a6 Nov 02 10:24:23 devstack sudo[105382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:24 devstack sudo[105382]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:24 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-809ff891-7e11-4577-9f07-329ec1d8a272 tempest-CreateVolumesFromSnapshotTest-1668273897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-902745cf-6e64-4c27-906c-6efba04100a6" returned: 0 in 0.312s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:24 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-809ff891-7e11-4577-9f07-329ec1d8a272 tempest-CreateVolumesFromSnapshotTest-1668273897 None] Lock "cinder-quobyte-902745cf-6e64-4c27-906c-6efba04100a6" released by "delete_volume" :: held 0.794s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:24:24 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ba0e246-890f-4d15-8ce6-eb5bb0e2c3a4 tempest-CinderUnicodeTest-716392597 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:24:24 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-6ba0e246-890f-4d15-8ce6-eb5bb0e2c3a4 tempest-CinderUnicodeTest-716392597 None] Flow 'volume_create_manager' (3234b392-5fe3-4cde-9577-01f833b3beb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:24:24 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-6ba0e246-890f-4d15-8ce6-eb5bb0e2c3a4 tempest-CinderUnicodeTest-716392597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e333daf-8484-4384-a014-f73c9e6565e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:24:24 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-6ba0e246-890f-4d15-8ce6-eb5bb0e2c3a4 tempest-CinderUnicodeTest-716392597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e333daf-8484-4384-a014-f73c9e6565e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:24:24Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1588394195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b8621b0-2c99-4568-9e2e-80b13772c6f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bc708121ba644278fff60fbb4a46ab4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:24:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:24:24Z,use_quota=True,user_id='5b24460d77c1417f8e4db4e87ca0e301',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:24:24 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-6ba0e246-890f-4d15-8ce6-eb5bb0e2c3a4 tempest-CinderUnicodeTest-716392597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a4a2085-48de-452f-9a19-da58efc9f211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:24:24 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-6ba0e246-890f-4d15-8ce6-eb5bb0e2c3a4 tempest-CinderUnicodeTest-716392597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a4a2085-48de-452f-9a19-da58efc9f211) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:24:24 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-6ba0e246-890f-4d15-8ce6-eb5bb0e2c3a4 tempest-CinderUnicodeTest-716392597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b1f72bc-d06d-4640-86eb-d554cc7b9099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:24:24 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-6ba0e246-890f-4d15-8ce6-eb5bb0e2c3a4 tempest-CinderUnicodeTest-716392597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b1f72bc-d06d-4640-86eb-d554cc7b9099) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b8621b0-2c99-4568-9e2e-80b13772c6f3', 'volume_name': 'volume-0b8621b0-2c99-4568-9e2e-80b13772c6f3', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:24:24 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-6ba0e246-890f-4d15-8ce6-eb5bb0e2c3a4 tempest-CinderUnicodeTest-716392597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c67626b-9ece-4555-ac26-9660a3bca12a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:24:24 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-6ba0e246-890f-4d15-8ce6-eb5bb0e2c3a4 tempest-CinderUnicodeTest-716392597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c67626b-9ece-4555-ac26-9660a3bca12a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:24:24 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-6ba0e246-890f-4d15-8ce6-eb5bb0e2c3a4 tempest-CinderUnicodeTest-716392597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2ecad73-5f06-49a4-b87f-44c127e985bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:24:24 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-6ba0e246-890f-4d15-8ce6-eb5bb0e2c3a4 tempest-CinderUnicodeTest-716392597 None] Volume 0b8621b0-2c99-4568-9e2e-80b13772c6f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b8621b0-2c99-4568-9e2e-80b13772c6f3', 'volume_size': 1} Nov 02 10:24:24 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-6ba0e246-890f-4d15-8ce6-eb5bb0e2c3a4 tempest-CinderUnicodeTest-716392597 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:24:24 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-6ba0e246-890f-4d15-8ce6-eb5bb0e2c3a4 tempest-CinderUnicodeTest-716392597 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:24:24 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-6ba0e246-890f-4d15-8ce6-eb5bb0e2c3a4 tempest-CinderUnicodeTest-716392597 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:24:24Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1588394195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b8621b0-2c99-4568-9e2e-80b13772c6f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bc708121ba644278fff60fbb4a46ab4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:24:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:24:24Z,use_quota=True,user_id='5b24460d77c1417f8e4db4e87ca0e301',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:24:24 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-6ba0e246-890f-4d15-8ce6-eb5bb0e2c3a4 tempest-CinderUnicodeTest-716392597 None] Creating volume 0b8621b0-2c99-4568-9e2e-80b13772c6f3 {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:24:24 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-6ba0e246-890f-4d15-8ce6-eb5bb0e2c3a4 tempest-CinderUnicodeTest-716392597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:24:24 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-6ba0e246-890f-4d15-8ce6-eb5bb0e2c3a4 tempest-CinderUnicodeTest-716392597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:24:24 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-6ba0e246-890f-4d15-8ce6-eb5bb0e2c3a4 tempest-CinderUnicodeTest-716392597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:24:24 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-6ba0e246-890f-4d15-8ce6-eb5bb0e2c3a4 tempest-CinderUnicodeTest-716392597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:24:24 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-6ba0e246-890f-4d15-8ce6-eb5bb0e2c3a4 tempest-CinderUnicodeTest-716392597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:24:24 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-6ba0e246-890f-4d15-8ce6-eb5bb0e2c3a4 tempest-CinderUnicodeTest-716392597 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:24:24 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-6ba0e246-890f-4d15-8ce6-eb5bb0e2c3a4 tempest-CinderUnicodeTest-716392597 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:24:24 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6ba0e246-890f-4d15-8ce6-eb5bb0e2c3a4 tempest-CinderUnicodeTest-716392597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-0b8621b0-2c99-4568-9e2e-80b13772c6f3 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:24 devstack sudo[105386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-0b8621b0-2c99-4568-9e2e-80b13772c6f3 1073741824 Nov 02 10:24:24 devstack sudo[105386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:24 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-809ff891-7e11-4577-9f07-329ec1d8a272 tempest-CreateVolumesFromSnapshotTest-1668273897 None] Created reservations ['0961f352-c0ea-47b6-aa60-cabf7401bec2', 'b20cc482-e7e7-44d5-bb31-0649f089c92c', 'f4f210a0-d7c9-498c-8995-520bc47da71c', '44c4f192-7478-4dea-8b51-d50ca7411582'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:24:24 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-809ff891-7e11-4577-9f07-329ec1d8a272 tempest-CreateVolumesFromSnapshotTest-1668273897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:24:24 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-809ff891-7e11-4577-9f07-329ec1d8a272 tempest-CreateVolumesFromSnapshotTest-1668273897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:24:24 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-809ff891-7e11-4577-9f07-329ec1d8a272 tempest-CreateVolumesFromSnapshotTest-1668273897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:24:24 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-809ff891-7e11-4577-9f07-329ec1d8a272 tempest-CreateVolumesFromSnapshotTest-1668273897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:24:24 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-809ff891-7e11-4577-9f07-329ec1d8a272 tempest-CreateVolumesFromSnapshotTest-1668273897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:24:24 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-809ff891-7e11-4577-9f07-329ec1d8a272 tempest-CreateVolumesFromSnapshotTest-1668273897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:24 devstack sudo[105389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:24:24 devstack sudo[105389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:24 devstack sudo[105389]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:24 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-809ff891-7e11-4577-9f07-329ec1d8a272 tempest-CreateVolumesFromSnapshotTest-1668273897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.315s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:24 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-809ff891-7e11-4577-9f07-329ec1d8a272 tempest-CreateVolumesFromSnapshotTest-1668273897 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:24:24 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-809ff891-7e11-4577-9f07-329ec1d8a272 tempest-CreateVolumesFromSnapshotTest-1668273897 None] Deleted volume successfully. Nov 02 10:24:24 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-809ff891-7e11-4577-9f07-329ec1d8a272 tempest-CreateVolumesFromSnapshotTest-1668273897 None] Lock "cinder-902745cf-6e64-4c27-906c-6efba04100a6-delete_volume" released by "delete_volume" :: held 1.510s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:24:24 devstack sudo[105386]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:24 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6ba0e246-890f-4d15-8ce6-eb5bb0e2c3a4 tempest-CinderUnicodeTest-716392597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-0b8621b0-2c99-4568-9e2e-80b13772c6f3 1073741824" returned: 0 in 0.615s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:25 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6ba0e246-890f-4d15-8ce6-eb5bb0e2c3a4 tempest-CinderUnicodeTest-716392597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-0b8621b0-2c99-4568-9e2e-80b13772c6f3 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:25 devstack sudo[105397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-0b8621b0-2c99-4568-9e2e-80b13772c6f3 Nov 02 10:24:25 devstack sudo[105397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:25 devstack sudo[105397]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:25 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6ba0e246-890f-4d15-8ce6-eb5bb0e2c3a4 tempest-CinderUnicodeTest-716392597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-0b8621b0-2c99-4568-9e2e-80b13772c6f3" returned: 0 in 0.272s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:25 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-6ba0e246-890f-4d15-8ce6-eb5bb0e2c3a4 tempest-CinderUnicodeTest-716392597 None] <== create_volume: return (937ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:24:25 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-6ba0e246-890f-4d15-8ce6-eb5bb0e2c3a4 tempest-CinderUnicodeTest-716392597 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.942s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:24:25 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-6ba0e246-890f-4d15-8ce6-eb5bb0e2c3a4 tempest-CinderUnicodeTest-716392597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2ecad73-5f06-49a4-b87f-44c127e985bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b8621b0-2c99-4568-9e2e-80b13772c6f3', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:24:25 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-6ba0e246-890f-4d15-8ce6-eb5bb0e2c3a4 tempest-CinderUnicodeTest-716392597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (878f6cf7-0284-4999-a30f-d555152fd047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:24:25 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-6ba0e246-890f-4d15-8ce6-eb5bb0e2c3a4 tempest-CinderUnicodeTest-716392597 None] Volume volume-0b8621b0-2c99-4568-9e2e-80b13772c6f3 (0b8621b0-2c99-4568-9e2e-80b13772c6f3): created successfully Nov 02 10:24:25 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-6ba0e246-890f-4d15-8ce6-eb5bb0e2c3a4 tempest-CinderUnicodeTest-716392597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (878f6cf7-0284-4999-a30f-d555152fd047) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:24:25 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-6ba0e246-890f-4d15-8ce6-eb5bb0e2c3a4 tempest-CinderUnicodeTest-716392597 None] Flow 'volume_create_manager' (3234b392-5fe3-4cde-9577-01f833b3beb4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:24:25 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-6ba0e246-890f-4d15-8ce6-eb5bb0e2c3a4 tempest-CinderUnicodeTest-716392597 None] Created volume successfully. Nov 02 10:24:26 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-50e168e8-c2ec-45c1-ac19-9e7cd6ae9ae9 tempest-CinderUnicodeTest-716392597 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:24:26 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-50e168e8-c2ec-45c1-ac19-9e7cd6ae9ae9 tempest-CinderUnicodeTest-716392597 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:24:26 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-50e168e8-c2ec-45c1-ac19-9e7cd6ae9ae9 tempest-CinderUnicodeTest-716392597 None] Creating offline snapshot ebc3bd34-d1f8-4dad-89bc-1146ff3e73e8 of volume 0b8621b0-2c99-4568-9e2e-80b13772c6f3 {{(pid=86890) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:24:26 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[b21bbc06-dcf4-4e17-8483-56f1abd6726c]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:24:26 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-50e168e8-c2ec-45c1-ac19-9e7cd6ae9ae9 tempest-CinderUnicodeTest-716392597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-0b8621b0-2c99-4568-9e2e-80b13772c6f3 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:26 devstack sudo[105400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-0b8621b0-2c99-4568-9e2e-80b13772c6f3 Nov 02 10:24:26 devstack sudo[105400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:27 devstack sudo[105400]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:27 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-50e168e8-c2ec-45c1-ac19-9e7cd6ae9ae9 tempest-CinderUnicodeTest-716392597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-0b8621b0-2c99-4568-9e2e-80b13772c6f3" returned: 0 in 0.403s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:27 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-50e168e8-c2ec-45c1-ac19-9e7cd6ae9ae9 tempest-CinderUnicodeTest-716392597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-0b8621b0-2c99-4568-9e2e-80b13772c6f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-0b8621b0-2c99-4568-9e2e-80b13772c6f3.ebc3bd34-d1f8-4dad-89bc-1146ff3e73e8 1G {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:27 devstack sudo[105405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-0b8621b0-2c99-4568-9e2e-80b13772c6f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-0b8621b0-2c99-4568-9e2e-80b13772c6f3.ebc3bd34-d1f8-4dad-89bc-1146ff3e73e8 1G Nov 02 10:24:27 devstack sudo[105405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:27 devstack sudo[105405]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:27 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-50e168e8-c2ec-45c1-ac19-9e7cd6ae9ae9 tempest-CinderUnicodeTest-716392597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-0b8621b0-2c99-4568-9e2e-80b13772c6f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-0b8621b0-2c99-4568-9e2e-80b13772c6f3.ebc3bd34-d1f8-4dad-89bc-1146ff3e73e8 1G" returned: 0 in 0.532s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:27 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-50e168e8-c2ec-45c1-ac19-9e7cd6ae9ae9 tempest-CinderUnicodeTest-716392597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b8621b0-2c99-4568-9e2e-80b13772c6f3 -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-0b8621b0-2c99-4568-9e2e-80b13772c6f3.ebc3bd34-d1f8-4dad-89bc-1146ff3e73e8 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:27 devstack sudo[105411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b8621b0-2c99-4568-9e2e-80b13772c6f3 -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-0b8621b0-2c99-4568-9e2e-80b13772c6f3.ebc3bd34-d1f8-4dad-89bc-1146ff3e73e8 Nov 02 10:24:27 devstack sudo[105411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:27 devstack sudo[105411]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:28 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-50e168e8-c2ec-45c1-ac19-9e7cd6ae9ae9 tempest-CinderUnicodeTest-716392597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b8621b0-2c99-4568-9e2e-80b13772c6f3 -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-0b8621b0-2c99-4568-9e2e-80b13772c6f3.ebc3bd34-d1f8-4dad-89bc-1146ff3e73e8" returned: 0 in 0.338s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:28 devstack cinder-volume[86890]: WARNING cinder.volume.drivers.remotefs [None req-50e168e8-c2ec-45c1-ac19-9e7cd6ae9ae9 tempest-CinderUnicodeTest-716392597 None] /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-0b8621b0-2c99-4568-9e2e-80b13772c6f3.ebc3bd34-d1f8-4dad-89bc-1146ff3e73e8 is being set with open permissions: ugo+rw Nov 02 10:24:28 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-50e168e8-c2ec-45c1-ac19-9e7cd6ae9ae9 tempest-CinderUnicodeTest-716392597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-0b8621b0-2c99-4568-9e2e-80b13772c6f3.ebc3bd34-d1f8-4dad-89bc-1146ff3e73e8 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:28 devstack sudo[105417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-0b8621b0-2c99-4568-9e2e-80b13772c6f3.ebc3bd34-d1f8-4dad-89bc-1146ff3e73e8 Nov 02 10:24:28 devstack sudo[105417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:28 devstack sudo[105417]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:28 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-50e168e8-c2ec-45c1-ac19-9e7cd6ae9ae9 tempest-CinderUnicodeTest-716392597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-0b8621b0-2c99-4568-9e2e-80b13772c6f3.ebc3bd34-d1f8-4dad-89bc-1146ff3e73e8" returned: 0 in 0.296s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:28 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-50e168e8-c2ec-45c1-ac19-9e7cd6ae9ae9 tempest-CinderUnicodeTest-716392597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-0b8621b0-2c99-4568-9e2e-80b13772c6f3.info {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:28 devstack sudo[105420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-0b8621b0-2c99-4568-9e2e-80b13772c6f3.info Nov 02 10:24:28 devstack sudo[105420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:28 devstack sudo[105420]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:28 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-50e168e8-c2ec-45c1-ac19-9e7cd6ae9ae9 tempest-CinderUnicodeTest-716392597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-0b8621b0-2c99-4568-9e2e-80b13772c6f3.info" returned: 0 in 0.307s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:28 devstack cinder-volume[86890]: WARNING cinder.volume.drivers.remotefs [None req-50e168e8-c2ec-45c1-ac19-9e7cd6ae9ae9 tempest-CinderUnicodeTest-716392597 None] /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-0b8621b0-2c99-4568-9e2e-80b13772c6f3.info is being set with open permissions: ugo+rw Nov 02 10:24:28 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-50e168e8-c2ec-45c1-ac19-9e7cd6ae9ae9 tempest-CinderUnicodeTest-716392597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-0b8621b0-2c99-4568-9e2e-80b13772c6f3.info {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:28 devstack sudo[105423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-0b8621b0-2c99-4568-9e2e-80b13772c6f3.info Nov 02 10:24:28 devstack sudo[105423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:28 devstack sudo[105423]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:28 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-50e168e8-c2ec-45c1-ac19-9e7cd6ae9ae9 tempest-CinderUnicodeTest-716392597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-0b8621b0-2c99-4568-9e2e-80b13772c6f3.info" returned: 0 in 0.282s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:28 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-50e168e8-c2ec-45c1-ac19-9e7cd6ae9ae9 tempest-CinderUnicodeTest-716392597 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.283s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:24:28 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-50e168e8-c2ec-45c1-ac19-9e7cd6ae9ae9 tempest-CinderUnicodeTest-716392597 None] Create snapshot completed successfully Nov 02 10:24:29 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-73440350-8c34-4703-9004-dc8bcf3e15f6 tempest-CinderUnicodeTest-716392597 None] Acquiring lock "cinder-ebc3bd34-d1f8-4dad-89bc-1146ff3e73e8-delete_snapshot" by "delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:24:29 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-73440350-8c34-4703-9004-dc8bcf3e15f6 tempest-CinderUnicodeTest-716392597 None] Lock "cinder-ebc3bd34-d1f8-4dad-89bc-1146ff3e73e8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:24:29 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-73440350-8c34-4703-9004-dc8bcf3e15f6 tempest-CinderUnicodeTest-716392597 None] Acquiring lock "cinder-quobyte-0b8621b0-2c99-4568-9e2e-80b13772c6f3" by "delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:24:29 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-73440350-8c34-4703-9004-dc8bcf3e15f6 tempest-CinderUnicodeTest-716392597 None] Lock "cinder-quobyte-0b8621b0-2c99-4568-9e2e-80b13772c6f3" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:24:29 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-73440350-8c34-4703-9004-dc8bcf3e15f6 tempest-CinderUnicodeTest-716392597 None] Acquiring lock "cinder-quobyte-ebc3bd34-d1f8-4dad-89bc-1146ff3e73e8" by "_delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:24:29 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-73440350-8c34-4703-9004-dc8bcf3e15f6 tempest-CinderUnicodeTest-716392597 None] Lock "cinder-quobyte-ebc3bd34-d1f8-4dad-89bc-1146ff3e73e8" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:24:29 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-73440350-8c34-4703-9004-dc8bcf3e15f6 tempest-CinderUnicodeTest-716392597 None] Deleting offline snapshot ebc3bd34-d1f8-4dad-89bc-1146ff3e73e8 of volume 0b8621b0-2c99-4568-9e2e-80b13772c6f3 {{(pid=86890) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:24:29 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-73440350-8c34-4703-9004-dc8bcf3e15f6 tempest-CinderUnicodeTest-716392597 None] snapshot_file for this snap is: volume-0b8621b0-2c99-4568-9e2e-80b13772c6f3.ebc3bd34-d1f8-4dad-89bc-1146ff3e73e8 {{(pid=86890) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:24:30 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e57d768-671b-4db8-bcd1-17b24ddcdcb4]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:24:30 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-73440350-8c34-4703-9004-dc8bcf3e15f6 tempest-CinderUnicodeTest-716392597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-0b8621b0-2c99-4568-9e2e-80b13772c6f3.ebc3bd34-d1f8-4dad-89bc-1146ff3e73e8 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:30 devstack sudo[105426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-0b8621b0-2c99-4568-9e2e-80b13772c6f3.ebc3bd34-d1f8-4dad-89bc-1146ff3e73e8 Nov 02 10:24:30 devstack sudo[105426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:30 devstack sudo[105426]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:30 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-73440350-8c34-4703-9004-dc8bcf3e15f6 tempest-CinderUnicodeTest-716392597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-0b8621b0-2c99-4568-9e2e-80b13772c6f3.ebc3bd34-d1f8-4dad-89bc-1146ff3e73e8" returned: 0 in 0.407s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:30 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-73440350-8c34-4703-9004-dc8bcf3e15f6 tempest-CinderUnicodeTest-716392597 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0b8621b0-2c99-4568-9e2e-80b13772c6f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86890) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:24:30 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[fffad270-5704-42ea-83f7-b9a831d6dce1]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:24:30 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-73440350-8c34-4703-9004-dc8bcf3e15f6 tempest-CinderUnicodeTest-716392597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-0b8621b0-2c99-4568-9e2e-80b13772c6f3 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:30 devstack sudo[105432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-0b8621b0-2c99-4568-9e2e-80b13772c6f3 Nov 02 10:24:30 devstack sudo[105432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:30 devstack sudo[105432]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:30 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-73440350-8c34-4703-9004-dc8bcf3e15f6 tempest-CinderUnicodeTest-716392597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-0b8621b0-2c99-4568-9e2e-80b13772c6f3" returned: 0 in 0.419s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:30 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-73440350-8c34-4703-9004-dc8bcf3e15f6 tempest-CinderUnicodeTest-716392597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-0b8621b0-2c99-4568-9e2e-80b13772c6f3.ebc3bd34-d1f8-4dad-89bc-1146ff3e73e8 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:30 devstack sudo[105437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-0b8621b0-2c99-4568-9e2e-80b13772c6f3.ebc3bd34-d1f8-4dad-89bc-1146ff3e73e8 Nov 02 10:24:30 devstack sudo[105437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:31 devstack sudo[105437]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:31 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-73440350-8c34-4703-9004-dc8bcf3e15f6 tempest-CinderUnicodeTest-716392597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-0b8621b0-2c99-4568-9e2e-80b13772c6f3.ebc3bd34-d1f8-4dad-89bc-1146ff3e73e8" returned: 0 in 0.443s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:31 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-73440350-8c34-4703-9004-dc8bcf3e15f6 tempest-CinderUnicodeTest-716392597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-0b8621b0-2c99-4568-9e2e-80b13772c6f3.ebc3bd34-d1f8-4dad-89bc-1146ff3e73e8 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:31 devstack sudo[105443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-0b8621b0-2c99-4568-9e2e-80b13772c6f3.ebc3bd34-d1f8-4dad-89bc-1146ff3e73e8 Nov 02 10:24:31 devstack sudo[105443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:31 devstack sudo[105443]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:31 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-73440350-8c34-4703-9004-dc8bcf3e15f6 tempest-CinderUnicodeTest-716392597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-0b8621b0-2c99-4568-9e2e-80b13772c6f3.ebc3bd34-d1f8-4dad-89bc-1146ff3e73e8" returned: 0 in 0.299s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:31 devstack cinder-volume[86890]: DEBUG dbcounter [-] [86890] Writing DB stats cinder:SELECT=207,cinder:UPDATE=280,cinder:INSERT=72,cinder:DELETE=28 {{(pid=86890) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:24:31 devstack cinder-volume[86890]: DEBUG dbcounter [-] [86890] Writing DB stats cinder:UPDATE=275,cinder:SELECT=194,cinder:DELETE=23,cinder:INSERT=75 {{(pid=86890) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:24:31 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-73440350-8c34-4703-9004-dc8bcf3e15f6 tempest-CinderUnicodeTest-716392597 None] Lock "cinder-quobyte-ebc3bd34-d1f8-4dad-89bc-1146ff3e73e8" released by "_delete_snapshot" :: held 1.706s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:24:31 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-73440350-8c34-4703-9004-dc8bcf3e15f6 tempest-CinderUnicodeTest-716392597 None] Lock "cinder-quobyte-0b8621b0-2c99-4568-9e2e-80b13772c6f3" released by "delete_snapshot" :: held 1.740s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:24:31 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-73440350-8c34-4703-9004-dc8bcf3e15f6 tempest-CinderUnicodeTest-716392597 None] Created reservations ['04571a1c-3001-48ce-9704-dbf4d74311bb', '61dfa612-3b11-4a27-8a04-329191a22390', '80f3fd5c-6658-47b9-9ea2-c7cd9c5122af', '86c328c9-3962-41d6-848f-55750f7104fa'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:24:31 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-73440350-8c34-4703-9004-dc8bcf3e15f6 tempest-CinderUnicodeTest-716392597 None] Delete snapshot completed successfully. Nov 02 10:24:31 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-73440350-8c34-4703-9004-dc8bcf3e15f6 tempest-CinderUnicodeTest-716392597 None] Lock "cinder-ebc3bd34-d1f8-4dad-89bc-1146ff3e73e8-delete_snapshot" released by "delete_snapshot" :: held 1.909s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:24:32 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-65c18f14-729c-4179-84c9-fa6f19298892 tempest-CinderUnicodeTest-716392597 None] Acquiring lock "cinder-0b8621b0-2c99-4568-9e2e-80b13772c6f3-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:24:32 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-65c18f14-729c-4179-84c9-fa6f19298892 tempest-CinderUnicodeTest-716392597 None] Lock "cinder-0b8621b0-2c99-4568-9e2e-80b13772c6f3-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:24:32 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-65c18f14-729c-4179-84c9-fa6f19298892 tempest-CinderUnicodeTest-716392597 None] Acquiring lock "cinder-quobyte-0b8621b0-2c99-4568-9e2e-80b13772c6f3" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:24:32 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-65c18f14-729c-4179-84c9-fa6f19298892 tempest-CinderUnicodeTest-716392597 None] Lock "cinder-quobyte-0b8621b0-2c99-4568-9e2e-80b13772c6f3" acquired by "delete_volume" :: waited 0.026s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:24:32 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[4441b80b-d82e-43de-a3bc-c9437e3aa2a3]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:24:32 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-65c18f14-729c-4179-84c9-fa6f19298892 tempest-CinderUnicodeTest-716392597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-0b8621b0-2c99-4568-9e2e-80b13772c6f3 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:32 devstack sudo[105446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-0b8621b0-2c99-4568-9e2e-80b13772c6f3 Nov 02 10:24:32 devstack sudo[105446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:32 devstack sudo[105446]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:32 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-65c18f14-729c-4179-84c9-fa6f19298892 tempest-CinderUnicodeTest-716392597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-0b8621b0-2c99-4568-9e2e-80b13772c6f3" returned: 0 in 0.435s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:32 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-65c18f14-729c-4179-84c9-fa6f19298892 tempest-CinderUnicodeTest-716392597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-0b8621b0-2c99-4568-9e2e-80b13772c6f3 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:32 devstack sudo[105451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-0b8621b0-2c99-4568-9e2e-80b13772c6f3 Nov 02 10:24:32 devstack sudo[105451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:32 devstack sudo[105451]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:32 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-65c18f14-729c-4179-84c9-fa6f19298892 tempest-CinderUnicodeTest-716392597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-0b8621b0-2c99-4568-9e2e-80b13772c6f3" returned: 0 in 0.278s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:33 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-65c18f14-729c-4179-84c9-fa6f19298892 tempest-CinderUnicodeTest-716392597 None] Lock "cinder-quobyte-0b8621b0-2c99-4568-9e2e-80b13772c6f3" released by "delete_volume" :: held 0.810s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:24:33 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-65c18f14-729c-4179-84c9-fa6f19298892 tempest-CinderUnicodeTest-716392597 None] Created reservations ['8ae65f31-2975-46d1-a336-5033d918cfbd', '2efcb73f-e54e-4f06-ac41-aab61e04c20b', '9e7201d1-49ea-436e-8da9-d2fbe2f5e128', '63220ddb-5677-4650-a2e2-a3d92a53b1c0'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:24:33 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-65c18f14-729c-4179-84c9-fa6f19298892 tempest-CinderUnicodeTest-716392597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:24:33 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-65c18f14-729c-4179-84c9-fa6f19298892 tempest-CinderUnicodeTest-716392597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:24:33 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-65c18f14-729c-4179-84c9-fa6f19298892 tempest-CinderUnicodeTest-716392597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:24:33 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-65c18f14-729c-4179-84c9-fa6f19298892 tempest-CinderUnicodeTest-716392597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:24:33 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-65c18f14-729c-4179-84c9-fa6f19298892 tempest-CinderUnicodeTest-716392597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:24:33 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-65c18f14-729c-4179-84c9-fa6f19298892 tempest-CinderUnicodeTest-716392597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:33 devstack sudo[105454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:24:33 devstack sudo[105454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:33 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-789837f4-d295-4e1c-a686-af5deb0c0a6d tempest-CinderUnicodeTest-716392597 None] Acquiring lock "cinder-db25e36b-d804-4411-9d29-c6efa913564d-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:24:33 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-789837f4-d295-4e1c-a686-af5deb0c0a6d tempest-CinderUnicodeTest-716392597 None] Lock "cinder-db25e36b-d804-4411-9d29-c6efa913564d-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:24:33 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-789837f4-d295-4e1c-a686-af5deb0c0a6d tempest-CinderUnicodeTest-716392597 None] Acquiring lock "cinder-quobyte-db25e36b-d804-4411-9d29-c6efa913564d" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:24:33 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-789837f4-d295-4e1c-a686-af5deb0c0a6d tempest-CinderUnicodeTest-716392597 None] Lock "cinder-quobyte-db25e36b-d804-4411-9d29-c6efa913564d" acquired by "delete_volume" :: waited 0.015s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:24:33 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[97f08943-2465-4650-94be-4e0b31a9c917]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:24:33 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-789837f4-d295-4e1c-a686-af5deb0c0a6d tempest-CinderUnicodeTest-716392597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-db25e36b-d804-4411-9d29-c6efa913564d {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:33 devstack sudo[105454]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:33 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-65c18f14-729c-4179-84c9-fa6f19298892 tempest-CinderUnicodeTest-716392597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.299s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:33 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-65c18f14-729c-4179-84c9-fa6f19298892 tempest-CinderUnicodeTest-716392597 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:24:33 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-65c18f14-729c-4179-84c9-fa6f19298892 tempest-CinderUnicodeTest-716392597 None] Deleted volume successfully. Nov 02 10:24:33 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-65c18f14-729c-4179-84c9-fa6f19298892 tempest-CinderUnicodeTest-716392597 None] Lock "cinder-0b8621b0-2c99-4568-9e2e-80b13772c6f3-delete_volume" released by "delete_volume" :: held 1.378s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:24:33 devstack sudo[105457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-db25e36b-d804-4411-9d29-c6efa913564d Nov 02 10:24:33 devstack sudo[105457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:33 devstack sudo[105457]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:33 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-789837f4-d295-4e1c-a686-af5deb0c0a6d tempest-CinderUnicodeTest-716392597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-db25e36b-d804-4411-9d29-c6efa913564d" returned: 0 in 0.461s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:33 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-789837f4-d295-4e1c-a686-af5deb0c0a6d tempest-CinderUnicodeTest-716392597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-db25e36b-d804-4411-9d29-c6efa913564d {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:33 devstack sudo[105462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-db25e36b-d804-4411-9d29-c6efa913564d Nov 02 10:24:33 devstack sudo[105462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:33 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-649f08a4-fb07-42f0-b649-cf4de23e7d5b tempest-ProjectMemberTests-406093346 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:24:34 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-649f08a4-fb07-42f0-b649-cf4de23e7d5b tempest-ProjectMemberTests-406093346 None] Flow 'volume_create_manager' (2cf2b934-180d-46e6-97fa-0d3b891a7f1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:24:34 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-649f08a4-fb07-42f0-b649-cf4de23e7d5b tempest-ProjectMemberTests-406093346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83c68efe-27ad-499d-9234-8d8051752a52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:24:34 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-649f08a4-fb07-42f0-b649-cf4de23e7d5b tempest-ProjectMemberTests-406093346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83c68efe-27ad-499d-9234-8d8051752a52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:24:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2135183890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc2986e2-1213-4696-a831-e107982064e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='639ad964aa1b416eb473afb3c18dd4e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:24:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:24:34Z,use_quota=True,user_id='076db3d85c064198aa1722b31937515d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:24:34 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-649f08a4-fb07-42f0-b649-cf4de23e7d5b tempest-ProjectMemberTests-406093346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a047d14b-84a7-4734-a0ca-53e0101f6fce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:24:34 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-649f08a4-fb07-42f0-b649-cf4de23e7d5b tempest-ProjectMemberTests-406093346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a047d14b-84a7-4734-a0ca-53e0101f6fce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:24:34 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-649f08a4-fb07-42f0-b649-cf4de23e7d5b tempest-ProjectMemberTests-406093346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9901e583-3afe-4a01-a271-6d9add1cfba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:24:34 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-649f08a4-fb07-42f0-b649-cf4de23e7d5b tempest-ProjectMemberTests-406093346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9901e583-3afe-4a01-a271-6d9add1cfba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc2986e2-1213-4696-a831-e107982064e1', 'volume_name': 'volume-fc2986e2-1213-4696-a831-e107982064e1', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:24:34 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-649f08a4-fb07-42f0-b649-cf4de23e7d5b tempest-ProjectMemberTests-406093346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e96e9e3f-b166-4617-8643-433a42887817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:24:34 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-649f08a4-fb07-42f0-b649-cf4de23e7d5b tempest-ProjectMemberTests-406093346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e96e9e3f-b166-4617-8643-433a42887817) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:24:34 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-649f08a4-fb07-42f0-b649-cf4de23e7d5b tempest-ProjectMemberTests-406093346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19cd85a6-f8fb-40c8-87f2-e24a83ad46e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:24:34 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-649f08a4-fb07-42f0-b649-cf4de23e7d5b tempest-ProjectMemberTests-406093346 None] Volume fc2986e2-1213-4696-a831-e107982064e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc2986e2-1213-4696-a831-e107982064e1', 'volume_size': 1} Nov 02 10:24:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-649f08a4-fb07-42f0-b649-cf4de23e7d5b tempest-ProjectMemberTests-406093346 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:24:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-649f08a4-fb07-42f0-b649-cf4de23e7d5b tempest-ProjectMemberTests-406093346 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:24:34 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-649f08a4-fb07-42f0-b649-cf4de23e7d5b tempest-ProjectMemberTests-406093346 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:24:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2135183890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc2986e2-1213-4696-a831-e107982064e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='639ad964aa1b416eb473afb3c18dd4e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:24:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:24:34Z,use_quota=True,user_id='076db3d85c064198aa1722b31937515d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:24:34 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-649f08a4-fb07-42f0-b649-cf4de23e7d5b tempest-ProjectMemberTests-406093346 None] Creating volume fc2986e2-1213-4696-a831-e107982064e1 {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:24:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-649f08a4-fb07-42f0-b649-cf4de23e7d5b tempest-ProjectMemberTests-406093346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:24:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-649f08a4-fb07-42f0-b649-cf4de23e7d5b tempest-ProjectMemberTests-406093346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:24:34 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-649f08a4-fb07-42f0-b649-cf4de23e7d5b tempest-ProjectMemberTests-406093346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:24:34 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-649f08a4-fb07-42f0-b649-cf4de23e7d5b tempest-ProjectMemberTests-406093346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:24:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-649f08a4-fb07-42f0-b649-cf4de23e7d5b tempest-ProjectMemberTests-406093346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:24:34 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-649f08a4-fb07-42f0-b649-cf4de23e7d5b tempest-ProjectMemberTests-406093346 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:24:34 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-649f08a4-fb07-42f0-b649-cf4de23e7d5b tempest-ProjectMemberTests-406093346 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:24:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-649f08a4-fb07-42f0-b649-cf4de23e7d5b tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-fc2986e2-1213-4696-a831-e107982064e1 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:34 devstack sudo[105465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-fc2986e2-1213-4696-a831-e107982064e1 1073741824 Nov 02 10:24:34 devstack sudo[105465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:34 devstack sudo[105462]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-789837f4-d295-4e1c-a686-af5deb0c0a6d tempest-CinderUnicodeTest-716392597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-db25e36b-d804-4411-9d29-c6efa913564d" returned: 0 in 0.280s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:34 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-789837f4-d295-4e1c-a686-af5deb0c0a6d tempest-CinderUnicodeTest-716392597 None] Lock "cinder-quobyte-db25e36b-d804-4411-9d29-c6efa913564d" released by "delete_volume" :: held 0.806s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:24:34 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-789837f4-d295-4e1c-a686-af5deb0c0a6d tempest-CinderUnicodeTest-716392597 None] Created reservations ['6c430842-53a9-43d1-a123-579f48c4dd46', '19e30672-a973-4956-b05d-2a48f1245778', 'f2be4836-7183-4057-95db-beb66290e971', '816a32d8-02c5-4009-b209-fb714513f27c'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:24:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-789837f4-d295-4e1c-a686-af5deb0c0a6d tempest-CinderUnicodeTest-716392597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:24:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-789837f4-d295-4e1c-a686-af5deb0c0a6d tempest-CinderUnicodeTest-716392597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:24:34 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-789837f4-d295-4e1c-a686-af5deb0c0a6d tempest-CinderUnicodeTest-716392597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:24:34 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-789837f4-d295-4e1c-a686-af5deb0c0a6d tempest-CinderUnicodeTest-716392597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:24:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-789837f4-d295-4e1c-a686-af5deb0c0a6d tempest-CinderUnicodeTest-716392597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:24:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-789837f4-d295-4e1c-a686-af5deb0c0a6d tempest-CinderUnicodeTest-716392597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:34 devstack sudo[105468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:24:34 devstack sudo[105468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:34 devstack sudo[105465]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-649f08a4-fb07-42f0-b649-cf4de23e7d5b tempest-ProjectMemberTests-406093346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-fc2986e2-1213-4696-a831-e107982064e1 1073741824" returned: 0 in 0.535s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:34 devstack sudo[105468]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-789837f4-d295-4e1c-a686-af5deb0c0a6d tempest-CinderUnicodeTest-716392597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.311s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:34 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-789837f4-d295-4e1c-a686-af5deb0c0a6d tempest-CinderUnicodeTest-716392597 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:24:34 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-789837f4-d295-4e1c-a686-af5deb0c0a6d tempest-CinderUnicodeTest-716392597 None] Deleted volume successfully. Nov 02 10:24:34 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-789837f4-d295-4e1c-a686-af5deb0c0a6d tempest-CinderUnicodeTest-716392597 None] Lock "cinder-db25e36b-d804-4411-9d29-c6efa913564d-delete_volume" released by "delete_volume" :: held 1.354s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:24:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-649f08a4-fb07-42f0-b649-cf4de23e7d5b tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-fc2986e2-1213-4696-a831-e107982064e1 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:34 devstack sudo[105475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-fc2986e2-1213-4696-a831-e107982064e1 Nov 02 10:24:34 devstack sudo[105475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:34 devstack cinder-volume[86890]: DEBUG oslo_service.periodic_task [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86890) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:24:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:24:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:24:34 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:24:34 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:24:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:24:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:34 devstack sudo[105477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:24:34 devstack sudo[105477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:34 devstack sudo[105475]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-649f08a4-fb07-42f0-b649-cf4de23e7d5b tempest-ProjectMemberTests-406093346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-fc2986e2-1213-4696-a831-e107982064e1" returned: 0 in 0.294s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:34 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-649f08a4-fb07-42f0-b649-cf4de23e7d5b tempest-ProjectMemberTests-406093346 None] <== create_volume: return (893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:24:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-649f08a4-fb07-42f0-b649-cf4de23e7d5b tempest-ProjectMemberTests-406093346 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:24:34 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-649f08a4-fb07-42f0-b649-cf4de23e7d5b tempest-ProjectMemberTests-406093346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19cd85a6-f8fb-40c8-87f2-e24a83ad46e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc2986e2-1213-4696-a831-e107982064e1', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:24:34 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-649f08a4-fb07-42f0-b649-cf4de23e7d5b tempest-ProjectMemberTests-406093346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5fb2c8a-b5de-4c61-8c2b-79307fb64531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:24:35 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-649f08a4-fb07-42f0-b649-cf4de23e7d5b tempest-ProjectMemberTests-406093346 None] Volume volume-fc2986e2-1213-4696-a831-e107982064e1 (fc2986e2-1213-4696-a831-e107982064e1): created successfully Nov 02 10:24:35 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-649f08a4-fb07-42f0-b649-cf4de23e7d5b tempest-ProjectMemberTests-406093346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5fb2c8a-b5de-4c61-8c2b-79307fb64531) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:24:35 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-649f08a4-fb07-42f0-b649-cf4de23e7d5b tempest-ProjectMemberTests-406093346 None] Flow 'volume_create_manager' (2cf2b934-180d-46e6-97fa-0d3b891a7f1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:24:35 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-649f08a4-fb07-42f0-b649-cf4de23e7d5b tempest-ProjectMemberTests-406093346 None] Created volume successfully. Nov 02 10:24:35 devstack sudo[105477]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:35 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.293s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:35 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:24:35 devstack cinder-volume[86890]: DEBUG oslo_service.periodic_task [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Running periodic task VolumeManager._thread_info {{(pid=86890) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:24:35 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] thread count: 29 {{(pid=86890) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:24:35 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] thread info: [<_MainThread(MainThread, started 133913319395456)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86890) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:24:36 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-578e4eb6-1b81-4a5d-8892-a4ee022b39a4 tempest-ProjectMemberTests-406093346 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:24:36 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-578e4eb6-1b81-4a5d-8892-a4ee022b39a4 tempest-ProjectMemberTests-406093346 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:24:36 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-578e4eb6-1b81-4a5d-8892-a4ee022b39a4 tempest-ProjectMemberTests-406093346 None] Creating offline snapshot 636f6a7b-b1ef-4d8e-a791-d24f5570ee37 of volume fc2986e2-1213-4696-a831-e107982064e1 {{(pid=86890) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:24:36 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[358b8d99-dbe2-4366-ad24-43039df5436c]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:24:36 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-578e4eb6-1b81-4a5d-8892-a4ee022b39a4 tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-fc2986e2-1213-4696-a831-e107982064e1 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:36 devstack sudo[105481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-fc2986e2-1213-4696-a831-e107982064e1 Nov 02 10:24:36 devstack sudo[105481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:37 devstack sudo[105481]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:37 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-578e4eb6-1b81-4a5d-8892-a4ee022b39a4 tempest-ProjectMemberTests-406093346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-fc2986e2-1213-4696-a831-e107982064e1" returned: 0 in 0.391s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:37 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-578e4eb6-1b81-4a5d-8892-a4ee022b39a4 tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-fc2986e2-1213-4696-a831-e107982064e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-fc2986e2-1213-4696-a831-e107982064e1.636f6a7b-b1ef-4d8e-a791-d24f5570ee37 1G {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:37 devstack sudo[105487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-fc2986e2-1213-4696-a831-e107982064e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-fc2986e2-1213-4696-a831-e107982064e1.636f6a7b-b1ef-4d8e-a791-d24f5570ee37 1G Nov 02 10:24:37 devstack sudo[105487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:37 devstack sudo[105487]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:37 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-578e4eb6-1b81-4a5d-8892-a4ee022b39a4 tempest-ProjectMemberTests-406093346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-fc2986e2-1213-4696-a831-e107982064e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-fc2986e2-1213-4696-a831-e107982064e1.636f6a7b-b1ef-4d8e-a791-d24f5570ee37 1G" returned: 0 in 0.472s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:37 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-578e4eb6-1b81-4a5d-8892-a4ee022b39a4 tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc2986e2-1213-4696-a831-e107982064e1 -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-fc2986e2-1213-4696-a831-e107982064e1.636f6a7b-b1ef-4d8e-a791-d24f5570ee37 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:37 devstack sudo[105493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc2986e2-1213-4696-a831-e107982064e1 -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-fc2986e2-1213-4696-a831-e107982064e1.636f6a7b-b1ef-4d8e-a791-d24f5570ee37 Nov 02 10:24:37 devstack sudo[105493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:37 devstack sudo[105493]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:37 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-578e4eb6-1b81-4a5d-8892-a4ee022b39a4 tempest-ProjectMemberTests-406093346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc2986e2-1213-4696-a831-e107982064e1 -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-fc2986e2-1213-4696-a831-e107982064e1.636f6a7b-b1ef-4d8e-a791-d24f5570ee37" returned: 0 in 0.311s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:37 devstack cinder-volume[86890]: WARNING cinder.volume.drivers.remotefs [None req-578e4eb6-1b81-4a5d-8892-a4ee022b39a4 tempest-ProjectMemberTests-406093346 None] /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-fc2986e2-1213-4696-a831-e107982064e1.636f6a7b-b1ef-4d8e-a791-d24f5570ee37 is being set with open permissions: ugo+rw Nov 02 10:24:37 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-578e4eb6-1b81-4a5d-8892-a4ee022b39a4 tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-fc2986e2-1213-4696-a831-e107982064e1.636f6a7b-b1ef-4d8e-a791-d24f5570ee37 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:37 devstack sudo[105499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-fc2986e2-1213-4696-a831-e107982064e1.636f6a7b-b1ef-4d8e-a791-d24f5570ee37 Nov 02 10:24:37 devstack sudo[105499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:38 devstack sudo[105499]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:38 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-578e4eb6-1b81-4a5d-8892-a4ee022b39a4 tempest-ProjectMemberTests-406093346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-fc2986e2-1213-4696-a831-e107982064e1.636f6a7b-b1ef-4d8e-a791-d24f5570ee37" returned: 0 in 0.278s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:38 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-578e4eb6-1b81-4a5d-8892-a4ee022b39a4 tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-fc2986e2-1213-4696-a831-e107982064e1.info {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:38 devstack sudo[105502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-fc2986e2-1213-4696-a831-e107982064e1.info Nov 02 10:24:38 devstack sudo[105502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:38 devstack sudo[105502]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:38 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-578e4eb6-1b81-4a5d-8892-a4ee022b39a4 tempest-ProjectMemberTests-406093346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-fc2986e2-1213-4696-a831-e107982064e1.info" returned: 0 in 0.308s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:38 devstack cinder-volume[86890]: WARNING cinder.volume.drivers.remotefs [None req-578e4eb6-1b81-4a5d-8892-a4ee022b39a4 tempest-ProjectMemberTests-406093346 None] /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-fc2986e2-1213-4696-a831-e107982064e1.info is being set with open permissions: ugo+rw Nov 02 10:24:38 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-578e4eb6-1b81-4a5d-8892-a4ee022b39a4 tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-fc2986e2-1213-4696-a831-e107982064e1.info {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:38 devstack sudo[105505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-fc2986e2-1213-4696-a831-e107982064e1.info Nov 02 10:24:38 devstack sudo[105505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:38 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-01d85dc7-85c8-4f37-b3be-a322d40a66c3 tempest-ProjectReaderTests-779709804 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:24:38 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-01d85dc7-85c8-4f37-b3be-a322d40a66c3 tempest-ProjectReaderTests-779709804 None] Flow 'volume_create_manager' (2fc0b520-f48e-47cb-ac34-6390e04ca8e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:24:38 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-01d85dc7-85c8-4f37-b3be-a322d40a66c3 tempest-ProjectReaderTests-779709804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d94f311-0d18-49cf-b143-25e2d3bcf177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:24:38 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-01d85dc7-85c8-4f37-b3be-a322d40a66c3 tempest-ProjectReaderTests-779709804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d94f311-0d18-49cf-b143-25e2d3bcf177) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:24:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-449755889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=188818ba-eb13-4bae-9bc0-58df14bb3e20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a88c80344544473c8d2457c14d0db292',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:24:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:24:39Z,use_quota=True,user_id='830d06ded8694a4dae7d1bfd5f316394',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:24:38 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-01d85dc7-85c8-4f37-b3be-a322d40a66c3 tempest-ProjectReaderTests-779709804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaa57b46-581e-4b6a-ab19-8ab7acd2d03d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:24:38 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-01d85dc7-85c8-4f37-b3be-a322d40a66c3 tempest-ProjectReaderTests-779709804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaa57b46-581e-4b6a-ab19-8ab7acd2d03d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:24:38 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-01d85dc7-85c8-4f37-b3be-a322d40a66c3 tempest-ProjectReaderTests-779709804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a59846ab-7809-4116-861d-2be7dae07017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:24:38 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-01d85dc7-85c8-4f37-b3be-a322d40a66c3 tempest-ProjectReaderTests-779709804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a59846ab-7809-4116-861d-2be7dae07017) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '188818ba-eb13-4bae-9bc0-58df14bb3e20', 'volume_name': 'volume-188818ba-eb13-4bae-9bc0-58df14bb3e20', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:24:38 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-01d85dc7-85c8-4f37-b3be-a322d40a66c3 tempest-ProjectReaderTests-779709804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3d7948c-437d-4fa7-8feb-c150002f7f31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:24:38 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-01d85dc7-85c8-4f37-b3be-a322d40a66c3 tempest-ProjectReaderTests-779709804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3d7948c-437d-4fa7-8feb-c150002f7f31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:24:38 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-01d85dc7-85c8-4f37-b3be-a322d40a66c3 tempest-ProjectReaderTests-779709804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f8814b9-c1bd-49e7-9d99-39f83ebe525a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:24:38 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-01d85dc7-85c8-4f37-b3be-a322d40a66c3 tempest-ProjectReaderTests-779709804 None] Volume 188818ba-eb13-4bae-9bc0-58df14bb3e20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-188818ba-eb13-4bae-9bc0-58df14bb3e20', 'volume_size': 1} Nov 02 10:24:38 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-01d85dc7-85c8-4f37-b3be-a322d40a66c3 tempest-ProjectReaderTests-779709804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:24:38 devstack sudo[105505]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:38 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-578e4eb6-1b81-4a5d-8892-a4ee022b39a4 tempest-ProjectMemberTests-406093346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-fc2986e2-1213-4696-a831-e107982064e1.info" returned: 0 in 0.284s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:38 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-578e4eb6-1b81-4a5d-8892-a4ee022b39a4 tempest-ProjectMemberTests-406093346 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.168s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:24:38 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-01d85dc7-85c8-4f37-b3be-a322d40a66c3 tempest-ProjectReaderTests-779709804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.045s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:24:38 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-01d85dc7-85c8-4f37-b3be-a322d40a66c3 tempest-ProjectReaderTests-779709804 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:24:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-449755889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=188818ba-eb13-4bae-9bc0-58df14bb3e20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a88c80344544473c8d2457c14d0db292',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:24:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:24:39Z,use_quota=True,user_id='830d06ded8694a4dae7d1bfd5f316394',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:24:38 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-01d85dc7-85c8-4f37-b3be-a322d40a66c3 tempest-ProjectReaderTests-779709804 None] Creating volume 188818ba-eb13-4bae-9bc0-58df14bb3e20 {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:24:38 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-01d85dc7-85c8-4f37-b3be-a322d40a66c3 tempest-ProjectReaderTests-779709804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:24:38 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-01d85dc7-85c8-4f37-b3be-a322d40a66c3 tempest-ProjectReaderTests-779709804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:24:38 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-01d85dc7-85c8-4f37-b3be-a322d40a66c3 tempest-ProjectReaderTests-779709804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:24:38 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-01d85dc7-85c8-4f37-b3be-a322d40a66c3 tempest-ProjectReaderTests-779709804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:24:38 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-01d85dc7-85c8-4f37-b3be-a322d40a66c3 tempest-ProjectReaderTests-779709804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:24:38 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-01d85dc7-85c8-4f37-b3be-a322d40a66c3 tempest-ProjectReaderTests-779709804 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:24:38 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-01d85dc7-85c8-4f37-b3be-a322d40a66c3 tempest-ProjectReaderTests-779709804 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:24:38 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-01d85dc7-85c8-4f37-b3be-a322d40a66c3 tempest-ProjectReaderTests-779709804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-188818ba-eb13-4bae-9bc0-58df14bb3e20 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:38 devstack sudo[105508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-188818ba-eb13-4bae-9bc0-58df14bb3e20 1073741824 Nov 02 10:24:38 devstack sudo[105508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:38 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-578e4eb6-1b81-4a5d-8892-a4ee022b39a4 tempest-ProjectMemberTests-406093346 None] Create snapshot completed successfully Nov 02 10:24:39 devstack sudo[105508]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:39 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-01d85dc7-85c8-4f37-b3be-a322d40a66c3 tempest-ProjectReaderTests-779709804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-188818ba-eb13-4bae-9bc0-58df14bb3e20 1073741824" returned: 0 in 0.464s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:39 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-01d85dc7-85c8-4f37-b3be-a322d40a66c3 tempest-ProjectReaderTests-779709804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-188818ba-eb13-4bae-9bc0-58df14bb3e20 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:39 devstack sudo[105514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-188818ba-eb13-4bae-9bc0-58df14bb3e20 Nov 02 10:24:39 devstack sudo[105514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:39 devstack sudo[105514]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:39 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-01d85dc7-85c8-4f37-b3be-a322d40a66c3 tempest-ProjectReaderTests-779709804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-188818ba-eb13-4bae-9bc0-58df14bb3e20" returned: 0 in 0.262s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:39 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-01d85dc7-85c8-4f37-b3be-a322d40a66c3 tempest-ProjectReaderTests-779709804 None] <== create_volume: return (771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:24:39 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-01d85dc7-85c8-4f37-b3be-a322d40a66c3 tempest-ProjectReaderTests-779709804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.774s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:24:39 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-01d85dc7-85c8-4f37-b3be-a322d40a66c3 tempest-ProjectReaderTests-779709804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f8814b9-c1bd-49e7-9d99-39f83ebe525a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-188818ba-eb13-4bae-9bc0-58df14bb3e20', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:24:39 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-01d85dc7-85c8-4f37-b3be-a322d40a66c3 tempest-ProjectReaderTests-779709804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (016ad8d1-899a-4449-81a1-fa8aee015759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:24:39 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-01d85dc7-85c8-4f37-b3be-a322d40a66c3 tempest-ProjectReaderTests-779709804 None] Volume volume-188818ba-eb13-4bae-9bc0-58df14bb3e20 (188818ba-eb13-4bae-9bc0-58df14bb3e20): created successfully Nov 02 10:24:39 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-01d85dc7-85c8-4f37-b3be-a322d40a66c3 tempest-ProjectReaderTests-779709804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (016ad8d1-899a-4449-81a1-fa8aee015759) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:24:39 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-01d85dc7-85c8-4f37-b3be-a322d40a66c3 tempest-ProjectReaderTests-779709804 None] Flow 'volume_create_manager' (2fc0b520-f48e-47cb-ac34-6390e04ca8e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:24:39 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-01d85dc7-85c8-4f37-b3be-a322d40a66c3 tempest-ProjectReaderTests-779709804 None] Created volume successfully. Nov 02 10:24:39 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-1025ef9b-63c9-4348-b8d1-3342402c315c tempest-ProjectMemberTests-406093346 None] Acquiring lock "cinder-636f6a7b-b1ef-4d8e-a791-d24f5570ee37-delete_snapshot" by "delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:24:39 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-1025ef9b-63c9-4348-b8d1-3342402c315c tempest-ProjectMemberTests-406093346 None] Lock "cinder-636f6a7b-b1ef-4d8e-a791-d24f5570ee37-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:24:39 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-1025ef9b-63c9-4348-b8d1-3342402c315c tempest-ProjectMemberTests-406093346 None] Acquiring lock "cinder-quobyte-fc2986e2-1213-4696-a831-e107982064e1" by "delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:24:39 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-1025ef9b-63c9-4348-b8d1-3342402c315c tempest-ProjectMemberTests-406093346 None] Lock "cinder-quobyte-fc2986e2-1213-4696-a831-e107982064e1" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:24:39 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-1025ef9b-63c9-4348-b8d1-3342402c315c tempest-ProjectMemberTests-406093346 None] Acquiring lock "cinder-quobyte-636f6a7b-b1ef-4d8e-a791-d24f5570ee37" by "_delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:24:39 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-1025ef9b-63c9-4348-b8d1-3342402c315c tempest-ProjectMemberTests-406093346 None] Lock "cinder-quobyte-636f6a7b-b1ef-4d8e-a791-d24f5570ee37" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:24:39 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-1025ef9b-63c9-4348-b8d1-3342402c315c tempest-ProjectMemberTests-406093346 None] Deleting offline snapshot 636f6a7b-b1ef-4d8e-a791-d24f5570ee37 of volume fc2986e2-1213-4696-a831-e107982064e1 {{(pid=86890) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:24:39 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-1025ef9b-63c9-4348-b8d1-3342402c315c tempest-ProjectMemberTests-406093346 None] snapshot_file for this snap is: volume-fc2986e2-1213-4696-a831-e107982064e1.636f6a7b-b1ef-4d8e-a791-d24f5570ee37 {{(pid=86890) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:24:39 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eb4f260-87ab-4c95-811d-3240e2bff025]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:24:39 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-1025ef9b-63c9-4348-b8d1-3342402c315c tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-fc2986e2-1213-4696-a831-e107982064e1.636f6a7b-b1ef-4d8e-a791-d24f5570ee37 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:40 devstack sudo[105517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-fc2986e2-1213-4696-a831-e107982064e1.636f6a7b-b1ef-4d8e-a791-d24f5570ee37 Nov 02 10:24:40 devstack sudo[105517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:40 devstack sudo[105517]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:40 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-1025ef9b-63c9-4348-b8d1-3342402c315c tempest-ProjectMemberTests-406093346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-fc2986e2-1213-4696-a831-e107982064e1.636f6a7b-b1ef-4d8e-a791-d24f5570ee37" returned: 0 in 0.382s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:40 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-1025ef9b-63c9-4348-b8d1-3342402c315c tempest-ProjectMemberTests-406093346 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fc2986e2-1213-4696-a831-e107982064e1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86890) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:24:40 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[877d59bb-94d7-4e20-a798-a9a1fda5bdcc]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:24:40 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-1025ef9b-63c9-4348-b8d1-3342402c315c tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-fc2986e2-1213-4696-a831-e107982064e1 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:40 devstack sudo[105522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-fc2986e2-1213-4696-a831-e107982064e1 Nov 02 10:24:40 devstack sudo[105522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:40 devstack sudo[105522]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:40 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-1025ef9b-63c9-4348-b8d1-3342402c315c tempest-ProjectMemberTests-406093346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-fc2986e2-1213-4696-a831-e107982064e1" returned: 0 in 0.385s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:40 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-1025ef9b-63c9-4348-b8d1-3342402c315c tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-fc2986e2-1213-4696-a831-e107982064e1.636f6a7b-b1ef-4d8e-a791-d24f5570ee37 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:40 devstack sudo[105527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-fc2986e2-1213-4696-a831-e107982064e1.636f6a7b-b1ef-4d8e-a791-d24f5570ee37 Nov 02 10:24:40 devstack sudo[105527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:40 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-8d527ed1-b29e-4429-ab92-9d29ef1c7f10 tempest-ProjectReaderTests-779709804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:24:40 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-8d527ed1-b29e-4429-ab92-9d29ef1c7f10 tempest-ProjectReaderTests-779709804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:24:40 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-8d527ed1-b29e-4429-ab92-9d29ef1c7f10 tempest-ProjectReaderTests-779709804 None] Creating offline snapshot 317772cb-c473-488b-8dab-a9e37a26f8a0 of volume 188818ba-eb13-4bae-9bc0-58df14bb3e20 {{(pid=86890) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:24:40 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[626372db-720b-47da-aeec-8f4bf4b47c54]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:24:40 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8d527ed1-b29e-4429-ab92-9d29ef1c7f10 tempest-ProjectReaderTests-779709804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-188818ba-eb13-4bae-9bc0-58df14bb3e20 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:41 devstack sudo[105530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-188818ba-eb13-4bae-9bc0-58df14bb3e20 Nov 02 10:24:41 devstack sudo[105530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:41 devstack sudo[105527]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:41 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-1025ef9b-63c9-4348-b8d1-3342402c315c tempest-ProjectMemberTests-406093346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-fc2986e2-1213-4696-a831-e107982064e1.636f6a7b-b1ef-4d8e-a791-d24f5570ee37" returned: 0 in 0.474s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:41 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-1025ef9b-63c9-4348-b8d1-3342402c315c tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-fc2986e2-1213-4696-a831-e107982064e1.636f6a7b-b1ef-4d8e-a791-d24f5570ee37 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:41 devstack sudo[105535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-fc2986e2-1213-4696-a831-e107982064e1.636f6a7b-b1ef-4d8e-a791-d24f5570ee37 Nov 02 10:24:41 devstack sudo[105535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:41 devstack sudo[105530]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:41 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8d527ed1-b29e-4429-ab92-9d29ef1c7f10 tempest-ProjectReaderTests-779709804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-188818ba-eb13-4bae-9bc0-58df14bb3e20" returned: 0 in 0.420s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:41 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8d527ed1-b29e-4429-ab92-9d29ef1c7f10 tempest-ProjectReaderTests-779709804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-188818ba-eb13-4bae-9bc0-58df14bb3e20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-188818ba-eb13-4bae-9bc0-58df14bb3e20.317772cb-c473-488b-8dab-a9e37a26f8a0 1G {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:41 devstack sudo[105540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-188818ba-eb13-4bae-9bc0-58df14bb3e20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-188818ba-eb13-4bae-9bc0-58df14bb3e20.317772cb-c473-488b-8dab-a9e37a26f8a0 1G Nov 02 10:24:41 devstack sudo[105540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:41 devstack sudo[105535]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:41 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-1025ef9b-63c9-4348-b8d1-3342402c315c tempest-ProjectMemberTests-406093346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-fc2986e2-1213-4696-a831-e107982064e1.636f6a7b-b1ef-4d8e-a791-d24f5570ee37" returned: 0 in 0.298s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:41 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-1025ef9b-63c9-4348-b8d1-3342402c315c tempest-ProjectMemberTests-406093346 None] Lock "cinder-quobyte-636f6a7b-b1ef-4d8e-a791-d24f5570ee37" released by "_delete_snapshot" :: held 1.668s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:24:41 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-1025ef9b-63c9-4348-b8d1-3342402c315c tempest-ProjectMemberTests-406093346 None] Lock "cinder-quobyte-fc2986e2-1213-4696-a831-e107982064e1" released by "delete_snapshot" :: held 1.692s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:24:41 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-1025ef9b-63c9-4348-b8d1-3342402c315c tempest-ProjectMemberTests-406093346 None] Created reservations ['e597b169-ba69-4c22-af4f-213c04bfa989', 'f43ce815-05eb-4fdd-b364-79302a860712', 'd00df578-3c0b-4f02-9781-002e345f47dc', 'da21a168-73d2-4e06-a5f9-a68ff11f9453'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:24:41 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-1025ef9b-63c9-4348-b8d1-3342402c315c tempest-ProjectMemberTests-406093346 None] Delete snapshot completed successfully. Nov 02 10:24:41 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-1025ef9b-63c9-4348-b8d1-3342402c315c tempest-ProjectMemberTests-406093346 None] Lock "cinder-636f6a7b-b1ef-4d8e-a791-d24f5570ee37-delete_snapshot" released by "delete_snapshot" :: held 1.865s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:24:41 devstack sudo[105540]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:41 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8d527ed1-b29e-4429-ab92-9d29ef1c7f10 tempest-ProjectReaderTests-779709804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-188818ba-eb13-4bae-9bc0-58df14bb3e20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-188818ba-eb13-4bae-9bc0-58df14bb3e20.317772cb-c473-488b-8dab-a9e37a26f8a0 1G" returned: 0 in 0.455s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:41 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8d527ed1-b29e-4429-ab92-9d29ef1c7f10 tempest-ProjectReaderTests-779709804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-188818ba-eb13-4bae-9bc0-58df14bb3e20 -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-188818ba-eb13-4bae-9bc0-58df14bb3e20.317772cb-c473-488b-8dab-a9e37a26f8a0 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:41 devstack sudo[105547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-188818ba-eb13-4bae-9bc0-58df14bb3e20 -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-188818ba-eb13-4bae-9bc0-58df14bb3e20.317772cb-c473-488b-8dab-a9e37a26f8a0 Nov 02 10:24:41 devstack sudo[105547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:41 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-4c6a1ae6-cc73-4214-8671-eaf9ac8c92bb tempest-ProjectMemberTests-406093346 None] Acquiring lock "cinder-fc2986e2-1213-4696-a831-e107982064e1-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:24:42 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-4c6a1ae6-cc73-4214-8671-eaf9ac8c92bb tempest-ProjectMemberTests-406093346 None] Lock "cinder-fc2986e2-1213-4696-a831-e107982064e1-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:24:42 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-4c6a1ae6-cc73-4214-8671-eaf9ac8c92bb tempest-ProjectMemberTests-406093346 None] Acquiring lock "cinder-quobyte-fc2986e2-1213-4696-a831-e107982064e1" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:24:42 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-4c6a1ae6-cc73-4214-8671-eaf9ac8c92bb tempest-ProjectMemberTests-406093346 None] Lock "cinder-quobyte-fc2986e2-1213-4696-a831-e107982064e1" acquired by "delete_volume" :: waited 0.019s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:24:42 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe8938a9-981d-4b66-958f-06b031d6a3e7]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:24:42 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-4c6a1ae6-cc73-4214-8671-eaf9ac8c92bb tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-fc2986e2-1213-4696-a831-e107982064e1 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:42 devstack sudo[105547]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:42 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8d527ed1-b29e-4429-ab92-9d29ef1c7f10 tempest-ProjectReaderTests-779709804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-188818ba-eb13-4bae-9bc0-58df14bb3e20 -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-188818ba-eb13-4bae-9bc0-58df14bb3e20.317772cb-c473-488b-8dab-a9e37a26f8a0" returned: 0 in 0.328s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:42 devstack cinder-volume[86890]: WARNING cinder.volume.drivers.remotefs [None req-8d527ed1-b29e-4429-ab92-9d29ef1c7f10 tempest-ProjectReaderTests-779709804 None] /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-188818ba-eb13-4bae-9bc0-58df14bb3e20.317772cb-c473-488b-8dab-a9e37a26f8a0 is being set with open permissions: ugo+rw Nov 02 10:24:42 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8d527ed1-b29e-4429-ab92-9d29ef1c7f10 tempest-ProjectReaderTests-779709804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-188818ba-eb13-4bae-9bc0-58df14bb3e20.317772cb-c473-488b-8dab-a9e37a26f8a0 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:42 devstack sudo[105554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-188818ba-eb13-4bae-9bc0-58df14bb3e20.317772cb-c473-488b-8dab-a9e37a26f8a0 Nov 02 10:24:42 devstack sudo[105554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:42 devstack sudo[105552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-fc2986e2-1213-4696-a831-e107982064e1 Nov 02 10:24:42 devstack sudo[105552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:42 devstack sudo[105554]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:42 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8d527ed1-b29e-4429-ab92-9d29ef1c7f10 tempest-ProjectReaderTests-779709804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-188818ba-eb13-4bae-9bc0-58df14bb3e20.317772cb-c473-488b-8dab-a9e37a26f8a0" returned: 0 in 0.285s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:42 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8d527ed1-b29e-4429-ab92-9d29ef1c7f10 tempest-ProjectReaderTests-779709804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-188818ba-eb13-4bae-9bc0-58df14bb3e20.info {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:42 devstack sudo[105561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-188818ba-eb13-4bae-9bc0-58df14bb3e20.info Nov 02 10:24:42 devstack sudo[105561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:42 devstack sudo[105552]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:42 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-4c6a1ae6-cc73-4214-8671-eaf9ac8c92bb tempest-ProjectMemberTests-406093346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-fc2986e2-1213-4696-a831-e107982064e1" returned: 0 in 0.427s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:42 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-4c6a1ae6-cc73-4214-8671-eaf9ac8c92bb tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-fc2986e2-1213-4696-a831-e107982064e1 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:42 devstack sudo[105563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-fc2986e2-1213-4696-a831-e107982064e1 Nov 02 10:24:42 devstack sudo[105563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:42 devstack sudo[105561]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:42 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8d527ed1-b29e-4429-ab92-9d29ef1c7f10 tempest-ProjectReaderTests-779709804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-188818ba-eb13-4bae-9bc0-58df14bb3e20.info" returned: 0 in 0.297s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:42 devstack cinder-volume[86890]: WARNING cinder.volume.drivers.remotefs [None req-8d527ed1-b29e-4429-ab92-9d29ef1c7f10 tempest-ProjectReaderTests-779709804 None] /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-188818ba-eb13-4bae-9bc0-58df14bb3e20.info is being set with open permissions: ugo+rw Nov 02 10:24:42 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8d527ed1-b29e-4429-ab92-9d29ef1c7f10 tempest-ProjectReaderTests-779709804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-188818ba-eb13-4bae-9bc0-58df14bb3e20.info {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:42 devstack sudo[105563]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:42 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-4c6a1ae6-cc73-4214-8671-eaf9ac8c92bb tempest-ProjectMemberTests-406093346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-fc2986e2-1213-4696-a831-e107982064e1" returned: 0 in 0.270s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:42 devstack sudo[105567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-188818ba-eb13-4bae-9bc0-58df14bb3e20.info Nov 02 10:24:42 devstack sudo[105567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:42 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-4c6a1ae6-cc73-4214-8671-eaf9ac8c92bb tempest-ProjectMemberTests-406093346 None] Lock "cinder-quobyte-fc2986e2-1213-4696-a831-e107982064e1" released by "delete_volume" :: held 0.772s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:24:42 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-4c6a1ae6-cc73-4214-8671-eaf9ac8c92bb tempest-ProjectMemberTests-406093346 None] Created reservations ['07b5f30a-7370-4a1b-8ba2-8cd58a59ee1c', '35c7c5e4-8c97-4cf2-96bb-df492499283d', 'ad07e6a0-3283-49d7-b8aa-3208bcde8333', '5ad269ae-f031-4bd5-a48a-79cbb538961f'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:24:42 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-4c6a1ae6-cc73-4214-8671-eaf9ac8c92bb tempest-ProjectMemberTests-406093346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:24:42 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-4c6a1ae6-cc73-4214-8671-eaf9ac8c92bb tempest-ProjectMemberTests-406093346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:24:42 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-4c6a1ae6-cc73-4214-8671-eaf9ac8c92bb tempest-ProjectMemberTests-406093346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:24:43 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-4c6a1ae6-cc73-4214-8671-eaf9ac8c92bb tempest-ProjectMemberTests-406093346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:24:43 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-4c6a1ae6-cc73-4214-8671-eaf9ac8c92bb tempest-ProjectMemberTests-406093346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:24:43 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-4c6a1ae6-cc73-4214-8671-eaf9ac8c92bb tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:43 devstack sudo[105569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:24:43 devstack sudo[105569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:43 devstack sudo[105567]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:43 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8d527ed1-b29e-4429-ab92-9d29ef1c7f10 tempest-ProjectReaderTests-779709804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-188818ba-eb13-4bae-9bc0-58df14bb3e20.info" returned: 0 in 0.258s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:43 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-8d527ed1-b29e-4429-ab92-9d29ef1c7f10 tempest-ProjectReaderTests-779709804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.152s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:24:43 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-8d527ed1-b29e-4429-ab92-9d29ef1c7f10 tempest-ProjectReaderTests-779709804 None] Create snapshot completed successfully Nov 02 10:24:43 devstack sudo[105569]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:43 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-4c6a1ae6-cc73-4214-8671-eaf9ac8c92bb tempest-ProjectMemberTests-406093346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.299s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:43 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-4c6a1ae6-cc73-4214-8671-eaf9ac8c92bb tempest-ProjectMemberTests-406093346 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:24:43 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-4c6a1ae6-cc73-4214-8671-eaf9ac8c92bb tempest-ProjectMemberTests-406093346 None] Deleted volume successfully. Nov 02 10:24:43 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-4c6a1ae6-cc73-4214-8671-eaf9ac8c92bb tempest-ProjectMemberTests-406093346 None] Lock "cinder-fc2986e2-1213-4696-a831-e107982064e1-delete_volume" released by "delete_volume" :: held 1.339s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:24:43 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0bd69f9-cb7f-4067-8455-64e4df1226aa tempest-ProjectMemberTests-406093346 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:24:43 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-f0bd69f9-cb7f-4067-8455-64e4df1226aa tempest-ProjectMemberTests-406093346 None] Flow 'volume_create_manager' (79b1290c-500b-4918-aa60-1b43072e4752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:24:43 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-f0bd69f9-cb7f-4067-8455-64e4df1226aa tempest-ProjectMemberTests-406093346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73482e18-3b7d-4e7f-99a1-cbec56aa3ecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:24:43 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-f0bd69f9-cb7f-4067-8455-64e4df1226aa tempest-ProjectMemberTests-406093346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73482e18-3b7d-4e7f-99a1-cbec56aa3ecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:24:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2131639862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8c48418-f1f5-4882-a787-70a8829798c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='639ad964aa1b416eb473afb3c18dd4e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:24:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:24:44Z,use_quota=True,user_id='076db3d85c064198aa1722b31937515d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:24:43 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-f0bd69f9-cb7f-4067-8455-64e4df1226aa tempest-ProjectMemberTests-406093346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4748e4f6-f4b3-4fc6-9ef1-73006b0dae9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:24:43 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-f0bd69f9-cb7f-4067-8455-64e4df1226aa tempest-ProjectMemberTests-406093346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4748e4f6-f4b3-4fc6-9ef1-73006b0dae9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:24:43 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-f0bd69f9-cb7f-4067-8455-64e4df1226aa tempest-ProjectMemberTests-406093346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fd83b0a-97fd-4b09-93bb-4340b0a599d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:24:43 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-f0bd69f9-cb7f-4067-8455-64e4df1226aa tempest-ProjectMemberTests-406093346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fd83b0a-97fd-4b09-93bb-4340b0a599d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8c48418-f1f5-4882-a787-70a8829798c0', 'volume_name': 'volume-b8c48418-f1f5-4882-a787-70a8829798c0', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:24:43 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-f0bd69f9-cb7f-4067-8455-64e4df1226aa tempest-ProjectMemberTests-406093346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b50156b-4d47-4f81-bce7-09d001fdb334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:24:43 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-f0bd69f9-cb7f-4067-8455-64e4df1226aa tempest-ProjectMemberTests-406093346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b50156b-4d47-4f81-bce7-09d001fdb334) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:24:43 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-f0bd69f9-cb7f-4067-8455-64e4df1226aa tempest-ProjectMemberTests-406093346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (124e44e7-9d24-4059-9bd2-1dd52dc31769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:24:43 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-f0bd69f9-cb7f-4067-8455-64e4df1226aa tempest-ProjectMemberTests-406093346 None] Volume b8c48418-f1f5-4882-a787-70a8829798c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8c48418-f1f5-4882-a787-70a8829798c0', 'volume_size': 1} Nov 02 10:24:43 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-f0bd69f9-cb7f-4067-8455-64e4df1226aa tempest-ProjectMemberTests-406093346 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:24:43 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-f0bd69f9-cb7f-4067-8455-64e4df1226aa tempest-ProjectMemberTests-406093346 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:24:43 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-f0bd69f9-cb7f-4067-8455-64e4df1226aa tempest-ProjectMemberTests-406093346 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:24:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2131639862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8c48418-f1f5-4882-a787-70a8829798c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='639ad964aa1b416eb473afb3c18dd4e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:24:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:24:44Z,use_quota=True,user_id='076db3d85c064198aa1722b31937515d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:24:43 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-f0bd69f9-cb7f-4067-8455-64e4df1226aa tempest-ProjectMemberTests-406093346 None] Creating volume b8c48418-f1f5-4882-a787-70a8829798c0 {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:24:43 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-f0bd69f9-cb7f-4067-8455-64e4df1226aa tempest-ProjectMemberTests-406093346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:24:43 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-f0bd69f9-cb7f-4067-8455-64e4df1226aa tempest-ProjectMemberTests-406093346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:24:43 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-f0bd69f9-cb7f-4067-8455-64e4df1226aa tempest-ProjectMemberTests-406093346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:24:43 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-f0bd69f9-cb7f-4067-8455-64e4df1226aa tempest-ProjectMemberTests-406093346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:24:43 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-f0bd69f9-cb7f-4067-8455-64e4df1226aa tempest-ProjectMemberTests-406093346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:24:43 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-f0bd69f9-cb7f-4067-8455-64e4df1226aa tempest-ProjectMemberTests-406093346 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:24:43 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-f0bd69f9-cb7f-4067-8455-64e4df1226aa tempest-ProjectMemberTests-406093346 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:24:43 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-f0bd69f9-cb7f-4067-8455-64e4df1226aa tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b8c48418-f1f5-4882-a787-70a8829798c0 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:43 devstack sudo[105573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b8c48418-f1f5-4882-a787-70a8829798c0 1073741824 Nov 02 10:24:43 devstack sudo[105573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:44 devstack sudo[105573]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:44 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-f0bd69f9-cb7f-4067-8455-64e4df1226aa tempest-ProjectMemberTests-406093346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b8c48418-f1f5-4882-a787-70a8829798c0 1073741824" returned: 0 in 0.527s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:44 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-9515285a-c363-494c-88dc-3cbf56ce4e8b tempest-ProjectReaderTests-779709804 None] Acquiring lock "cinder-317772cb-c473-488b-8dab-a9e37a26f8a0-delete_snapshot" by "delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:24:44 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-9515285a-c363-494c-88dc-3cbf56ce4e8b tempest-ProjectReaderTests-779709804 None] Lock "cinder-317772cb-c473-488b-8dab-a9e37a26f8a0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:24:44 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-9515285a-c363-494c-88dc-3cbf56ce4e8b tempest-ProjectReaderTests-779709804 None] Acquiring lock "cinder-quobyte-188818ba-eb13-4bae-9bc0-58df14bb3e20" by "delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:24:44 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-f0bd69f9-cb7f-4067-8455-64e4df1226aa tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b8c48418-f1f5-4882-a787-70a8829798c0 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:44 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-9515285a-c363-494c-88dc-3cbf56ce4e8b tempest-ProjectReaderTests-779709804 None] Lock "cinder-quobyte-188818ba-eb13-4bae-9bc0-58df14bb3e20" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:24:44 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-9515285a-c363-494c-88dc-3cbf56ce4e8b tempest-ProjectReaderTests-779709804 None] Acquiring lock "cinder-quobyte-317772cb-c473-488b-8dab-a9e37a26f8a0" by "_delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:24:44 devstack sudo[105580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b8c48418-f1f5-4882-a787-70a8829798c0 Nov 02 10:24:44 devstack sudo[105580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:44 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-9515285a-c363-494c-88dc-3cbf56ce4e8b tempest-ProjectReaderTests-779709804 None] Lock "cinder-quobyte-317772cb-c473-488b-8dab-a9e37a26f8a0" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:24:44 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-9515285a-c363-494c-88dc-3cbf56ce4e8b tempest-ProjectReaderTests-779709804 None] Deleting offline snapshot 317772cb-c473-488b-8dab-a9e37a26f8a0 of volume 188818ba-eb13-4bae-9bc0-58df14bb3e20 {{(pid=86890) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:24:44 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-9515285a-c363-494c-88dc-3cbf56ce4e8b tempest-ProjectReaderTests-779709804 None] snapshot_file for this snap is: volume-188818ba-eb13-4bae-9bc0-58df14bb3e20.317772cb-c473-488b-8dab-a9e37a26f8a0 {{(pid=86890) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:24:44 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9be3099-5308-4035-bfa4-e62c2d41fce7 tempest-ProjectReaderTests-1830827551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:24:44 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-e9be3099-5308-4035-bfa4-e62c2d41fce7 tempest-ProjectReaderTests-1830827551 None] Flow 'volume_create_manager' (c36b9b32-1f32-42f4-9de2-52d227590bf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:24:44 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-e9be3099-5308-4035-bfa4-e62c2d41fce7 tempest-ProjectReaderTests-1830827551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8b988f4-f232-44d3-bde8-1f1e40206dd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:24:44 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e752ea0-d369-4ba9-9fd9-81d3a877fe7e]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:24:44 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-9515285a-c363-494c-88dc-3cbf56ce4e8b tempest-ProjectReaderTests-779709804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-188818ba-eb13-4bae-9bc0-58df14bb3e20.317772cb-c473-488b-8dab-a9e37a26f8a0 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:44 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-e9be3099-5308-4035-bfa4-e62c2d41fce7 tempest-ProjectReaderTests-1830827551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8b988f4-f232-44d3-bde8-1f1e40206dd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:24:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1463921528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3ecda9d-d504-472c-b8be-2bdabb81b240,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b072af995c54f0496d16f029566557b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:24:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:24:44Z,use_quota=True,user_id='bff003e260ef40d796330b26c8c06cf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:24:44 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-e9be3099-5308-4035-bfa4-e62c2d41fce7 tempest-ProjectReaderTests-1830827551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91239160-cc04-474e-9b79-0325a6bebb3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:24:44 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-e9be3099-5308-4035-bfa4-e62c2d41fce7 tempest-ProjectReaderTests-1830827551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91239160-cc04-474e-9b79-0325a6bebb3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:24:44 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-e9be3099-5308-4035-bfa4-e62c2d41fce7 tempest-ProjectReaderTests-1830827551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b82ded5e-2436-407e-9bdf-cecb3bd4d2a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:24:44 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-e9be3099-5308-4035-bfa4-e62c2d41fce7 tempest-ProjectReaderTests-1830827551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b82ded5e-2436-407e-9bdf-cecb3bd4d2a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3ecda9d-d504-472c-b8be-2bdabb81b240', 'volume_name': 'volume-c3ecda9d-d504-472c-b8be-2bdabb81b240', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:24:44 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-e9be3099-5308-4035-bfa4-e62c2d41fce7 tempest-ProjectReaderTests-1830827551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77fbc824-5ca7-4e9c-8aa2-21ad78cfaef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:24:44 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-e9be3099-5308-4035-bfa4-e62c2d41fce7 tempest-ProjectReaderTests-1830827551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77fbc824-5ca7-4e9c-8aa2-21ad78cfaef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:24:44 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-e9be3099-5308-4035-bfa4-e62c2d41fce7 tempest-ProjectReaderTests-1830827551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68748346-f72b-43e1-ab6b-1e8026f16dcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:24:44 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-e9be3099-5308-4035-bfa4-e62c2d41fce7 tempest-ProjectReaderTests-1830827551 None] Volume c3ecda9d-d504-472c-b8be-2bdabb81b240: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3ecda9d-d504-472c-b8be-2bdabb81b240', 'volume_size': 1} Nov 02 10:24:44 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-e9be3099-5308-4035-bfa4-e62c2d41fce7 tempest-ProjectReaderTests-1830827551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:24:44 devstack sudo[105582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-188818ba-eb13-4bae-9bc0-58df14bb3e20.317772cb-c473-488b-8dab-a9e37a26f8a0 Nov 02 10:24:44 devstack sudo[105582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:44 devstack sudo[105580]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:44 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-f0bd69f9-cb7f-4067-8455-64e4df1226aa tempest-ProjectMemberTests-406093346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b8c48418-f1f5-4882-a787-70a8829798c0" returned: 0 in 0.289s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:44 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-f0bd69f9-cb7f-4067-8455-64e4df1226aa tempest-ProjectMemberTests-406093346 None] <== create_volume: return (905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:24:44 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-f0bd69f9-cb7f-4067-8455-64e4df1226aa tempest-ProjectMemberTests-406093346 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.908s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:24:44 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-e9be3099-5308-4035-bfa4-e62c2d41fce7 tempest-ProjectReaderTests-1830827551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.127s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:24:44 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-e9be3099-5308-4035-bfa4-e62c2d41fce7 tempest-ProjectReaderTests-1830827551 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:24:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1463921528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3ecda9d-d504-472c-b8be-2bdabb81b240,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b072af995c54f0496d16f029566557b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:24:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:24:44Z,use_quota=True,user_id='bff003e260ef40d796330b26c8c06cf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:24:44 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-e9be3099-5308-4035-bfa4-e62c2d41fce7 tempest-ProjectReaderTests-1830827551 None] Creating volume c3ecda9d-d504-472c-b8be-2bdabb81b240 {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:24:44 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-e9be3099-5308-4035-bfa4-e62c2d41fce7 tempest-ProjectReaderTests-1830827551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:24:44 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-e9be3099-5308-4035-bfa4-e62c2d41fce7 tempest-ProjectReaderTests-1830827551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:24:44 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-e9be3099-5308-4035-bfa4-e62c2d41fce7 tempest-ProjectReaderTests-1830827551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:24:44 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-e9be3099-5308-4035-bfa4-e62c2d41fce7 tempest-ProjectReaderTests-1830827551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:24:44 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-e9be3099-5308-4035-bfa4-e62c2d41fce7 tempest-ProjectReaderTests-1830827551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:24:44 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-e9be3099-5308-4035-bfa4-e62c2d41fce7 tempest-ProjectReaderTests-1830827551 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:24:44 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-e9be3099-5308-4035-bfa4-e62c2d41fce7 tempest-ProjectReaderTests-1830827551 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:24:44 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-e9be3099-5308-4035-bfa4-e62c2d41fce7 tempest-ProjectReaderTests-1830827551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-c3ecda9d-d504-472c-b8be-2bdabb81b240 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:44 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-f0bd69f9-cb7f-4067-8455-64e4df1226aa tempest-ProjectMemberTests-406093346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (124e44e7-9d24-4059-9bd2-1dd52dc31769) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8c48418-f1f5-4882-a787-70a8829798c0', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:24:44 devstack sudo[105585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-c3ecda9d-d504-472c-b8be-2bdabb81b240 1073741824 Nov 02 10:24:44 devstack sudo[105585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:44 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-f0bd69f9-cb7f-4067-8455-64e4df1226aa tempest-ProjectMemberTests-406093346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8683be7-ae21-46dd-9725-52ca4eec0042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:24:44 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-f0bd69f9-cb7f-4067-8455-64e4df1226aa tempest-ProjectMemberTests-406093346 None] Volume volume-b8c48418-f1f5-4882-a787-70a8829798c0 (b8c48418-f1f5-4882-a787-70a8829798c0): created successfully Nov 02 10:24:44 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-f0bd69f9-cb7f-4067-8455-64e4df1226aa tempest-ProjectMemberTests-406093346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8683be7-ae21-46dd-9725-52ca4eec0042) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:24:44 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-f0bd69f9-cb7f-4067-8455-64e4df1226aa tempest-ProjectMemberTests-406093346 None] Flow 'volume_create_manager' (79b1290c-500b-4918-aa60-1b43072e4752) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:24:44 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-f0bd69f9-cb7f-4067-8455-64e4df1226aa tempest-ProjectMemberTests-406093346 None] Created volume successfully. Nov 02 10:24:44 devstack sudo[105582]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:44 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-9515285a-c363-494c-88dc-3cbf56ce4e8b tempest-ProjectReaderTests-779709804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-188818ba-eb13-4bae-9bc0-58df14bb3e20.317772cb-c473-488b-8dab-a9e37a26f8a0" returned: 0 in 0.385s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:44 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-9515285a-c363-494c-88dc-3cbf56ce4e8b tempest-ProjectReaderTests-779709804 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-188818ba-eb13-4bae-9bc0-58df14bb3e20(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86890) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:24:44 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2a8baf2-c6d3-40b8-bfe9-cc8fddd58fa9]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:24:44 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-9515285a-c363-494c-88dc-3cbf56ce4e8b tempest-ProjectReaderTests-779709804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-188818ba-eb13-4bae-9bc0-58df14bb3e20 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:45 devstack sudo[105590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-188818ba-eb13-4bae-9bc0-58df14bb3e20 Nov 02 10:24:45 devstack sudo[105590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:45 devstack sudo[105585]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:45 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-e9be3099-5308-4035-bfa4-e62c2d41fce7 tempest-ProjectReaderTests-1830827551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-c3ecda9d-d504-472c-b8be-2bdabb81b240 1073741824" returned: 0 in 0.467s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:45 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-e9be3099-5308-4035-bfa4-e62c2d41fce7 tempest-ProjectReaderTests-1830827551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-c3ecda9d-d504-472c-b8be-2bdabb81b240 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:45 devstack sudo[105595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-c3ecda9d-d504-472c-b8be-2bdabb81b240 Nov 02 10:24:45 devstack sudo[105595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:45 devstack sudo[105590]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:45 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-9515285a-c363-494c-88dc-3cbf56ce4e8b tempest-ProjectReaderTests-779709804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-188818ba-eb13-4bae-9bc0-58df14bb3e20" returned: 0 in 0.398s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:45 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-9515285a-c363-494c-88dc-3cbf56ce4e8b tempest-ProjectReaderTests-779709804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-188818ba-eb13-4bae-9bc0-58df14bb3e20.317772cb-c473-488b-8dab-a9e37a26f8a0 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:45 devstack sudo[105600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-188818ba-eb13-4bae-9bc0-58df14bb3e20.317772cb-c473-488b-8dab-a9e37a26f8a0 Nov 02 10:24:45 devstack sudo[105600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:45 devstack sudo[105595]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:45 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-e9be3099-5308-4035-bfa4-e62c2d41fce7 tempest-ProjectReaderTests-1830827551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-c3ecda9d-d504-472c-b8be-2bdabb81b240" returned: 0 in 0.277s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:45 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-e9be3099-5308-4035-bfa4-e62c2d41fce7 tempest-ProjectReaderTests-1830827551 None] <== create_volume: return (792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:24:45 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-e9be3099-5308-4035-bfa4-e62c2d41fce7 tempest-ProjectReaderTests-1830827551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.794s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:24:45 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-e9be3099-5308-4035-bfa4-e62c2d41fce7 tempest-ProjectReaderTests-1830827551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68748346-f72b-43e1-ab6b-1e8026f16dcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3ecda9d-d504-472c-b8be-2bdabb81b240', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:24:45 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-e9be3099-5308-4035-bfa4-e62c2d41fce7 tempest-ProjectReaderTests-1830827551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ece4105-96ce-44e8-98da-7c35c4925225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:24:45 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-e9be3099-5308-4035-bfa4-e62c2d41fce7 tempest-ProjectReaderTests-1830827551 None] Volume volume-c3ecda9d-d504-472c-b8be-2bdabb81b240 (c3ecda9d-d504-472c-b8be-2bdabb81b240): created successfully Nov 02 10:24:45 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-e9be3099-5308-4035-bfa4-e62c2d41fce7 tempest-ProjectReaderTests-1830827551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ece4105-96ce-44e8-98da-7c35c4925225) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:24:45 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-e9be3099-5308-4035-bfa4-e62c2d41fce7 tempest-ProjectReaderTests-1830827551 None] Flow 'volume_create_manager' (c36b9b32-1f32-42f4-9de2-52d227590bf2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:24:45 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-e9be3099-5308-4035-bfa4-e62c2d41fce7 tempest-ProjectReaderTests-1830827551 None] Created volume successfully. Nov 02 10:24:45 devstack sudo[105600]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:45 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-9515285a-c363-494c-88dc-3cbf56ce4e8b tempest-ProjectReaderTests-779709804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-188818ba-eb13-4bae-9bc0-58df14bb3e20.317772cb-c473-488b-8dab-a9e37a26f8a0" returned: 0 in 0.344s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:45 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-9515285a-c363-494c-88dc-3cbf56ce4e8b tempest-ProjectReaderTests-779709804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-188818ba-eb13-4bae-9bc0-58df14bb3e20.317772cb-c473-488b-8dab-a9e37a26f8a0 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:45 devstack sudo[105606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-188818ba-eb13-4bae-9bc0-58df14bb3e20.317772cb-c473-488b-8dab-a9e37a26f8a0 Nov 02 10:24:45 devstack sudo[105606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:45 devstack sudo[105606]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:45 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-9515285a-c363-494c-88dc-3cbf56ce4e8b tempest-ProjectReaderTests-779709804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-188818ba-eb13-4bae-9bc0-58df14bb3e20.317772cb-c473-488b-8dab-a9e37a26f8a0" returned: 0 in 0.263s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:45 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-ff6da6a3-4a6d-4f33-bb52-13e2a90b4b7c tempest-ProjectMemberTests-406093346 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:24:45 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-ff6da6a3-4a6d-4f33-bb52-13e2a90b4b7c tempest-ProjectMemberTests-406093346 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:24:45 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-9515285a-c363-494c-88dc-3cbf56ce4e8b tempest-ProjectReaderTests-779709804 None] Lock "cinder-quobyte-317772cb-c473-488b-8dab-a9e37a26f8a0" released by "_delete_snapshot" :: held 1.525s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:24:45 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-9515285a-c363-494c-88dc-3cbf56ce4e8b tempest-ProjectReaderTests-779709804 None] Lock "cinder-quobyte-188818ba-eb13-4bae-9bc0-58df14bb3e20" released by "delete_snapshot" :: held 1.559s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:24:45 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-ff6da6a3-4a6d-4f33-bb52-13e2a90b4b7c tempest-ProjectMemberTests-406093346 None] Creating offline snapshot 5e7864d8-55e4-461b-9ec6-d076cadd0b38 of volume b8c48418-f1f5-4882-a787-70a8829798c0 {{(pid=86890) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:24:45 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[c248b426-570d-48ec-9517-41ce9319ca02]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:24:46 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ff6da6a3-4a6d-4f33-bb52-13e2a90b4b7c tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b8c48418-f1f5-4882-a787-70a8829798c0 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:46 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-9515285a-c363-494c-88dc-3cbf56ce4e8b tempest-ProjectReaderTests-779709804 None] Created reservations ['110e9400-43b7-4ea4-8f99-7f187a0ff83c', '4070c543-f156-438e-8a79-23e49694c279', '53129811-f668-4fdb-a200-36ec1bac7a3e', '358a1bdb-4459-4fc0-8e33-c969e24c7346'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:24:46 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-9515285a-c363-494c-88dc-3cbf56ce4e8b tempest-ProjectReaderTests-779709804 None] Delete snapshot completed successfully. Nov 02 10:24:46 devstack sudo[105609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b8c48418-f1f5-4882-a787-70a8829798c0 Nov 02 10:24:46 devstack sudo[105609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:46 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-9515285a-c363-494c-88dc-3cbf56ce4e8b tempest-ProjectReaderTests-779709804 None] Lock "cinder-317772cb-c473-488b-8dab-a9e37a26f8a0-delete_snapshot" released by "delete_snapshot" :: held 1.737s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:24:46 devstack sudo[105609]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:46 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ff6da6a3-4a6d-4f33-bb52-13e2a90b4b7c tempest-ProjectMemberTests-406093346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b8c48418-f1f5-4882-a787-70a8829798c0" returned: 0 in 0.376s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:46 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ff6da6a3-4a6d-4f33-bb52-13e2a90b4b7c tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b8c48418-f1f5-4882-a787-70a8829798c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b8c48418-f1f5-4882-a787-70a8829798c0.5e7864d8-55e4-461b-9ec6-d076cadd0b38 1G {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:46 devstack sudo[105614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b8c48418-f1f5-4882-a787-70a8829798c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b8c48418-f1f5-4882-a787-70a8829798c0.5e7864d8-55e4-461b-9ec6-d076cadd0b38 1G Nov 02 10:24:46 devstack sudo[105614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:46 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-762b41b7-627a-4e21-9206-5bae0c921642 tempest-ProjectReaderTests-779709804 None] Acquiring lock "cinder-188818ba-eb13-4bae-9bc0-58df14bb3e20-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:24:46 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-762b41b7-627a-4e21-9206-5bae0c921642 tempest-ProjectReaderTests-779709804 None] Lock "cinder-188818ba-eb13-4bae-9bc0-58df14bb3e20-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:24:46 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-762b41b7-627a-4e21-9206-5bae0c921642 tempest-ProjectReaderTests-779709804 None] Acquiring lock "cinder-quobyte-188818ba-eb13-4bae-9bc0-58df14bb3e20" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:24:46 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-762b41b7-627a-4e21-9206-5bae0c921642 tempest-ProjectReaderTests-779709804 None] Lock "cinder-quobyte-188818ba-eb13-4bae-9bc0-58df14bb3e20" acquired by "delete_volume" :: waited 0.020s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:24:46 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2b69faa-ed19-464b-a801-3e4aaab7681f]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:24:46 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-762b41b7-627a-4e21-9206-5bae0c921642 tempest-ProjectReaderTests-779709804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-188818ba-eb13-4bae-9bc0-58df14bb3e20 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:46 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-201c6ada-8d8c-4dfd-96a4-1d611a868b09 tempest-ProjectReaderTests-1830827551 None] Acquiring lock "cinder-c3ecda9d-d504-472c-b8be-2bdabb81b240-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:24:46 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-201c6ada-8d8c-4dfd-96a4-1d611a868b09 tempest-ProjectReaderTests-1830827551 None] Lock "cinder-c3ecda9d-d504-472c-b8be-2bdabb81b240-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:24:46 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-201c6ada-8d8c-4dfd-96a4-1d611a868b09 tempest-ProjectReaderTests-1830827551 None] Acquiring lock "cinder-quobyte-c3ecda9d-d504-472c-b8be-2bdabb81b240" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:24:46 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-201c6ada-8d8c-4dfd-96a4-1d611a868b09 tempest-ProjectReaderTests-1830827551 None] Lock "cinder-quobyte-c3ecda9d-d504-472c-b8be-2bdabb81b240" acquired by "delete_volume" :: waited 0.018s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:24:46 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b6c88a5-06bc-46d7-8b00-6f61742c2fca]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:24:46 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-201c6ada-8d8c-4dfd-96a4-1d611a868b09 tempest-ProjectReaderTests-1830827551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-c3ecda9d-d504-472c-b8be-2bdabb81b240 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:46 devstack sudo[105618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-188818ba-eb13-4bae-9bc0-58df14bb3e20 Nov 02 10:24:46 devstack sudo[105618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:46 devstack sudo[105614]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:46 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ff6da6a3-4a6d-4f33-bb52-13e2a90b4b7c tempest-ProjectMemberTests-406093346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b8c48418-f1f5-4882-a787-70a8829798c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b8c48418-f1f5-4882-a787-70a8829798c0.5e7864d8-55e4-461b-9ec6-d076cadd0b38 1G" returned: 0 in 0.514s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:46 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ff6da6a3-4a6d-4f33-bb52-13e2a90b4b7c tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8c48418-f1f5-4882-a787-70a8829798c0 -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b8c48418-f1f5-4882-a787-70a8829798c0.5e7864d8-55e4-461b-9ec6-d076cadd0b38 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:46 devstack sudo[105620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-c3ecda9d-d504-472c-b8be-2bdabb81b240 Nov 02 10:24:46 devstack sudo[105620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:46 devstack sudo[105623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8c48418-f1f5-4882-a787-70a8829798c0 -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b8c48418-f1f5-4882-a787-70a8829798c0.5e7864d8-55e4-461b-9ec6-d076cadd0b38 Nov 02 10:24:46 devstack sudo[105623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:47 devstack sudo[105618]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:47 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-762b41b7-627a-4e21-9206-5bae0c921642 tempest-ProjectReaderTests-779709804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-188818ba-eb13-4bae-9bc0-58df14bb3e20" returned: 0 in 0.408s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:47 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-762b41b7-627a-4e21-9206-5bae0c921642 tempest-ProjectReaderTests-779709804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-188818ba-eb13-4bae-9bc0-58df14bb3e20 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:47 devstack sudo[105629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-188818ba-eb13-4bae-9bc0-58df14bb3e20 Nov 02 10:24:47 devstack sudo[105629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:47 devstack sudo[105620]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:47 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-201c6ada-8d8c-4dfd-96a4-1d611a868b09 tempest-ProjectReaderTests-1830827551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-c3ecda9d-d504-472c-b8be-2bdabb81b240" returned: 0 in 0.415s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:47 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-201c6ada-8d8c-4dfd-96a4-1d611a868b09 tempest-ProjectReaderTests-1830827551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-c3ecda9d-d504-472c-b8be-2bdabb81b240 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:47 devstack sudo[105623]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:47 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ff6da6a3-4a6d-4f33-bb52-13e2a90b4b7c tempest-ProjectMemberTests-406093346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8c48418-f1f5-4882-a787-70a8829798c0 -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b8c48418-f1f5-4882-a787-70a8829798c0.5e7864d8-55e4-461b-9ec6-d076cadd0b38" returned: 0 in 0.318s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:47 devstack cinder-volume[86890]: WARNING cinder.volume.drivers.remotefs [None req-ff6da6a3-4a6d-4f33-bb52-13e2a90b4b7c tempest-ProjectMemberTests-406093346 None] /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b8c48418-f1f5-4882-a787-70a8829798c0.5e7864d8-55e4-461b-9ec6-d076cadd0b38 is being set with open permissions: ugo+rw Nov 02 10:24:47 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ff6da6a3-4a6d-4f33-bb52-13e2a90b4b7c tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b8c48418-f1f5-4882-a787-70a8829798c0.5e7864d8-55e4-461b-9ec6-d076cadd0b38 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:47 devstack sudo[105637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-c3ecda9d-d504-472c-b8be-2bdabb81b240 Nov 02 10:24:47 devstack sudo[105637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:47 devstack sudo[105639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b8c48418-f1f5-4882-a787-70a8829798c0.5e7864d8-55e4-461b-9ec6-d076cadd0b38 Nov 02 10:24:47 devstack sudo[105639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:47 devstack sudo[105629]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:47 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-762b41b7-627a-4e21-9206-5bae0c921642 tempest-ProjectReaderTests-779709804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-188818ba-eb13-4bae-9bc0-58df14bb3e20" returned: 0 in 0.267s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:47 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-762b41b7-627a-4e21-9206-5bae0c921642 tempest-ProjectReaderTests-779709804 None] Lock "cinder-quobyte-188818ba-eb13-4bae-9bc0-58df14bb3e20" released by "delete_volume" :: held 0.760s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:24:47 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-762b41b7-627a-4e21-9206-5bae0c921642 tempest-ProjectReaderTests-779709804 None] Created reservations ['2369f14b-0108-43ac-ba53-5381f7bac67e', '3a9904d7-8d59-4981-b878-baa3a2c1d9b4', '473a5635-2648-49fe-ac4d-0f07c0dcadbf', '4e8c0476-8a24-4216-8eb2-92aef094a04b'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:24:47 devstack sudo[105637]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:47 devstack sudo[105639]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:47 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ff6da6a3-4a6d-4f33-bb52-13e2a90b4b7c tempest-ProjectMemberTests-406093346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b8c48418-f1f5-4882-a787-70a8829798c0.5e7864d8-55e4-461b-9ec6-d076cadd0b38" returned: 0 in 0.260s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:47 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-201c6ada-8d8c-4dfd-96a4-1d611a868b09 tempest-ProjectReaderTests-1830827551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-c3ecda9d-d504-472c-b8be-2bdabb81b240" returned: 0 in 0.287s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:47 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-201c6ada-8d8c-4dfd-96a4-1d611a868b09 tempest-ProjectReaderTests-1830827551 None] Lock "cinder-quobyte-c3ecda9d-d504-472c-b8be-2bdabb81b240" released by "delete_volume" :: held 0.751s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:24:47 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-762b41b7-627a-4e21-9206-5bae0c921642 tempest-ProjectReaderTests-779709804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:24:47 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-762b41b7-627a-4e21-9206-5bae0c921642 tempest-ProjectReaderTests-779709804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:24:47 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-762b41b7-627a-4e21-9206-5bae0c921642 tempest-ProjectReaderTests-779709804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:24:47 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-762b41b7-627a-4e21-9206-5bae0c921642 tempest-ProjectReaderTests-779709804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:24:47 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-762b41b7-627a-4e21-9206-5bae0c921642 tempest-ProjectReaderTests-779709804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:24:47 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-762b41b7-627a-4e21-9206-5bae0c921642 tempest-ProjectReaderTests-779709804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:47 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ff6da6a3-4a6d-4f33-bb52-13e2a90b4b7c tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b8c48418-f1f5-4882-a787-70a8829798c0.info {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:47 devstack sudo[105644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:24:47 devstack sudo[105644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:47 devstack sudo[105645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b8c48418-f1f5-4882-a787-70a8829798c0.info Nov 02 10:24:47 devstack sudo[105645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:47 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-201c6ada-8d8c-4dfd-96a4-1d611a868b09 tempest-ProjectReaderTests-1830827551 None] Created reservations ['921f6265-0107-47ae-a565-d9db7478aba0', '657ef0a6-d496-41d1-bd75-3a2c5126c973', '8babc833-3a33-4907-962d-da005d73d9d8', 'd0688eff-c420-4c0e-a3e3-8af5172a4acd'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:24:47 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-201c6ada-8d8c-4dfd-96a4-1d611a868b09 tempest-ProjectReaderTests-1830827551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:24:47 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-201c6ada-8d8c-4dfd-96a4-1d611a868b09 tempest-ProjectReaderTests-1830827551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:24:47 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-201c6ada-8d8c-4dfd-96a4-1d611a868b09 tempest-ProjectReaderTests-1830827551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:24:47 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-201c6ada-8d8c-4dfd-96a4-1d611a868b09 tempest-ProjectReaderTests-1830827551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:24:47 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-201c6ada-8d8c-4dfd-96a4-1d611a868b09 tempest-ProjectReaderTests-1830827551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:24:47 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-201c6ada-8d8c-4dfd-96a4-1d611a868b09 tempest-ProjectReaderTests-1830827551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:47 devstack sudo[105648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:24:47 devstack sudo[105648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:47 devstack sudo[105645]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:47 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ff6da6a3-4a6d-4f33-bb52-13e2a90b4b7c tempest-ProjectMemberTests-406093346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b8c48418-f1f5-4882-a787-70a8829798c0.info" returned: 0 in 0.308s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:47 devstack cinder-volume[86890]: WARNING cinder.volume.drivers.remotefs [None req-ff6da6a3-4a6d-4f33-bb52-13e2a90b4b7c tempest-ProjectMemberTests-406093346 None] /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b8c48418-f1f5-4882-a787-70a8829798c0.info is being set with open permissions: ugo+rw Nov 02 10:24:47 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ff6da6a3-4a6d-4f33-bb52-13e2a90b4b7c tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b8c48418-f1f5-4882-a787-70a8829798c0.info {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:47 devstack sudo[105644]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:47 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-762b41b7-627a-4e21-9206-5bae0c921642 tempest-ProjectReaderTests-779709804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.358s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:47 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-762b41b7-627a-4e21-9206-5bae0c921642 tempest-ProjectReaderTests-779709804 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:24:47 devstack sudo[105652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b8c48418-f1f5-4882-a787-70a8829798c0.info Nov 02 10:24:47 devstack sudo[105652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:47 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-762b41b7-627a-4e21-9206-5bae0c921642 tempest-ProjectReaderTests-779709804 None] Deleted volume successfully. Nov 02 10:24:47 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-762b41b7-627a-4e21-9206-5bae0c921642 tempest-ProjectReaderTests-779709804 None] Lock "cinder-188818ba-eb13-4bae-9bc0-58df14bb3e20-delete_volume" released by "delete_volume" :: held 1.415s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:24:48 devstack sudo[105648]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:48 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-201c6ada-8d8c-4dfd-96a4-1d611a868b09 tempest-ProjectReaderTests-1830827551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.407s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:48 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-201c6ada-8d8c-4dfd-96a4-1d611a868b09 tempest-ProjectReaderTests-1830827551 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:24:48 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-201c6ada-8d8c-4dfd-96a4-1d611a868b09 tempest-ProjectReaderTests-1830827551 None] Deleted volume successfully. Nov 02 10:24:48 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-201c6ada-8d8c-4dfd-96a4-1d611a868b09 tempest-ProjectReaderTests-1830827551 None] Lock "cinder-c3ecda9d-d504-472c-b8be-2bdabb81b240-delete_volume" released by "delete_volume" :: held 1.454s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:24:48 devstack sudo[105652]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:48 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ff6da6a3-4a6d-4f33-bb52-13e2a90b4b7c tempest-ProjectMemberTests-406093346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b8c48418-f1f5-4882-a787-70a8829798c0.info" returned: 0 in 0.374s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:48 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-ff6da6a3-4a6d-4f33-bb52-13e2a90b4b7c tempest-ProjectMemberTests-406093346 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.272s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:24:48 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-ff6da6a3-4a6d-4f33-bb52-13e2a90b4b7c tempest-ProjectMemberTests-406093346 None] Create snapshot completed successfully Nov 02 10:24:48 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9828ce5-63f1-4412-b3a7-1e9a3a279690 tempest-ProjectReaderTests-779709804 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:24:48 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c9828ce5-63f1-4412-b3a7-1e9a3a279690 tempest-ProjectReaderTests-779709804 None] Flow 'volume_create_manager' (1fca35e8-4841-40a0-b3a6-5de4d6c74e78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:24:48 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c9828ce5-63f1-4412-b3a7-1e9a3a279690 tempest-ProjectReaderTests-779709804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cada3721-6eca-4ddf-9f80-e161fd5c1975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:24:48 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c9828ce5-63f1-4412-b3a7-1e9a3a279690 tempest-ProjectReaderTests-779709804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cada3721-6eca-4ddf-9f80-e161fd5c1975) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:24:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1534552823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d5276f3-1cea-4fe7-861d-4d7d6a763196,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a88c80344544473c8d2457c14d0db292',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:24:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:24:48Z,use_quota=True,user_id='830d06ded8694a4dae7d1bfd5f316394',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:24:48 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c9828ce5-63f1-4412-b3a7-1e9a3a279690 tempest-ProjectReaderTests-779709804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d11efbc-1d64-4426-bab3-2a432f083dad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:24:48 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c9828ce5-63f1-4412-b3a7-1e9a3a279690 tempest-ProjectReaderTests-779709804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d11efbc-1d64-4426-bab3-2a432f083dad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:24:48 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c9828ce5-63f1-4412-b3a7-1e9a3a279690 tempest-ProjectReaderTests-779709804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d064c82-04ad-484e-a2d2-c2b53a6b6bb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:24:48 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c9828ce5-63f1-4412-b3a7-1e9a3a279690 tempest-ProjectReaderTests-779709804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d064c82-04ad-484e-a2d2-c2b53a6b6bb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d5276f3-1cea-4fe7-861d-4d7d6a763196', 'volume_name': 'volume-5d5276f3-1cea-4fe7-861d-4d7d6a763196', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:24:48 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c9828ce5-63f1-4412-b3a7-1e9a3a279690 tempest-ProjectReaderTests-779709804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e77e7cf9-8714-44d6-8641-c0ea1744ea48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:24:48 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c9828ce5-63f1-4412-b3a7-1e9a3a279690 tempest-ProjectReaderTests-779709804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e77e7cf9-8714-44d6-8641-c0ea1744ea48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:24:48 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c9828ce5-63f1-4412-b3a7-1e9a3a279690 tempest-ProjectReaderTests-779709804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b74bdb4-1ac4-4427-a08b-f6af289414c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:24:48 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-c9828ce5-63f1-4412-b3a7-1e9a3a279690 tempest-ProjectReaderTests-779709804 None] Volume 5d5276f3-1cea-4fe7-861d-4d7d6a763196: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d5276f3-1cea-4fe7-861d-4d7d6a763196', 'volume_size': 1} Nov 02 10:24:48 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c9828ce5-63f1-4412-b3a7-1e9a3a279690 tempest-ProjectReaderTests-779709804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:24:48 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c9828ce5-63f1-4412-b3a7-1e9a3a279690 tempest-ProjectReaderTests-779709804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:24:48 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c9828ce5-63f1-4412-b3a7-1e9a3a279690 tempest-ProjectReaderTests-779709804 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:24:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1534552823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d5276f3-1cea-4fe7-861d-4d7d6a763196,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a88c80344544473c8d2457c14d0db292',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:24:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:24:48Z,use_quota=True,user_id='830d06ded8694a4dae7d1bfd5f316394',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:24:48 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-c9828ce5-63f1-4412-b3a7-1e9a3a279690 tempest-ProjectReaderTests-779709804 None] Creating volume 5d5276f3-1cea-4fe7-861d-4d7d6a763196 {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:24:48 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c9828ce5-63f1-4412-b3a7-1e9a3a279690 tempest-ProjectReaderTests-779709804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:24:48 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c9828ce5-63f1-4412-b3a7-1e9a3a279690 tempest-ProjectReaderTests-779709804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:24:48 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c9828ce5-63f1-4412-b3a7-1e9a3a279690 tempest-ProjectReaderTests-779709804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:24:48 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c9828ce5-63f1-4412-b3a7-1e9a3a279690 tempest-ProjectReaderTests-779709804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:24:48 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c9828ce5-63f1-4412-b3a7-1e9a3a279690 tempest-ProjectReaderTests-779709804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:24:48 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c9828ce5-63f1-4412-b3a7-1e9a3a279690 tempest-ProjectReaderTests-779709804 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:24:48 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-c9828ce5-63f1-4412-b3a7-1e9a3a279690 tempest-ProjectReaderTests-779709804 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:24:48 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c9828ce5-63f1-4412-b3a7-1e9a3a279690 tempest-ProjectReaderTests-779709804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-5d5276f3-1cea-4fe7-861d-4d7d6a763196 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:48 devstack sudo[105656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-5d5276f3-1cea-4fe7-861d-4d7d6a763196 1073741824 Nov 02 10:24:48 devstack sudo[105656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:48 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-c09d8540-4210-44aa-8067-d74f7cd4256b tempest-ProjectReaderTests-1830827551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:24:48 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c09d8540-4210-44aa-8067-d74f7cd4256b tempest-ProjectReaderTests-1830827551 None] Flow 'volume_create_manager' (bf9ef892-8be2-44af-b02d-88a55ae46f72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:24:48 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c09d8540-4210-44aa-8067-d74f7cd4256b tempest-ProjectReaderTests-1830827551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f939d8d7-8b8c-4457-9b7d-5a88fd7b7a1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:24:48 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c09d8540-4210-44aa-8067-d74f7cd4256b tempest-ProjectReaderTests-1830827551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f939d8d7-8b8c-4457-9b7d-5a88fd7b7a1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:24:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1388468188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9606cca-99f4-41ee-90e3-811d0fc7178f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b072af995c54f0496d16f029566557b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:24:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:24:49Z,use_quota=True,user_id='bff003e260ef40d796330b26c8c06cf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:24:48 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c09d8540-4210-44aa-8067-d74f7cd4256b tempest-ProjectReaderTests-1830827551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3af1fc2-aac6-496c-a596-1acea9fc7f83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:24:48 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c09d8540-4210-44aa-8067-d74f7cd4256b tempest-ProjectReaderTests-1830827551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3af1fc2-aac6-496c-a596-1acea9fc7f83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:24:48 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c09d8540-4210-44aa-8067-d74f7cd4256b tempest-ProjectReaderTests-1830827551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a34d969e-ef5d-48c4-b3e9-e295cad642b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:24:48 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c09d8540-4210-44aa-8067-d74f7cd4256b tempest-ProjectReaderTests-1830827551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a34d969e-ef5d-48c4-b3e9-e295cad642b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9606cca-99f4-41ee-90e3-811d0fc7178f', 'volume_name': 'volume-b9606cca-99f4-41ee-90e3-811d0fc7178f', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:24:48 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c09d8540-4210-44aa-8067-d74f7cd4256b tempest-ProjectReaderTests-1830827551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c16a612-abef-4484-a7b4-18f8e27ebe11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:24:48 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c09d8540-4210-44aa-8067-d74f7cd4256b tempest-ProjectReaderTests-1830827551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c16a612-abef-4484-a7b4-18f8e27ebe11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:24:48 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c09d8540-4210-44aa-8067-d74f7cd4256b tempest-ProjectReaderTests-1830827551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dad45bd6-99fb-4d4c-b00f-e53ce3814afe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:24:48 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-c09d8540-4210-44aa-8067-d74f7cd4256b tempest-ProjectReaderTests-1830827551 None] Volume b9606cca-99f4-41ee-90e3-811d0fc7178f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9606cca-99f4-41ee-90e3-811d0fc7178f', 'volume_size': 1} Nov 02 10:24:48 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c09d8540-4210-44aa-8067-d74f7cd4256b tempest-ProjectReaderTests-1830827551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:24:49 devstack sudo[105656]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:49 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c9828ce5-63f1-4412-b3a7-1e9a3a279690 tempest-ProjectReaderTests-779709804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-5d5276f3-1cea-4fe7-861d-4d7d6a763196 1073741824" returned: 0 in 0.422s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:49 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c9828ce5-63f1-4412-b3a7-1e9a3a279690 tempest-ProjectReaderTests-779709804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-5d5276f3-1cea-4fe7-861d-4d7d6a763196 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:49 devstack sudo[105662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-5d5276f3-1cea-4fe7-861d-4d7d6a763196 Nov 02 10:24:49 devstack sudo[105662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:49 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-aa4edcc0-3217-49d5-8f52-c62f4a4f84d6 tempest-ProjectMemberTests-406093346 None] Acquiring lock "cinder-5e7864d8-55e4-461b-9ec6-d076cadd0b38-delete_snapshot" by "delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:24:49 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-aa4edcc0-3217-49d5-8f52-c62f4a4f84d6 tempest-ProjectMemberTests-406093346 None] Lock "cinder-5e7864d8-55e4-461b-9ec6-d076cadd0b38-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:24:49 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-aa4edcc0-3217-49d5-8f52-c62f4a4f84d6 tempest-ProjectMemberTests-406093346 None] Acquiring lock "cinder-quobyte-b8c48418-f1f5-4882-a787-70a8829798c0" by "delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:24:49 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-aa4edcc0-3217-49d5-8f52-c62f4a4f84d6 tempest-ProjectMemberTests-406093346 None] Lock "cinder-quobyte-b8c48418-f1f5-4882-a787-70a8829798c0" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:24:49 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-aa4edcc0-3217-49d5-8f52-c62f4a4f84d6 tempest-ProjectMemberTests-406093346 None] Acquiring lock "cinder-quobyte-5e7864d8-55e4-461b-9ec6-d076cadd0b38" by "_delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:24:49 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-aa4edcc0-3217-49d5-8f52-c62f4a4f84d6 tempest-ProjectMemberTests-406093346 None] Lock "cinder-quobyte-5e7864d8-55e4-461b-9ec6-d076cadd0b38" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:24:49 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-aa4edcc0-3217-49d5-8f52-c62f4a4f84d6 tempest-ProjectMemberTests-406093346 None] Deleting offline snapshot 5e7864d8-55e4-461b-9ec6-d076cadd0b38 of volume b8c48418-f1f5-4882-a787-70a8829798c0 {{(pid=86890) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:24:49 devstack sudo[105662]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:49 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-aa4edcc0-3217-49d5-8f52-c62f4a4f84d6 tempest-ProjectMemberTests-406093346 None] snapshot_file for this snap is: volume-b8c48418-f1f5-4882-a787-70a8829798c0.5e7864d8-55e4-461b-9ec6-d076cadd0b38 {{(pid=86890) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:24:49 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c9828ce5-63f1-4412-b3a7-1e9a3a279690 tempest-ProjectReaderTests-779709804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-5d5276f3-1cea-4fe7-861d-4d7d6a763196" returned: 0 in 0.292s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:49 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c9828ce5-63f1-4412-b3a7-1e9a3a279690 tempest-ProjectReaderTests-779709804 None] <== create_volume: return (752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:24:49 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c9828ce5-63f1-4412-b3a7-1e9a3a279690 tempest-ProjectReaderTests-779709804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.754s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:24:49 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c09d8540-4210-44aa-8067-d74f7cd4256b tempest-ProjectReaderTests-1830827551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.639s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:24:49 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c09d8540-4210-44aa-8067-d74f7cd4256b tempest-ProjectReaderTests-1830827551 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:24:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1388468188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9606cca-99f4-41ee-90e3-811d0fc7178f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b072af995c54f0496d16f029566557b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:24:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:24:49Z,use_quota=True,user_id='bff003e260ef40d796330b26c8c06cf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:24:49 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-c09d8540-4210-44aa-8067-d74f7cd4256b tempest-ProjectReaderTests-1830827551 None] Creating volume b9606cca-99f4-41ee-90e3-811d0fc7178f {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:24:49 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c09d8540-4210-44aa-8067-d74f7cd4256b tempest-ProjectReaderTests-1830827551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:24:49 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c09d8540-4210-44aa-8067-d74f7cd4256b tempest-ProjectReaderTests-1830827551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:24:49 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c09d8540-4210-44aa-8067-d74f7cd4256b tempest-ProjectReaderTests-1830827551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:24:49 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c09d8540-4210-44aa-8067-d74f7cd4256b tempest-ProjectReaderTests-1830827551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:24:49 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c09d8540-4210-44aa-8067-d74f7cd4256b tempest-ProjectReaderTests-1830827551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:24:49 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c09d8540-4210-44aa-8067-d74f7cd4256b tempest-ProjectReaderTests-1830827551 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:24:49 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-c09d8540-4210-44aa-8067-d74f7cd4256b tempest-ProjectReaderTests-1830827551 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:24:49 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c09d8540-4210-44aa-8067-d74f7cd4256b tempest-ProjectReaderTests-1830827551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b9606cca-99f4-41ee-90e3-811d0fc7178f 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:49 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[42a9f32d-e09e-4c48-ad28-216d150a3ffb]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:24:49 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-aa4edcc0-3217-49d5-8f52-c62f4a4f84d6 tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b8c48418-f1f5-4882-a787-70a8829798c0.5e7864d8-55e4-461b-9ec6-d076cadd0b38 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:49 devstack sudo[105665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b9606cca-99f4-41ee-90e3-811d0fc7178f 1073741824 Nov 02 10:24:49 devstack sudo[105665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:49 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c9828ce5-63f1-4412-b3a7-1e9a3a279690 tempest-ProjectReaderTests-779709804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b74bdb4-1ac4-4427-a08b-f6af289414c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d5276f3-1cea-4fe7-861d-4d7d6a763196', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:24:49 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c9828ce5-63f1-4412-b3a7-1e9a3a279690 tempest-ProjectReaderTests-779709804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4675bd22-2edb-4e45-ba8a-0175cc6fe848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:24:49 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-c9828ce5-63f1-4412-b3a7-1e9a3a279690 tempest-ProjectReaderTests-779709804 None] Volume volume-5d5276f3-1cea-4fe7-861d-4d7d6a763196 (5d5276f3-1cea-4fe7-861d-4d7d6a763196): created successfully Nov 02 10:24:49 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c9828ce5-63f1-4412-b3a7-1e9a3a279690 tempest-ProjectReaderTests-779709804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4675bd22-2edb-4e45-ba8a-0175cc6fe848) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:24:49 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c9828ce5-63f1-4412-b3a7-1e9a3a279690 tempest-ProjectReaderTests-779709804 None] Flow 'volume_create_manager' (1fca35e8-4841-40a0-b3a6-5de4d6c74e78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:24:49 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-c9828ce5-63f1-4412-b3a7-1e9a3a279690 tempest-ProjectReaderTests-779709804 None] Created volume successfully. Nov 02 10:24:49 devstack sudo[105666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b8c48418-f1f5-4882-a787-70a8829798c0.5e7864d8-55e4-461b-9ec6-d076cadd0b38 Nov 02 10:24:49 devstack sudo[105666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:49 devstack sudo[105666]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:49 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-aa4edcc0-3217-49d5-8f52-c62f4a4f84d6 tempest-ProjectMemberTests-406093346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b8c48418-f1f5-4882-a787-70a8829798c0.5e7864d8-55e4-461b-9ec6-d076cadd0b38" returned: 0 in 0.380s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:49 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-aa4edcc0-3217-49d5-8f52-c62f4a4f84d6 tempest-ProjectMemberTests-406093346 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b8c48418-f1f5-4882-a787-70a8829798c0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86890) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:24:49 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2d82d6c-52c6-433b-8cdf-b054aa6ad4d0]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:24:49 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-aa4edcc0-3217-49d5-8f52-c62f4a4f84d6 tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b8c48418-f1f5-4882-a787-70a8829798c0 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:49 devstack sudo[105665]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:49 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c09d8540-4210-44aa-8067-d74f7cd4256b tempest-ProjectReaderTests-1830827551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b9606cca-99f4-41ee-90e3-811d0fc7178f 1073741824" returned: 0 in 0.448s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:49 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c09d8540-4210-44aa-8067-d74f7cd4256b tempest-ProjectReaderTests-1830827551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b9606cca-99f4-41ee-90e3-811d0fc7178f {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:49 devstack sudo[105677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b9606cca-99f4-41ee-90e3-811d0fc7178f Nov 02 10:24:49 devstack sudo[105677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:49 devstack sudo[105676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b8c48418-f1f5-4882-a787-70a8829798c0 Nov 02 10:24:49 devstack sudo[105676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:50 devstack sudo[105677]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:50 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c09d8540-4210-44aa-8067-d74f7cd4256b tempest-ProjectReaderTests-1830827551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b9606cca-99f4-41ee-90e3-811d0fc7178f" returned: 0 in 0.248s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:50 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c09d8540-4210-44aa-8067-d74f7cd4256b tempest-ProjectReaderTests-1830827551 None] <== create_volume: return (744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:24:50 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c09d8540-4210-44aa-8067-d74f7cd4256b tempest-ProjectReaderTests-1830827551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.747s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:24:50 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c09d8540-4210-44aa-8067-d74f7cd4256b tempest-ProjectReaderTests-1830827551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dad45bd6-99fb-4d4c-b00f-e53ce3814afe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9606cca-99f4-41ee-90e3-811d0fc7178f', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:24:50 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c09d8540-4210-44aa-8067-d74f7cd4256b tempest-ProjectReaderTests-1830827551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1557e441-00be-40c6-beee-f41cc4537327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:24:50 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-c09d8540-4210-44aa-8067-d74f7cd4256b tempest-ProjectReaderTests-1830827551 None] Volume volume-b9606cca-99f4-41ee-90e3-811d0fc7178f (b9606cca-99f4-41ee-90e3-811d0fc7178f): created successfully Nov 02 10:24:50 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c09d8540-4210-44aa-8067-d74f7cd4256b tempest-ProjectReaderTests-1830827551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1557e441-00be-40c6-beee-f41cc4537327) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:24:50 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c09d8540-4210-44aa-8067-d74f7cd4256b tempest-ProjectReaderTests-1830827551 None] Flow 'volume_create_manager' (bf9ef892-8be2-44af-b02d-88a55ae46f72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:24:50 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-c09d8540-4210-44aa-8067-d74f7cd4256b tempest-ProjectReaderTests-1830827551 None] Created volume successfully. Nov 02 10:24:50 devstack sudo[105676]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:50 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-aa4edcc0-3217-49d5-8f52-c62f4a4f84d6 tempest-ProjectMemberTests-406093346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b8c48418-f1f5-4882-a787-70a8829798c0" returned: 0 in 0.376s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:50 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-aa4edcc0-3217-49d5-8f52-c62f4a4f84d6 tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b8c48418-f1f5-4882-a787-70a8829798c0.5e7864d8-55e4-461b-9ec6-d076cadd0b38 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:50 devstack sudo[105684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b8c48418-f1f5-4882-a787-70a8829798c0.5e7864d8-55e4-461b-9ec6-d076cadd0b38 Nov 02 10:24:50 devstack sudo[105684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:50 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-399c4d00-3fbb-483b-8535-a9e5f670ac21 tempest-ProjectReaderTests-1830827551 None] Acquiring lock "cinder-b9606cca-99f4-41ee-90e3-811d0fc7178f-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:24:50 devstack sudo[105684]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:50 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-aa4edcc0-3217-49d5-8f52-c62f4a4f84d6 tempest-ProjectMemberTests-406093346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b8c48418-f1f5-4882-a787-70a8829798c0.5e7864d8-55e4-461b-9ec6-d076cadd0b38" returned: 0 in 0.419s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:50 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-aa4edcc0-3217-49d5-8f52-c62f4a4f84d6 tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b8c48418-f1f5-4882-a787-70a8829798c0.5e7864d8-55e4-461b-9ec6-d076cadd0b38 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:50 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-5b5cd413-645d-4d63-b506-d52a00ce7ba9 tempest-ProjectReaderTests-779709804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:24:50 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-5b5cd413-645d-4d63-b506-d52a00ce7ba9 tempest-ProjectReaderTests-779709804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:24:50 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-399c4d00-3fbb-483b-8535-a9e5f670ac21 tempest-ProjectReaderTests-1830827551 None] Lock "cinder-b9606cca-99f4-41ee-90e3-811d0fc7178f-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:24:50 devstack sudo[105689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b8c48418-f1f5-4882-a787-70a8829798c0.5e7864d8-55e4-461b-9ec6-d076cadd0b38 Nov 02 10:24:50 devstack sudo[105689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:50 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-5b5cd413-645d-4d63-b506-d52a00ce7ba9 tempest-ProjectReaderTests-779709804 None] Creating offline snapshot f8599edd-f6f3-414f-8f54-0a962959f313 of volume 5d5276f3-1cea-4fe7-861d-4d7d6a763196 {{(pid=86890) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:24:50 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9b844d4-829d-4f3c-9e7b-b4ae057e8192]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:24:50 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-5b5cd413-645d-4d63-b506-d52a00ce7ba9 tempest-ProjectReaderTests-779709804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-5d5276f3-1cea-4fe7-861d-4d7d6a763196 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:50 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-399c4d00-3fbb-483b-8535-a9e5f670ac21 tempest-ProjectReaderTests-1830827551 None] Acquiring lock "cinder-quobyte-b9606cca-99f4-41ee-90e3-811d0fc7178f" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:24:50 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-399c4d00-3fbb-483b-8535-a9e5f670ac21 tempest-ProjectReaderTests-1830827551 None] Lock "cinder-quobyte-b9606cca-99f4-41ee-90e3-811d0fc7178f" acquired by "delete_volume" :: waited 0.021s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:24:50 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[840c5009-f0a6-429c-8e19-382ab18aab30]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:24:50 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-399c4d00-3fbb-483b-8535-a9e5f670ac21 tempest-ProjectReaderTests-1830827551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b9606cca-99f4-41ee-90e3-811d0fc7178f {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:50 devstack sudo[105691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-5d5276f3-1cea-4fe7-861d-4d7d6a763196 Nov 02 10:24:50 devstack sudo[105691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:50 devstack sudo[105692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b9606cca-99f4-41ee-90e3-811d0fc7178f Nov 02 10:24:50 devstack sudo[105692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:50 devstack sudo[105689]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:50 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-aa4edcc0-3217-49d5-8f52-c62f4a4f84d6 tempest-ProjectMemberTests-406093346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b8c48418-f1f5-4882-a787-70a8829798c0.5e7864d8-55e4-461b-9ec6-d076cadd0b38" returned: 0 in 0.286s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:50 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-aa4edcc0-3217-49d5-8f52-c62f4a4f84d6 tempest-ProjectMemberTests-406093346 None] Lock "cinder-quobyte-5e7864d8-55e4-461b-9ec6-d076cadd0b38" released by "_delete_snapshot" :: held 1.626s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:24:50 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-aa4edcc0-3217-49d5-8f52-c62f4a4f84d6 tempest-ProjectMemberTests-406093346 None] Lock "cinder-quobyte-b8c48418-f1f5-4882-a787-70a8829798c0" released by "delete_snapshot" :: held 1.660s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:24:51 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-aa4edcc0-3217-49d5-8f52-c62f4a4f84d6 tempest-ProjectMemberTests-406093346 None] Created reservations ['8b5d8a54-4d99-4005-b791-84823d72e124', 'f833a468-be26-4446-9d9d-d737c7344e9d', '13af3320-c6c3-4644-8d14-4ffa5d10fd58', 'c5b4a1d4-72af-4713-8ef7-d3b70468d6d1'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:24:51 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-aa4edcc0-3217-49d5-8f52-c62f4a4f84d6 tempest-ProjectMemberTests-406093346 None] Delete snapshot completed successfully. Nov 02 10:24:51 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-aa4edcc0-3217-49d5-8f52-c62f4a4f84d6 tempest-ProjectMemberTests-406093346 None] Lock "cinder-5e7864d8-55e4-461b-9ec6-d076cadd0b38-delete_snapshot" released by "delete_snapshot" :: held 1.848s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:24:51 devstack sudo[105691]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:51 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-5b5cd413-645d-4d63-b506-d52a00ce7ba9 tempest-ProjectReaderTests-779709804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-5d5276f3-1cea-4fe7-861d-4d7d6a763196" returned: 0 in 0.459s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:51 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-5b5cd413-645d-4d63-b506-d52a00ce7ba9 tempest-ProjectReaderTests-779709804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-5d5276f3-1cea-4fe7-861d-4d7d6a763196,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-5d5276f3-1cea-4fe7-861d-4d7d6a763196.f8599edd-f6f3-414f-8f54-0a962959f313 1G {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:51 devstack sudo[105692]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:51 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-399c4d00-3fbb-483b-8535-a9e5f670ac21 tempest-ProjectReaderTests-1830827551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b9606cca-99f4-41ee-90e3-811d0fc7178f" returned: 0 in 0.422s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:51 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-399c4d00-3fbb-483b-8535-a9e5f670ac21 tempest-ProjectReaderTests-1830827551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b9606cca-99f4-41ee-90e3-811d0fc7178f {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:51 devstack sudo[105703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-5d5276f3-1cea-4fe7-861d-4d7d6a763196,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-5d5276f3-1cea-4fe7-861d-4d7d6a763196.f8599edd-f6f3-414f-8f54-0a962959f313 1G Nov 02 10:24:51 devstack sudo[105703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:51 devstack sudo[105704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b9606cca-99f4-41ee-90e3-811d0fc7178f Nov 02 10:24:51 devstack sudo[105704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:51 devstack sudo[105704]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:51 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-399c4d00-3fbb-483b-8535-a9e5f670ac21 tempest-ProjectReaderTests-1830827551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b9606cca-99f4-41ee-90e3-811d0fc7178f" returned: 0 in 0.268s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:51 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-399c4d00-3fbb-483b-8535-a9e5f670ac21 tempest-ProjectReaderTests-1830827551 None] Lock "cinder-quobyte-b9606cca-99f4-41ee-90e3-811d0fc7178f" released by "delete_volume" :: held 0.743s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:24:51 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-82e91abf-e518-4187-83cf-ac9e22a0bd7f tempest-ProjectMemberTests-406093346 None] Acquiring lock "cinder-b8c48418-f1f5-4882-a787-70a8829798c0-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:24:51 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-82e91abf-e518-4187-83cf-ac9e22a0bd7f tempest-ProjectMemberTests-406093346 None] Lock "cinder-b8c48418-f1f5-4882-a787-70a8829798c0-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:24:51 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-399c4d00-3fbb-483b-8535-a9e5f670ac21 tempest-ProjectReaderTests-1830827551 None] Created reservations ['e7860990-e3f7-4481-b04e-db3c51fab8a5', 'f42dfed7-22dd-4ca3-aef8-ef1928c75f0c', 'e34f4034-88bc-4787-8bb3-a2ee1b678392', '33b87059-fa43-4bbf-b5ef-9255e14ece2e'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:24:51 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-82e91abf-e518-4187-83cf-ac9e22a0bd7f tempest-ProjectMemberTests-406093346 None] Acquiring lock "cinder-quobyte-b8c48418-f1f5-4882-a787-70a8829798c0" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:24:51 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-82e91abf-e518-4187-83cf-ac9e22a0bd7f tempest-ProjectMemberTests-406093346 None] Lock "cinder-quobyte-b8c48418-f1f5-4882-a787-70a8829798c0" acquired by "delete_volume" :: waited 0.024s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:24:51 devstack sudo[105703]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:51 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-5b5cd413-645d-4d63-b506-d52a00ce7ba9 tempest-ProjectReaderTests-779709804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-5d5276f3-1cea-4fe7-861d-4d7d6a763196,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-5d5276f3-1cea-4fe7-861d-4d7d6a763196.f8599edd-f6f3-414f-8f54-0a962959f313 1G" returned: 0 in 0.511s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:51 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-5b5cd413-645d-4d63-b506-d52a00ce7ba9 tempest-ProjectReaderTests-779709804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d5276f3-1cea-4fe7-861d-4d7d6a763196 -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-5d5276f3-1cea-4fe7-861d-4d7d6a763196.f8599edd-f6f3-414f-8f54-0a962959f313 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:51 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[75d3627b-4b77-4f67-9608-f65279033081]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:24:51 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-82e91abf-e518-4187-83cf-ac9e22a0bd7f tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b8c48418-f1f5-4882-a787-70a8829798c0 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:51 devstack sudo[105712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d5276f3-1cea-4fe7-861d-4d7d6a763196 -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-5d5276f3-1cea-4fe7-861d-4d7d6a763196.f8599edd-f6f3-414f-8f54-0a962959f313 Nov 02 10:24:51 devstack sudo[105712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:51 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-399c4d00-3fbb-483b-8535-a9e5f670ac21 tempest-ProjectReaderTests-1830827551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:24:51 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-399c4d00-3fbb-483b-8535-a9e5f670ac21 tempest-ProjectReaderTests-1830827551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:24:51 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-399c4d00-3fbb-483b-8535-a9e5f670ac21 tempest-ProjectReaderTests-1830827551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:24:51 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-399c4d00-3fbb-483b-8535-a9e5f670ac21 tempest-ProjectReaderTests-1830827551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:24:51 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-399c4d00-3fbb-483b-8535-a9e5f670ac21 tempest-ProjectReaderTests-1830827551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:24:51 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-399c4d00-3fbb-483b-8535-a9e5f670ac21 tempest-ProjectReaderTests-1830827551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:51 devstack sudo[105715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:24:51 devstack sudo[105715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:51 devstack sudo[105713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b8c48418-f1f5-4882-a787-70a8829798c0 Nov 02 10:24:51 devstack sudo[105713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:52 devstack sudo[105715]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:52 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-399c4d00-3fbb-483b-8535-a9e5f670ac21 tempest-ProjectReaderTests-1830827551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.309s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:52 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-399c4d00-3fbb-483b-8535-a9e5f670ac21 tempest-ProjectReaderTests-1830827551 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:24:52 devstack sudo[105712]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:52 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-5b5cd413-645d-4d63-b506-d52a00ce7ba9 tempest-ProjectReaderTests-779709804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d5276f3-1cea-4fe7-861d-4d7d6a763196 -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-5d5276f3-1cea-4fe7-861d-4d7d6a763196.f8599edd-f6f3-414f-8f54-0a962959f313" returned: 0 in 0.391s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:52 devstack cinder-volume[86890]: WARNING cinder.volume.drivers.remotefs [None req-5b5cd413-645d-4d63-b506-d52a00ce7ba9 tempest-ProjectReaderTests-779709804 None] /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-5d5276f3-1cea-4fe7-861d-4d7d6a763196.f8599edd-f6f3-414f-8f54-0a962959f313 is being set with open permissions: ugo+rw Nov 02 10:24:52 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-5b5cd413-645d-4d63-b506-d52a00ce7ba9 tempest-ProjectReaderTests-779709804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-5d5276f3-1cea-4fe7-861d-4d7d6a763196.f8599edd-f6f3-414f-8f54-0a962959f313 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:52 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-399c4d00-3fbb-483b-8535-a9e5f670ac21 tempest-ProjectReaderTests-1830827551 None] Deleted volume successfully. Nov 02 10:24:52 devstack sudo[105726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-5d5276f3-1cea-4fe7-861d-4d7d6a763196.f8599edd-f6f3-414f-8f54-0a962959f313 Nov 02 10:24:52 devstack sudo[105726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:52 devstack sudo[105713]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:52 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-399c4d00-3fbb-483b-8535-a9e5f670ac21 tempest-ProjectReaderTests-1830827551 None] Lock "cinder-b9606cca-99f4-41ee-90e3-811d0fc7178f-delete_volume" released by "delete_volume" :: held 1.489s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:24:52 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-82e91abf-e518-4187-83cf-ac9e22a0bd7f tempest-ProjectMemberTests-406093346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b8c48418-f1f5-4882-a787-70a8829798c0" returned: 0 in 0.453s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:52 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-82e91abf-e518-4187-83cf-ac9e22a0bd7f tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b8c48418-f1f5-4882-a787-70a8829798c0 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:52 devstack sudo[105728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b8c48418-f1f5-4882-a787-70a8829798c0 Nov 02 10:24:52 devstack sudo[105728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:52 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecf99645-95ed-45dd-8145-8c0686c53582 tempest-ProjectReaderTests-1830827551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:24:52 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-ecf99645-95ed-45dd-8145-8c0686c53582 tempest-ProjectReaderTests-1830827551 None] Flow 'volume_create_manager' (ad209e53-800c-4924-a274-b04d0f996aca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:24:52 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-ecf99645-95ed-45dd-8145-8c0686c53582 tempest-ProjectReaderTests-1830827551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be3a04f2-b1e3-48dc-8787-141a02dbaeaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:24:52 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-ecf99645-95ed-45dd-8145-8c0686c53582 tempest-ProjectReaderTests-1830827551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be3a04f2-b1e3-48dc-8787-141a02dbaeaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:24:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1657913462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb1d37ea-bc5a-4a87-b35b-ee3ca2b3915a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b072af995c54f0496d16f029566557b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:24:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:24:52Z,use_quota=True,user_id='bff003e260ef40d796330b26c8c06cf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:24:52 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-ecf99645-95ed-45dd-8145-8c0686c53582 tempest-ProjectReaderTests-1830827551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abcf851a-e284-4ba1-b42c-6e77fefc11f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:24:52 devstack sudo[105726]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:52 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-ecf99645-95ed-45dd-8145-8c0686c53582 tempest-ProjectReaderTests-1830827551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abcf851a-e284-4ba1-b42c-6e77fefc11f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:24:52 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-ecf99645-95ed-45dd-8145-8c0686c53582 tempest-ProjectReaderTests-1830827551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf0fad04-9ba5-421a-910b-efe4a93279db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:24:52 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-ecf99645-95ed-45dd-8145-8c0686c53582 tempest-ProjectReaderTests-1830827551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf0fad04-9ba5-421a-910b-efe4a93279db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb1d37ea-bc5a-4a87-b35b-ee3ca2b3915a', 'volume_name': 'volume-eb1d37ea-bc5a-4a87-b35b-ee3ca2b3915a', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:24:52 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-ecf99645-95ed-45dd-8145-8c0686c53582 tempest-ProjectReaderTests-1830827551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d37cd06-ef61-48bb-a616-5cc7947eac2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:24:52 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-ecf99645-95ed-45dd-8145-8c0686c53582 tempest-ProjectReaderTests-1830827551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d37cd06-ef61-48bb-a616-5cc7947eac2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:24:52 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-ecf99645-95ed-45dd-8145-8c0686c53582 tempest-ProjectReaderTests-1830827551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9968a2c2-b2c1-40cd-91f4-77056546fbb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:24:52 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-ecf99645-95ed-45dd-8145-8c0686c53582 tempest-ProjectReaderTests-1830827551 None] Volume eb1d37ea-bc5a-4a87-b35b-ee3ca2b3915a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb1d37ea-bc5a-4a87-b35b-ee3ca2b3915a', 'volume_size': 1} Nov 02 10:24:52 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-ecf99645-95ed-45dd-8145-8c0686c53582 tempest-ProjectReaderTests-1830827551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:24:52 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-5b5cd413-645d-4d63-b506-d52a00ce7ba9 tempest-ProjectReaderTests-779709804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-5d5276f3-1cea-4fe7-861d-4d7d6a763196.f8599edd-f6f3-414f-8f54-0a962959f313" returned: 0 in 0.332s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:52 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-5b5cd413-645d-4d63-b506-d52a00ce7ba9 tempest-ProjectReaderTests-779709804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-5d5276f3-1cea-4fe7-861d-4d7d6a763196.info {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:52 devstack sudo[105728]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:52 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-82e91abf-e518-4187-83cf-ac9e22a0bd7f tempest-ProjectMemberTests-406093346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b8c48418-f1f5-4882-a787-70a8829798c0" returned: 0 in 0.291s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:52 devstack sudo[105732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-5d5276f3-1cea-4fe7-861d-4d7d6a763196.info Nov 02 10:24:52 devstack sudo[105732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:52 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-82e91abf-e518-4187-83cf-ac9e22a0bd7f tempest-ProjectMemberTests-406093346 None] Lock "cinder-quobyte-b8c48418-f1f5-4882-a787-70a8829798c0" released by "delete_volume" :: held 0.818s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:24:52 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-82e91abf-e518-4187-83cf-ac9e22a0bd7f tempest-ProjectMemberTests-406093346 None] Created reservations ['03e3ac0e-9ab6-467c-b7cf-02f7fdd7484e', 'fb00a8e4-139b-4f39-9773-aa215b9a2d12', 'ec7861c7-e49a-45c0-b8e2-19b2721fe163', 'b24c5f4d-cc74-4eba-aca8-a671fe3583c0'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:24:52 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-82e91abf-e518-4187-83cf-ac9e22a0bd7f tempest-ProjectMemberTests-406093346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:24:52 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-82e91abf-e518-4187-83cf-ac9e22a0bd7f tempest-ProjectMemberTests-406093346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:24:52 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-82e91abf-e518-4187-83cf-ac9e22a0bd7f tempest-ProjectMemberTests-406093346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:24:52 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-82e91abf-e518-4187-83cf-ac9e22a0bd7f tempest-ProjectMemberTests-406093346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:24:52 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-82e91abf-e518-4187-83cf-ac9e22a0bd7f tempest-ProjectMemberTests-406093346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:24:52 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-82e91abf-e518-4187-83cf-ac9e22a0bd7f tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:52 devstack sudo[105734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:24:52 devstack sudo[105734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:52 devstack sudo[105732]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:52 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-5b5cd413-645d-4d63-b506-d52a00ce7ba9 tempest-ProjectReaderTests-779709804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-5d5276f3-1cea-4fe7-861d-4d7d6a763196.info" returned: 0 in 0.295s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:52 devstack cinder-volume[86890]: WARNING cinder.volume.drivers.remotefs [None req-5b5cd413-645d-4d63-b506-d52a00ce7ba9 tempest-ProjectReaderTests-779709804 None] /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-5d5276f3-1cea-4fe7-861d-4d7d6a763196.info is being set with open permissions: ugo+rw Nov 02 10:24:52 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-5b5cd413-645d-4d63-b506-d52a00ce7ba9 tempest-ProjectReaderTests-779709804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-5d5276f3-1cea-4fe7-861d-4d7d6a763196.info {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:52 devstack sudo[105737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-5d5276f3-1cea-4fe7-861d-4d7d6a763196.info Nov 02 10:24:52 devstack sudo[105737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:52 devstack sudo[105734]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:52 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-82e91abf-e518-4187-83cf-ac9e22a0bd7f tempest-ProjectMemberTests-406093346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.281s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:52 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-82e91abf-e518-4187-83cf-ac9e22a0bd7f tempest-ProjectMemberTests-406093346 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:24:52 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-82e91abf-e518-4187-83cf-ac9e22a0bd7f tempest-ProjectMemberTests-406093346 None] Deleted volume successfully. Nov 02 10:24:52 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-82e91abf-e518-4187-83cf-ac9e22a0bd7f tempest-ProjectMemberTests-406093346 None] Lock "cinder-b8c48418-f1f5-4882-a787-70a8829798c0-delete_volume" released by "delete_volume" :: held 1.361s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:24:52 devstack sudo[105737]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:52 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-5b5cd413-645d-4d63-b506-d52a00ce7ba9 tempest-ProjectReaderTests-779709804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-5d5276f3-1cea-4fe7-861d-4d7d6a763196.info" returned: 0 in 0.261s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:53 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-5b5cd413-645d-4d63-b506-d52a00ce7ba9 tempest-ProjectReaderTests-779709804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.365s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:24:53 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-ecf99645-95ed-45dd-8145-8c0686c53582 tempest-ProjectReaderTests-1830827551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.613s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:24:53 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-ecf99645-95ed-45dd-8145-8c0686c53582 tempest-ProjectReaderTests-1830827551 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:24:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1657913462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb1d37ea-bc5a-4a87-b35b-ee3ca2b3915a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b072af995c54f0496d16f029566557b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:24:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:24:52Z,use_quota=True,user_id='bff003e260ef40d796330b26c8c06cf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:24:53 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-ecf99645-95ed-45dd-8145-8c0686c53582 tempest-ProjectReaderTests-1830827551 None] Creating volume eb1d37ea-bc5a-4a87-b35b-ee3ca2b3915a {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:24:53 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-ecf99645-95ed-45dd-8145-8c0686c53582 tempest-ProjectReaderTests-1830827551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:24:53 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-ecf99645-95ed-45dd-8145-8c0686c53582 tempest-ProjectReaderTests-1830827551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:24:53 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-ecf99645-95ed-45dd-8145-8c0686c53582 tempest-ProjectReaderTests-1830827551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:24:53 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-ecf99645-95ed-45dd-8145-8c0686c53582 tempest-ProjectReaderTests-1830827551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:24:53 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-ecf99645-95ed-45dd-8145-8c0686c53582 tempest-ProjectReaderTests-1830827551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:24:53 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-ecf99645-95ed-45dd-8145-8c0686c53582 tempest-ProjectReaderTests-1830827551 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:24:53 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-ecf99645-95ed-45dd-8145-8c0686c53582 tempest-ProjectReaderTests-1830827551 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:24:53 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ecf99645-95ed-45dd-8145-8c0686c53582 tempest-ProjectReaderTests-1830827551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-eb1d37ea-bc5a-4a87-b35b-ee3ca2b3915a 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:53 devstack sudo[105741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-eb1d37ea-bc5a-4a87-b35b-ee3ca2b3915a 1073741824 Nov 02 10:24:53 devstack sudo[105741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:53 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-5b5cd413-645d-4d63-b506-d52a00ce7ba9 tempest-ProjectReaderTests-779709804 None] Create snapshot completed successfully Nov 02 10:24:53 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-9bcf567e-274a-4d0e-9652-29af716758b4 tempest-ProjectMemberTests-406093346 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:24:53 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-9bcf567e-274a-4d0e-9652-29af716758b4 tempest-ProjectMemberTests-406093346 None] Flow 'volume_create_manager' (bd43557f-1607-43e3-9790-cef60e8225eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:24:53 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-9bcf567e-274a-4d0e-9652-29af716758b4 tempest-ProjectMemberTests-406093346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5d0cde2-0891-4dea-822d-15f251146d71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:24:53 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-9bcf567e-274a-4d0e-9652-29af716758b4 tempest-ProjectMemberTests-406093346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5d0cde2-0891-4dea-822d-15f251146d71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:24:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-327737151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df7dec79-7a52-4026-8016-a857736c8c52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='639ad964aa1b416eb473afb3c18dd4e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:24:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:24:53Z,use_quota=True,user_id='076db3d85c064198aa1722b31937515d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:24:53 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-9bcf567e-274a-4d0e-9652-29af716758b4 tempest-ProjectMemberTests-406093346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9c6e7d6-1c6c-498d-9e86-6829fbb258b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:24:53 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-9bcf567e-274a-4d0e-9652-29af716758b4 tempest-ProjectMemberTests-406093346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9c6e7d6-1c6c-498d-9e86-6829fbb258b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:24:53 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-9bcf567e-274a-4d0e-9652-29af716758b4 tempest-ProjectMemberTests-406093346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c712cafc-79f9-4308-b2f8-b764bdc148bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:24:53 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-9bcf567e-274a-4d0e-9652-29af716758b4 tempest-ProjectMemberTests-406093346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c712cafc-79f9-4308-b2f8-b764bdc148bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df7dec79-7a52-4026-8016-a857736c8c52', 'volume_name': 'volume-df7dec79-7a52-4026-8016-a857736c8c52', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:24:53 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-9bcf567e-274a-4d0e-9652-29af716758b4 tempest-ProjectMemberTests-406093346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe011ba0-63e5-446e-a0d5-3db6ce1e0efe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:24:53 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-9bcf567e-274a-4d0e-9652-29af716758b4 tempest-ProjectMemberTests-406093346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe011ba0-63e5-446e-a0d5-3db6ce1e0efe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:24:53 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-9bcf567e-274a-4d0e-9652-29af716758b4 tempest-ProjectMemberTests-406093346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (264a1091-e7bb-4cfd-92cf-5094c8a1030a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:24:53 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-9bcf567e-274a-4d0e-9652-29af716758b4 tempest-ProjectMemberTests-406093346 None] Volume df7dec79-7a52-4026-8016-a857736c8c52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df7dec79-7a52-4026-8016-a857736c8c52', 'volume_size': 1} Nov 02 10:24:53 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-9bcf567e-274a-4d0e-9652-29af716758b4 tempest-ProjectMemberTests-406093346 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:24:53 devstack sudo[105741]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:53 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ecf99645-95ed-45dd-8145-8c0686c53582 tempest-ProjectReaderTests-1830827551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-eb1d37ea-bc5a-4a87-b35b-ee3ca2b3915a 1073741824" returned: 0 in 0.452s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:53 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ecf99645-95ed-45dd-8145-8c0686c53582 tempest-ProjectReaderTests-1830827551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-eb1d37ea-bc5a-4a87-b35b-ee3ca2b3915a {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:53 devstack sudo[105747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-eb1d37ea-bc5a-4a87-b35b-ee3ca2b3915a Nov 02 10:24:53 devstack sudo[105747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:53 devstack sudo[105747]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:53 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-2c4daf4f-f241-4434-9edf-d0f2abe998ff tempest-ProjectReaderTests-779709804 None] Acquiring lock "cinder-f8599edd-f6f3-414f-8f54-0a962959f313-delete_snapshot" by "delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:24:53 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ecf99645-95ed-45dd-8145-8c0686c53582 tempest-ProjectReaderTests-1830827551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-eb1d37ea-bc5a-4a87-b35b-ee3ca2b3915a" returned: 0 in 0.269s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:53 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-ecf99645-95ed-45dd-8145-8c0686c53582 tempest-ProjectReaderTests-1830827551 None] <== create_volume: return (763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:24:53 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-ecf99645-95ed-45dd-8145-8c0686c53582 tempest-ProjectReaderTests-1830827551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.768s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:24:53 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-9bcf567e-274a-4d0e-9652-29af716758b4 tempest-ProjectMemberTests-406093346 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.514s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:24:53 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-9bcf567e-274a-4d0e-9652-29af716758b4 tempest-ProjectMemberTests-406093346 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:24:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-327737151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df7dec79-7a52-4026-8016-a857736c8c52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='639ad964aa1b416eb473afb3c18dd4e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:24:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:24:53Z,use_quota=True,user_id='076db3d85c064198aa1722b31937515d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:24:53 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-9bcf567e-274a-4d0e-9652-29af716758b4 tempest-ProjectMemberTests-406093346 None] Creating volume df7dec79-7a52-4026-8016-a857736c8c52 {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:24:53 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-9bcf567e-274a-4d0e-9652-29af716758b4 tempest-ProjectMemberTests-406093346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:24:53 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-9bcf567e-274a-4d0e-9652-29af716758b4 tempest-ProjectMemberTests-406093346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:24:53 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-9bcf567e-274a-4d0e-9652-29af716758b4 tempest-ProjectMemberTests-406093346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:24:53 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-9bcf567e-274a-4d0e-9652-29af716758b4 tempest-ProjectMemberTests-406093346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:24:53 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-9bcf567e-274a-4d0e-9652-29af716758b4 tempest-ProjectMemberTests-406093346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:24:53 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-9bcf567e-274a-4d0e-9652-29af716758b4 tempest-ProjectMemberTests-406093346 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:24:53 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-9bcf567e-274a-4d0e-9652-29af716758b4 tempest-ProjectMemberTests-406093346 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:24:53 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-9bcf567e-274a-4d0e-9652-29af716758b4 tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-df7dec79-7a52-4026-8016-a857736c8c52 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:53 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-2c4daf4f-f241-4434-9edf-d0f2abe998ff tempest-ProjectReaderTests-779709804 None] Lock "cinder-f8599edd-f6f3-414f-8f54-0a962959f313-delete_snapshot" acquired by "delete_snapshot" :: waited 0.056s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:24:53 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-2c4daf4f-f241-4434-9edf-d0f2abe998ff tempest-ProjectReaderTests-779709804 None] Acquiring lock "cinder-quobyte-5d5276f3-1cea-4fe7-861d-4d7d6a763196" by "delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:24:53 devstack sudo[105750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-df7dec79-7a52-4026-8016-a857736c8c52 1073741824 Nov 02 10:24:53 devstack sudo[105750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:53 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-ecf99645-95ed-45dd-8145-8c0686c53582 tempest-ProjectReaderTests-1830827551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9968a2c2-b2c1-40cd-91f4-77056546fbb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb1d37ea-bc5a-4a87-b35b-ee3ca2b3915a', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:24:53 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-ecf99645-95ed-45dd-8145-8c0686c53582 tempest-ProjectReaderTests-1830827551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ee7d477-51b0-43a8-8660-72638d97c989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:24:53 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-ecf99645-95ed-45dd-8145-8c0686c53582 tempest-ProjectReaderTests-1830827551 None] Volume volume-eb1d37ea-bc5a-4a87-b35b-ee3ca2b3915a (eb1d37ea-bc5a-4a87-b35b-ee3ca2b3915a): created successfully Nov 02 10:24:53 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-ecf99645-95ed-45dd-8145-8c0686c53582 tempest-ProjectReaderTests-1830827551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ee7d477-51b0-43a8-8660-72638d97c989) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:24:53 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-ecf99645-95ed-45dd-8145-8c0686c53582 tempest-ProjectReaderTests-1830827551 None] Flow 'volume_create_manager' (ad209e53-800c-4924-a274-b04d0f996aca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:24:53 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-2c4daf4f-f241-4434-9edf-d0f2abe998ff tempest-ProjectReaderTests-779709804 None] Lock "cinder-quobyte-5d5276f3-1cea-4fe7-861d-4d7d6a763196" acquired by "delete_snapshot" :: waited 0.048s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:24:53 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-2c4daf4f-f241-4434-9edf-d0f2abe998ff tempest-ProjectReaderTests-779709804 None] Acquiring lock "cinder-quobyte-f8599edd-f6f3-414f-8f54-0a962959f313" by "_delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:24:53 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-ecf99645-95ed-45dd-8145-8c0686c53582 tempest-ProjectReaderTests-1830827551 None] Created volume successfully. Nov 02 10:24:53 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-2c4daf4f-f241-4434-9edf-d0f2abe998ff tempest-ProjectReaderTests-779709804 None] Lock "cinder-quobyte-f8599edd-f6f3-414f-8f54-0a962959f313" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:24:53 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-2c4daf4f-f241-4434-9edf-d0f2abe998ff tempest-ProjectReaderTests-779709804 None] Deleting offline snapshot f8599edd-f6f3-414f-8f54-0a962959f313 of volume 5d5276f3-1cea-4fe7-861d-4d7d6a763196 {{(pid=86890) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:24:53 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-2c4daf4f-f241-4434-9edf-d0f2abe998ff tempest-ProjectReaderTests-779709804 None] snapshot_file for this snap is: volume-5d5276f3-1cea-4fe7-861d-4d7d6a763196.f8599edd-f6f3-414f-8f54-0a962959f313 {{(pid=86890) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:24:53 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[1778b4ad-a4ec-40ea-9c70-70254f38b483]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:24:53 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-2c4daf4f-f241-4434-9edf-d0f2abe998ff tempest-ProjectReaderTests-779709804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-5d5276f3-1cea-4fe7-861d-4d7d6a763196.f8599edd-f6f3-414f-8f54-0a962959f313 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:54 devstack sudo[105752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-5d5276f3-1cea-4fe7-861d-4d7d6a763196.f8599edd-f6f3-414f-8f54-0a962959f313 Nov 02 10:24:54 devstack sudo[105752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:54 devstack sudo[105750]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:54 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-9bcf567e-274a-4d0e-9652-29af716758b4 tempest-ProjectMemberTests-406093346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-df7dec79-7a52-4026-8016-a857736c8c52 1073741824" returned: 0 in 0.496s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:54 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-9bcf567e-274a-4d0e-9652-29af716758b4 tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-df7dec79-7a52-4026-8016-a857736c8c52 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:54 devstack sudo[105762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-df7dec79-7a52-4026-8016-a857736c8c52 Nov 02 10:24:54 devstack sudo[105762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:54 devstack sudo[105752]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:54 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-2c4daf4f-f241-4434-9edf-d0f2abe998ff tempest-ProjectReaderTests-779709804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-5d5276f3-1cea-4fe7-861d-4d7d6a763196.f8599edd-f6f3-414f-8f54-0a962959f313" returned: 0 in 0.441s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:54 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-2c4daf4f-f241-4434-9edf-d0f2abe998ff tempest-ProjectReaderTests-779709804 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5d5276f3-1cea-4fe7-861d-4d7d6a763196(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86890) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:24:54 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0d4c623-6b01-4151-98d1-5e51884db56c]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:24:54 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-2c4daf4f-f241-4434-9edf-d0f2abe998ff tempest-ProjectReaderTests-779709804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-5d5276f3-1cea-4fe7-861d-4d7d6a763196 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:54 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-30766b11-73f2-4067-986a-d6e136d28245 tempest-ProjectReaderTests-1830827551 None] Acquiring lock "cinder-eb1d37ea-bc5a-4a87-b35b-ee3ca2b3915a-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:24:54 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-30766b11-73f2-4067-986a-d6e136d28245 tempest-ProjectReaderTests-1830827551 None] Lock "cinder-eb1d37ea-bc5a-4a87-b35b-ee3ca2b3915a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:24:54 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-30766b11-73f2-4067-986a-d6e136d28245 tempest-ProjectReaderTests-1830827551 None] Acquiring lock "cinder-quobyte-eb1d37ea-bc5a-4a87-b35b-ee3ca2b3915a" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:24:54 devstack sudo[105764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-5d5276f3-1cea-4fe7-861d-4d7d6a763196 Nov 02 10:24:54 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-30766b11-73f2-4067-986a-d6e136d28245 tempest-ProjectReaderTests-1830827551 None] Lock "cinder-quobyte-eb1d37ea-bc5a-4a87-b35b-ee3ca2b3915a" acquired by "delete_volume" :: waited 0.021s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:24:54 devstack sudo[105764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:54 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[cca461bd-d9c5-4dfb-b5e9-49af5354ffea]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:24:54 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-30766b11-73f2-4067-986a-d6e136d28245 tempest-ProjectReaderTests-1830827551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-eb1d37ea-bc5a-4a87-b35b-ee3ca2b3915a {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:54 devstack sudo[105762]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:54 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-9bcf567e-274a-4d0e-9652-29af716758b4 tempest-ProjectMemberTests-406093346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-df7dec79-7a52-4026-8016-a857736c8c52" returned: 0 in 0.271s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:54 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-9bcf567e-274a-4d0e-9652-29af716758b4 tempest-ProjectMemberTests-406093346 None] <== create_volume: return (834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:24:54 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-9bcf567e-274a-4d0e-9652-29af716758b4 tempest-ProjectMemberTests-406093346 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.837s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:24:54 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-9bcf567e-274a-4d0e-9652-29af716758b4 tempest-ProjectMemberTests-406093346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (264a1091-e7bb-4cfd-92cf-5094c8a1030a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df7dec79-7a52-4026-8016-a857736c8c52', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:24:54 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-9bcf567e-274a-4d0e-9652-29af716758b4 tempest-ProjectMemberTests-406093346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc2f6e95-9639-431c-9d09-2e9c2df30bef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:24:54 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-9bcf567e-274a-4d0e-9652-29af716758b4 tempest-ProjectMemberTests-406093346 None] Volume volume-df7dec79-7a52-4026-8016-a857736c8c52 (df7dec79-7a52-4026-8016-a857736c8c52): created successfully Nov 02 10:24:54 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-9bcf567e-274a-4d0e-9652-29af716758b4 tempest-ProjectMemberTests-406093346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc2f6e95-9639-431c-9d09-2e9c2df30bef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:24:54 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-9bcf567e-274a-4d0e-9652-29af716758b4 tempest-ProjectMemberTests-406093346 None] Flow 'volume_create_manager' (bd43557f-1607-43e3-9790-cef60e8225eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:24:54 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-9bcf567e-274a-4d0e-9652-29af716758b4 tempest-ProjectMemberTests-406093346 None] Created volume successfully. Nov 02 10:24:54 devstack sudo[105767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-eb1d37ea-bc5a-4a87-b35b-ee3ca2b3915a Nov 02 10:24:54 devstack sudo[105767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:54 devstack sudo[105764]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:54 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-2c4daf4f-f241-4434-9edf-d0f2abe998ff tempest-ProjectReaderTests-779709804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-5d5276f3-1cea-4fe7-861d-4d7d6a763196" returned: 0 in 0.430s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:54 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-2c4daf4f-f241-4434-9edf-d0f2abe998ff tempest-ProjectReaderTests-779709804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-5d5276f3-1cea-4fe7-861d-4d7d6a763196.f8599edd-f6f3-414f-8f54-0a962959f313 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:54 devstack sudo[105772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-5d5276f3-1cea-4fe7-861d-4d7d6a763196.f8599edd-f6f3-414f-8f54-0a962959f313 Nov 02 10:24:54 devstack sudo[105772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:55 devstack sudo[105767]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:55 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-30766b11-73f2-4067-986a-d6e136d28245 tempest-ProjectReaderTests-1830827551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-eb1d37ea-bc5a-4a87-b35b-ee3ca2b3915a" returned: 0 in 0.437s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:55 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-30766b11-73f2-4067-986a-d6e136d28245 tempest-ProjectReaderTests-1830827551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-eb1d37ea-bc5a-4a87-b35b-ee3ca2b3915a {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:55 devstack sudo[105777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-eb1d37ea-bc5a-4a87-b35b-ee3ca2b3915a Nov 02 10:24:55 devstack sudo[105777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:55 devstack sudo[105772]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:55 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-2c4daf4f-f241-4434-9edf-d0f2abe998ff tempest-ProjectReaderTests-779709804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-5d5276f3-1cea-4fe7-861d-4d7d6a763196.f8599edd-f6f3-414f-8f54-0a962959f313" returned: 0 in 0.350s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:55 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-2c4daf4f-f241-4434-9edf-d0f2abe998ff tempest-ProjectReaderTests-779709804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-5d5276f3-1cea-4fe7-861d-4d7d6a763196.f8599edd-f6f3-414f-8f54-0a962959f313 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:55 devstack sudo[105782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-5d5276f3-1cea-4fe7-861d-4d7d6a763196.f8599edd-f6f3-414f-8f54-0a962959f313 Nov 02 10:24:55 devstack sudo[105782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:55 devstack sudo[105777]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:55 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-30766b11-73f2-4067-986a-d6e136d28245 tempest-ProjectReaderTests-1830827551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-eb1d37ea-bc5a-4a87-b35b-ee3ca2b3915a" returned: 0 in 0.284s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:55 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-30766b11-73f2-4067-986a-d6e136d28245 tempest-ProjectReaderTests-1830827551 None] Lock "cinder-quobyte-eb1d37ea-bc5a-4a87-b35b-ee3ca2b3915a" released by "delete_volume" :: held 0.782s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:24:55 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-30766b11-73f2-4067-986a-d6e136d28245 tempest-ProjectReaderTests-1830827551 None] Created reservations ['4be8f5d2-858e-4258-afdd-c6aaa450023d', '17a82280-8bd7-48b1-b826-710513fdac9e', 'd79789fb-f637-42d6-969a-5e97db56400f', '9a737f21-c3b7-4f7b-99aa-eed7985bd6eb'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:24:55 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c9da03f4-adba-4249-ab6f-84af4af50106 tempest-ProjectMemberTests-406093346 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:24:55 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c9da03f4-adba-4249-ab6f-84af4af50106 tempest-ProjectMemberTests-406093346 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:24:55 devstack sudo[105782]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:55 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-30766b11-73f2-4067-986a-d6e136d28245 tempest-ProjectReaderTests-1830827551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:24:55 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-30766b11-73f2-4067-986a-d6e136d28245 tempest-ProjectReaderTests-1830827551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:24:55 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-30766b11-73f2-4067-986a-d6e136d28245 tempest-ProjectReaderTests-1830827551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:24:55 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-30766b11-73f2-4067-986a-d6e136d28245 tempest-ProjectReaderTests-1830827551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:24:55 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-30766b11-73f2-4067-986a-d6e136d28245 tempest-ProjectReaderTests-1830827551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:24:55 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-30766b11-73f2-4067-986a-d6e136d28245 tempest-ProjectReaderTests-1830827551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:55 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-2c4daf4f-f241-4434-9edf-d0f2abe998ff tempest-ProjectReaderTests-779709804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-5d5276f3-1cea-4fe7-861d-4d7d6a763196.f8599edd-f6f3-414f-8f54-0a962959f313" returned: 0 in 0.338s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:55 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-c9da03f4-adba-4249-ab6f-84af4af50106 tempest-ProjectMemberTests-406093346 None] Creating offline snapshot 8ac5fa67-7935-4f8d-964b-f4e83e652c98 of volume df7dec79-7a52-4026-8016-a857736c8c52 {{(pid=86890) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:24:55 devstack sudo[105786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:24:55 devstack sudo[105786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:55 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0094eb0-3e21-4bb9-8bd1-9eca8afa463e]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:24:55 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c9da03f4-adba-4249-ab6f-84af4af50106 tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-df7dec79-7a52-4026-8016-a857736c8c52 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:55 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-2c4daf4f-f241-4434-9edf-d0f2abe998ff tempest-ProjectReaderTests-779709804 None] Lock "cinder-quobyte-f8599edd-f6f3-414f-8f54-0a962959f313" released by "_delete_snapshot" :: held 1.729s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:24:55 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-2c4daf4f-f241-4434-9edf-d0f2abe998ff tempest-ProjectReaderTests-779709804 None] Lock "cinder-quobyte-5d5276f3-1cea-4fe7-861d-4d7d6a763196" released by "delete_snapshot" :: held 1.762s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:24:55 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-2c4daf4f-f241-4434-9edf-d0f2abe998ff tempest-ProjectReaderTests-779709804 None] Created reservations ['90aa5ab8-e344-4aaf-b4db-350d4873a7e7', '6efb6e93-33f3-4fdc-b359-6c347b21df6a', '58f324cb-e27b-4742-87a1-284dee8ab8f0', '2a06a20c-cb2b-440f-baac-e5579c9ae6ba'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:24:55 devstack sudo[105788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-df7dec79-7a52-4026-8016-a857736c8c52 Nov 02 10:24:55 devstack sudo[105788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:55 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-2c4daf4f-f241-4434-9edf-d0f2abe998ff tempest-ProjectReaderTests-779709804 None] Delete snapshot completed successfully. Nov 02 10:24:55 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-2c4daf4f-f241-4434-9edf-d0f2abe998ff tempest-ProjectReaderTests-779709804 None] Lock "cinder-f8599edd-f6f3-414f-8f54-0a962959f313-delete_snapshot" released by "delete_snapshot" :: held 1.983s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:24:55 devstack sudo[105786]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:55 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-30766b11-73f2-4067-986a-d6e136d28245 tempest-ProjectReaderTests-1830827551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.329s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:55 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-30766b11-73f2-4067-986a-d6e136d28245 tempest-ProjectReaderTests-1830827551 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:24:55 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-30766b11-73f2-4067-986a-d6e136d28245 tempest-ProjectReaderTests-1830827551 None] Deleted volume successfully. Nov 02 10:24:55 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-30766b11-73f2-4067-986a-d6e136d28245 tempest-ProjectReaderTests-1830827551 None] Lock "cinder-eb1d37ea-bc5a-4a87-b35b-ee3ca2b3915a-delete_volume" released by "delete_volume" :: held 1.436s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:24:55 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-79b39e1f-4de5-411c-b1c4-cd91f88bb11a tempest-ProjectReaderTests-779709804 None] Acquiring lock "cinder-5d5276f3-1cea-4fe7-861d-4d7d6a763196-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:24:56 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-79b39e1f-4de5-411c-b1c4-cd91f88bb11a tempest-ProjectReaderTests-779709804 None] Lock "cinder-5d5276f3-1cea-4fe7-861d-4d7d6a763196-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:24:56 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-79b39e1f-4de5-411c-b1c4-cd91f88bb11a tempest-ProjectReaderTests-779709804 None] Acquiring lock "cinder-quobyte-5d5276f3-1cea-4fe7-861d-4d7d6a763196" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:24:56 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-79b39e1f-4de5-411c-b1c4-cd91f88bb11a tempest-ProjectReaderTests-779709804 None] Lock "cinder-quobyte-5d5276f3-1cea-4fe7-861d-4d7d6a763196" acquired by "delete_volume" :: waited 0.016s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:24:56 devstack sudo[105788]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:56 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c9da03f4-adba-4249-ab6f-84af4af50106 tempest-ProjectMemberTests-406093346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-df7dec79-7a52-4026-8016-a857736c8c52" returned: 0 in 0.496s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:56 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c9da03f4-adba-4249-ab6f-84af4af50106 tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-df7dec79-7a52-4026-8016-a857736c8c52,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-df7dec79-7a52-4026-8016-a857736c8c52.8ac5fa67-7935-4f8d-964b-f4e83e652c98 1G {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:56 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[17e8a6fe-a983-402e-a31d-40c78e5604e6]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:24:56 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-79b39e1f-4de5-411c-b1c4-cd91f88bb11a tempest-ProjectReaderTests-779709804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-5d5276f3-1cea-4fe7-861d-4d7d6a763196 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:56 devstack sudo[105795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-df7dec79-7a52-4026-8016-a857736c8c52,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-df7dec79-7a52-4026-8016-a857736c8c52.8ac5fa67-7935-4f8d-964b-f4e83e652c98 1G Nov 02 10:24:56 devstack sudo[105795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:56 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-c18eb919-6f45-4685-ae3e-878b2e6428df tempest-ProjectReaderTests-1830827551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:24:56 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c18eb919-6f45-4685-ae3e-878b2e6428df tempest-ProjectReaderTests-1830827551 None] Flow 'volume_create_manager' (00299975-90ec-42e9-b868-fa7ea97c8fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:24:56 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c18eb919-6f45-4685-ae3e-878b2e6428df tempest-ProjectReaderTests-1830827551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2ed7858-2528-4d97-bdb3-6e871e3d754f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:24:56 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c18eb919-6f45-4685-ae3e-878b2e6428df tempest-ProjectReaderTests-1830827551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2ed7858-2528-4d97-bdb3-6e871e3d754f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:24:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2127267670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f4e4857-e100-4aa3-ad78-4c2f115e56db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b072af995c54f0496d16f029566557b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:24:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:24:56Z,use_quota=True,user_id='bff003e260ef40d796330b26c8c06cf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:24:56 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c18eb919-6f45-4685-ae3e-878b2e6428df tempest-ProjectReaderTests-1830827551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0aea5fd-3a87-4ca3-a152-c4b4f50fdf2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:24:56 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c18eb919-6f45-4685-ae3e-878b2e6428df tempest-ProjectReaderTests-1830827551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0aea5fd-3a87-4ca3-a152-c4b4f50fdf2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:24:56 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c18eb919-6f45-4685-ae3e-878b2e6428df tempest-ProjectReaderTests-1830827551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e46669a6-31f4-47f9-86d1-d2374e41126d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:24:56 devstack sudo[105796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-5d5276f3-1cea-4fe7-861d-4d7d6a763196 Nov 02 10:24:56 devstack sudo[105796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:56 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c18eb919-6f45-4685-ae3e-878b2e6428df tempest-ProjectReaderTests-1830827551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e46669a6-31f4-47f9-86d1-d2374e41126d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f4e4857-e100-4aa3-ad78-4c2f115e56db', 'volume_name': 'volume-8f4e4857-e100-4aa3-ad78-4c2f115e56db', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:24:56 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c18eb919-6f45-4685-ae3e-878b2e6428df tempest-ProjectReaderTests-1830827551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (808e0868-05dd-46ad-b7f6-290e46077625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:24:56 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c18eb919-6f45-4685-ae3e-878b2e6428df tempest-ProjectReaderTests-1830827551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (808e0868-05dd-46ad-b7f6-290e46077625) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:24:56 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c18eb919-6f45-4685-ae3e-878b2e6428df tempest-ProjectReaderTests-1830827551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49eaabc9-5e3f-4cce-879f-279cfd8ec417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:24:56 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-c18eb919-6f45-4685-ae3e-878b2e6428df tempest-ProjectReaderTests-1830827551 None] Volume 8f4e4857-e100-4aa3-ad78-4c2f115e56db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f4e4857-e100-4aa3-ad78-4c2f115e56db', 'volume_size': 1} Nov 02 10:24:56 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c18eb919-6f45-4685-ae3e-878b2e6428df tempest-ProjectReaderTests-1830827551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:24:56 devstack sudo[105796]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:56 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-79b39e1f-4de5-411c-b1c4-cd91f88bb11a tempest-ProjectReaderTests-779709804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-5d5276f3-1cea-4fe7-861d-4d7d6a763196" returned: 0 in 0.390s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:56 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-79b39e1f-4de5-411c-b1c4-cd91f88bb11a tempest-ProjectReaderTests-779709804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-5d5276f3-1cea-4fe7-861d-4d7d6a763196 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:56 devstack sudo[105795]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:56 devstack sudo[105805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-5d5276f3-1cea-4fe7-861d-4d7d6a763196 Nov 02 10:24:56 devstack sudo[105805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:56 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c9da03f4-adba-4249-ab6f-84af4af50106 tempest-ProjectMemberTests-406093346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-df7dec79-7a52-4026-8016-a857736c8c52,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-df7dec79-7a52-4026-8016-a857736c8c52.8ac5fa67-7935-4f8d-964b-f4e83e652c98 1G" returned: 0 in 0.432s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:56 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c9da03f4-adba-4249-ab6f-84af4af50106 tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df7dec79-7a52-4026-8016-a857736c8c52 -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-df7dec79-7a52-4026-8016-a857736c8c52.8ac5fa67-7935-4f8d-964b-f4e83e652c98 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:56 devstack sudo[105807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df7dec79-7a52-4026-8016-a857736c8c52 -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-df7dec79-7a52-4026-8016-a857736c8c52.8ac5fa67-7935-4f8d-964b-f4e83e652c98 Nov 02 10:24:56 devstack sudo[105807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:56 devstack sudo[105805]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:56 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-79b39e1f-4de5-411c-b1c4-cd91f88bb11a tempest-ProjectReaderTests-779709804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-5d5276f3-1cea-4fe7-861d-4d7d6a763196" returned: 0 in 0.256s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:56 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-79b39e1f-4de5-411c-b1c4-cd91f88bb11a tempest-ProjectReaderTests-779709804 None] Lock "cinder-quobyte-5d5276f3-1cea-4fe7-861d-4d7d6a763196" released by "delete_volume" :: held 0.730s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:24:56 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-79b39e1f-4de5-411c-b1c4-cd91f88bb11a tempest-ProjectReaderTests-779709804 None] Created reservations ['307048e1-6a2a-4d59-891c-080fb8783bc5', '439265c0-f1f3-43ec-a641-12671b466a75', '260dadf6-62e7-4268-9355-862b129cd082', 'a1529868-47fe-4063-99a2-6e67a3fa4c33'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:24:56 devstack sudo[105807]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:56 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c9da03f4-adba-4249-ab6f-84af4af50106 tempest-ProjectMemberTests-406093346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df7dec79-7a52-4026-8016-a857736c8c52 -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-df7dec79-7a52-4026-8016-a857736c8c52.8ac5fa67-7935-4f8d-964b-f4e83e652c98" returned: 0 in 0.347s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:56 devstack cinder-volume[86890]: WARNING cinder.volume.drivers.remotefs [None req-c9da03f4-adba-4249-ab6f-84af4af50106 tempest-ProjectMemberTests-406093346 None] /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-df7dec79-7a52-4026-8016-a857736c8c52.8ac5fa67-7935-4f8d-964b-f4e83e652c98 is being set with open permissions: ugo+rw Nov 02 10:24:56 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c9da03f4-adba-4249-ab6f-84af4af50106 tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-df7dec79-7a52-4026-8016-a857736c8c52.8ac5fa67-7935-4f8d-964b-f4e83e652c98 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:56 devstack sudo[105814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-df7dec79-7a52-4026-8016-a857736c8c52.8ac5fa67-7935-4f8d-964b-f4e83e652c98 Nov 02 10:24:56 devstack sudo[105814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:56 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-79b39e1f-4de5-411c-b1c4-cd91f88bb11a tempest-ProjectReaderTests-779709804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:24:56 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-79b39e1f-4de5-411c-b1c4-cd91f88bb11a tempest-ProjectReaderTests-779709804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:24:56 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-79b39e1f-4de5-411c-b1c4-cd91f88bb11a tempest-ProjectReaderTests-779709804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:24:56 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-79b39e1f-4de5-411c-b1c4-cd91f88bb11a tempest-ProjectReaderTests-779709804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:24:56 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-79b39e1f-4de5-411c-b1c4-cd91f88bb11a tempest-ProjectReaderTests-779709804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:24:56 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-79b39e1f-4de5-411c-b1c4-cd91f88bb11a tempest-ProjectReaderTests-779709804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:56 devstack sudo[105816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:24:56 devstack sudo[105816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:57 devstack sudo[105814]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:57 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c9da03f4-adba-4249-ab6f-84af4af50106 tempest-ProjectMemberTests-406093346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-df7dec79-7a52-4026-8016-a857736c8c52.8ac5fa67-7935-4f8d-964b-f4e83e652c98" returned: 0 in 0.265s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:57 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c9da03f4-adba-4249-ab6f-84af4af50106 tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-df7dec79-7a52-4026-8016-a857736c8c52.info {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:57 devstack sudo[105816]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:57 devstack sudo[105820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-df7dec79-7a52-4026-8016-a857736c8c52.info Nov 02 10:24:57 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-79b39e1f-4de5-411c-b1c4-cd91f88bb11a tempest-ProjectReaderTests-779709804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.282s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:57 devstack sudo[105820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:57 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-79b39e1f-4de5-411c-b1c4-cd91f88bb11a tempest-ProjectReaderTests-779709804 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:24:57 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-79b39e1f-4de5-411c-b1c4-cd91f88bb11a tempest-ProjectReaderTests-779709804 None] Deleted volume successfully. Nov 02 10:24:57 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-79b39e1f-4de5-411c-b1c4-cd91f88bb11a tempest-ProjectReaderTests-779709804 None] Lock "cinder-5d5276f3-1cea-4fe7-861d-4d7d6a763196-delete_volume" released by "delete_volume" :: held 1.247s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:24:57 devstack sudo[105820]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:57 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c9da03f4-adba-4249-ab6f-84af4af50106 tempest-ProjectMemberTests-406093346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-df7dec79-7a52-4026-8016-a857736c8c52.info" returned: 0 in 0.274s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:57 devstack cinder-volume[86890]: WARNING cinder.volume.drivers.remotefs [None req-c9da03f4-adba-4249-ab6f-84af4af50106 tempest-ProjectMemberTests-406093346 None] /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-df7dec79-7a52-4026-8016-a857736c8c52.info is being set with open permissions: ugo+rw Nov 02 10:24:57 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c9da03f4-adba-4249-ab6f-84af4af50106 tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-df7dec79-7a52-4026-8016-a857736c8c52.info {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:57 devstack sudo[105823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-df7dec79-7a52-4026-8016-a857736c8c52.info Nov 02 10:24:57 devstack sudo[105823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:57 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5d38d6a-5913-4b26-a778-033ed447a634 tempest-ProjectReaderTests-779709804 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:24:57 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-a5d38d6a-5913-4b26-a778-033ed447a634 tempest-ProjectReaderTests-779709804 None] Flow 'volume_create_manager' (569022d3-3c99-4af6-958d-a210e42abc83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:24:57 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-a5d38d6a-5913-4b26-a778-033ed447a634 tempest-ProjectReaderTests-779709804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2619843-b45a-47f0-9414-f80b3b35be46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:24:57 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-a5d38d6a-5913-4b26-a778-033ed447a634 tempest-ProjectReaderTests-779709804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2619843-b45a-47f0-9414-f80b3b35be46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:24:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-883537736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d2e346e-3762-450f-a671-8425bf1f04e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a88c80344544473c8d2457c14d0db292',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:24:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:24:58Z,use_quota=True,user_id='830d06ded8694a4dae7d1bfd5f316394',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:24:57 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-a5d38d6a-5913-4b26-a778-033ed447a634 tempest-ProjectReaderTests-779709804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3830f2e4-e04a-42f1-ad70-8dff53a383ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:24:57 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-a5d38d6a-5913-4b26-a778-033ed447a634 tempest-ProjectReaderTests-779709804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3830f2e4-e04a-42f1-ad70-8dff53a383ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:24:57 devstack sudo[105823]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:57 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-a5d38d6a-5913-4b26-a778-033ed447a634 tempest-ProjectReaderTests-779709804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0da4791f-b66b-4e51-a876-2a9fcf685352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:24:57 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-a5d38d6a-5913-4b26-a778-033ed447a634 tempest-ProjectReaderTests-779709804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0da4791f-b66b-4e51-a876-2a9fcf685352) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d2e346e-3762-450f-a671-8425bf1f04e7', 'volume_name': 'volume-3d2e346e-3762-450f-a671-8425bf1f04e7', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:24:57 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-a5d38d6a-5913-4b26-a778-033ed447a634 tempest-ProjectReaderTests-779709804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0fb4d84-c859-4452-bb61-d8f8c395972a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:24:57 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-a5d38d6a-5913-4b26-a778-033ed447a634 tempest-ProjectReaderTests-779709804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0fb4d84-c859-4452-bb61-d8f8c395972a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:24:57 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-a5d38d6a-5913-4b26-a778-033ed447a634 tempest-ProjectReaderTests-779709804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e79d07d-e4b5-4cc7-ba23-01b4603f38e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:24:57 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-a5d38d6a-5913-4b26-a778-033ed447a634 tempest-ProjectReaderTests-779709804 None] Volume 3d2e346e-3762-450f-a671-8425bf1f04e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d2e346e-3762-450f-a671-8425bf1f04e7', 'volume_size': 1} Nov 02 10:24:57 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-a5d38d6a-5913-4b26-a778-033ed447a634 tempest-ProjectReaderTests-779709804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:24:57 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c9da03f4-adba-4249-ab6f-84af4af50106 tempest-ProjectMemberTests-406093346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-df7dec79-7a52-4026-8016-a857736c8c52.info" returned: 0 in 0.312s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:57 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c9da03f4-adba-4249-ab6f-84af4af50106 tempest-ProjectMemberTests-406093346 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.264s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:24:57 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c18eb919-6f45-4685-ae3e-878b2e6428df tempest-ProjectReaderTests-1830827551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.528s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:24:57 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c18eb919-6f45-4685-ae3e-878b2e6428df tempest-ProjectReaderTests-1830827551 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:24:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2127267670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f4e4857-e100-4aa3-ad78-4c2f115e56db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b072af995c54f0496d16f029566557b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:24:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:24:56Z,use_quota=True,user_id='bff003e260ef40d796330b26c8c06cf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:24:57 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-c18eb919-6f45-4685-ae3e-878b2e6428df tempest-ProjectReaderTests-1830827551 None] Creating volume 8f4e4857-e100-4aa3-ad78-4c2f115e56db {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:24:57 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c18eb919-6f45-4685-ae3e-878b2e6428df tempest-ProjectReaderTests-1830827551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:24:57 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c18eb919-6f45-4685-ae3e-878b2e6428df tempest-ProjectReaderTests-1830827551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:24:57 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c18eb919-6f45-4685-ae3e-878b2e6428df tempest-ProjectReaderTests-1830827551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:24:57 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c18eb919-6f45-4685-ae3e-878b2e6428df tempest-ProjectReaderTests-1830827551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:24:57 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c18eb919-6f45-4685-ae3e-878b2e6428df tempest-ProjectReaderTests-1830827551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:24:57 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c18eb919-6f45-4685-ae3e-878b2e6428df tempest-ProjectReaderTests-1830827551 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:24:57 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-c18eb919-6f45-4685-ae3e-878b2e6428df tempest-ProjectReaderTests-1830827551 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:24:57 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c18eb919-6f45-4685-ae3e-878b2e6428df tempest-ProjectReaderTests-1830827551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-8f4e4857-e100-4aa3-ad78-4c2f115e56db 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:57 devstack sudo[105826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-8f4e4857-e100-4aa3-ad78-4c2f115e56db 1073741824 Nov 02 10:24:57 devstack sudo[105826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:57 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-c9da03f4-adba-4249-ab6f-84af4af50106 tempest-ProjectMemberTests-406093346 None] Create snapshot completed successfully Nov 02 10:24:58 devstack sudo[105826]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:58 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c18eb919-6f45-4685-ae3e-878b2e6428df tempest-ProjectReaderTests-1830827551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-8f4e4857-e100-4aa3-ad78-4c2f115e56db 1073741824" returned: 0 in 0.446s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:58 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c18eb919-6f45-4685-ae3e-878b2e6428df tempest-ProjectReaderTests-1830827551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-8f4e4857-e100-4aa3-ad78-4c2f115e56db {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:58 devstack sudo[105832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-8f4e4857-e100-4aa3-ad78-4c2f115e56db Nov 02 10:24:58 devstack sudo[105832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:58 devstack sudo[105832]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:58 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c18eb919-6f45-4685-ae3e-878b2e6428df tempest-ProjectReaderTests-1830827551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-8f4e4857-e100-4aa3-ad78-4c2f115e56db" returned: 0 in 0.240s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:58 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c18eb919-6f45-4685-ae3e-878b2e6428df tempest-ProjectReaderTests-1830827551 None] <== create_volume: return (723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:24:58 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c18eb919-6f45-4685-ae3e-878b2e6428df tempest-ProjectReaderTests-1830827551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.727s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:24:58 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-a5d38d6a-5913-4b26-a778-033ed447a634 tempest-ProjectReaderTests-779709804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.754s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:24:58 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-a5d38d6a-5913-4b26-a778-033ed447a634 tempest-ProjectReaderTests-779709804 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:24:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-883537736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d2e346e-3762-450f-a671-8425bf1f04e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a88c80344544473c8d2457c14d0db292',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:24:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:24:58Z,use_quota=True,user_id='830d06ded8694a4dae7d1bfd5f316394',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:24:58 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-a5d38d6a-5913-4b26-a778-033ed447a634 tempest-ProjectReaderTests-779709804 None] Creating volume 3d2e346e-3762-450f-a671-8425bf1f04e7 {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:24:58 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-a5d38d6a-5913-4b26-a778-033ed447a634 tempest-ProjectReaderTests-779709804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:24:58 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-a5d38d6a-5913-4b26-a778-033ed447a634 tempest-ProjectReaderTests-779709804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:24:58 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-a5d38d6a-5913-4b26-a778-033ed447a634 tempest-ProjectReaderTests-779709804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:24:58 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-a5d38d6a-5913-4b26-a778-033ed447a634 tempest-ProjectReaderTests-779709804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:24:58 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-a5d38d6a-5913-4b26-a778-033ed447a634 tempest-ProjectReaderTests-779709804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:24:58 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-a5d38d6a-5913-4b26-a778-033ed447a634 tempest-ProjectReaderTests-779709804 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:24:58 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-a5d38d6a-5913-4b26-a778-033ed447a634 tempest-ProjectReaderTests-779709804 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:24:58 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a5d38d6a-5913-4b26-a778-033ed447a634 tempest-ProjectReaderTests-779709804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3d2e346e-3762-450f-a671-8425bf1f04e7 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:58 devstack sudo[105835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3d2e346e-3762-450f-a671-8425bf1f04e7 1073741824 Nov 02 10:24:58 devstack sudo[105835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:58 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c18eb919-6f45-4685-ae3e-878b2e6428df tempest-ProjectReaderTests-1830827551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49eaabc9-5e3f-4cce-879f-279cfd8ec417) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f4e4857-e100-4aa3-ad78-4c2f115e56db', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:24:58 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c18eb919-6f45-4685-ae3e-878b2e6428df tempest-ProjectReaderTests-1830827551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f79a40f2-bd6a-47cd-a1fa-e03dfc0ee5aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:24:58 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-c18eb919-6f45-4685-ae3e-878b2e6428df tempest-ProjectReaderTests-1830827551 None] Volume volume-8f4e4857-e100-4aa3-ad78-4c2f115e56db (8f4e4857-e100-4aa3-ad78-4c2f115e56db): created successfully Nov 02 10:24:58 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c18eb919-6f45-4685-ae3e-878b2e6428df tempest-ProjectReaderTests-1830827551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f79a40f2-bd6a-47cd-a1fa-e03dfc0ee5aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:24:58 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c18eb919-6f45-4685-ae3e-878b2e6428df tempest-ProjectReaderTests-1830827551 None] Flow 'volume_create_manager' (00299975-90ec-42e9-b868-fa7ea97c8fd9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:24:58 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-c18eb919-6f45-4685-ae3e-878b2e6428df tempest-ProjectReaderTests-1830827551 None] Created volume successfully. Nov 02 10:24:58 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-bbb65bd6-73ac-45d2-b651-2d30e2dfc40c tempest-ProjectMemberTests-406093346 None] Acquiring lock "cinder-8ac5fa67-7935-4f8d-964b-f4e83e652c98-delete_snapshot" by "delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:24:58 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-bbb65bd6-73ac-45d2-b651-2d30e2dfc40c tempest-ProjectMemberTests-406093346 None] Lock "cinder-8ac5fa67-7935-4f8d-964b-f4e83e652c98-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:24:58 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-bbb65bd6-73ac-45d2-b651-2d30e2dfc40c tempest-ProjectMemberTests-406093346 None] Acquiring lock "cinder-quobyte-df7dec79-7a52-4026-8016-a857736c8c52" by "delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:24:58 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-bbb65bd6-73ac-45d2-b651-2d30e2dfc40c tempest-ProjectMemberTests-406093346 None] Lock "cinder-quobyte-df7dec79-7a52-4026-8016-a857736c8c52" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:24:58 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-bbb65bd6-73ac-45d2-b651-2d30e2dfc40c tempest-ProjectMemberTests-406093346 None] Acquiring lock "cinder-quobyte-8ac5fa67-7935-4f8d-964b-f4e83e652c98" by "_delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:24:58 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-bbb65bd6-73ac-45d2-b651-2d30e2dfc40c tempest-ProjectMemberTests-406093346 None] Lock "cinder-quobyte-8ac5fa67-7935-4f8d-964b-f4e83e652c98" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:24:58 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-bbb65bd6-73ac-45d2-b651-2d30e2dfc40c tempest-ProjectMemberTests-406093346 None] Deleting offline snapshot 8ac5fa67-7935-4f8d-964b-f4e83e652c98 of volume df7dec79-7a52-4026-8016-a857736c8c52 {{(pid=86890) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:24:58 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-bbb65bd6-73ac-45d2-b651-2d30e2dfc40c tempest-ProjectMemberTests-406093346 None] snapshot_file for this snap is: volume-df7dec79-7a52-4026-8016-a857736c8c52.8ac5fa67-7935-4f8d-964b-f4e83e652c98 {{(pid=86890) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:24:58 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[611e6f3a-1d93-4eef-a200-677baa8b7c77]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:24:58 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-bbb65bd6-73ac-45d2-b651-2d30e2dfc40c tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-df7dec79-7a52-4026-8016-a857736c8c52.8ac5fa67-7935-4f8d-964b-f4e83e652c98 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:58 devstack sudo[105840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-df7dec79-7a52-4026-8016-a857736c8c52.8ac5fa67-7935-4f8d-964b-f4e83e652c98 Nov 02 10:24:58 devstack sudo[105840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:58 devstack sudo[105835]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:59 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a5d38d6a-5913-4b26-a778-033ed447a634 tempest-ProjectReaderTests-779709804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3d2e346e-3762-450f-a671-8425bf1f04e7 1073741824" returned: 0 in 0.466s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:59 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a5d38d6a-5913-4b26-a778-033ed447a634 tempest-ProjectReaderTests-779709804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3d2e346e-3762-450f-a671-8425bf1f04e7 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:59 devstack sudo[105842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3d2e346e-3762-450f-a671-8425bf1f04e7 Nov 02 10:24:59 devstack sudo[105842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:59 devstack sudo[105840]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:59 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-bbb65bd6-73ac-45d2-b651-2d30e2dfc40c tempest-ProjectMemberTests-406093346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-df7dec79-7a52-4026-8016-a857736c8c52.8ac5fa67-7935-4f8d-964b-f4e83e652c98" returned: 0 in 0.364s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:59 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-bbb65bd6-73ac-45d2-b651-2d30e2dfc40c tempest-ProjectMemberTests-406093346 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-df7dec79-7a52-4026-8016-a857736c8c52(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86890) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:24:59 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[48cfbf6c-5b6f-43c3-9853-484ccd44e25f]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:24:59 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-bbb65bd6-73ac-45d2-b651-2d30e2dfc40c tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-df7dec79-7a52-4026-8016-a857736c8c52 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:59 devstack sudo[105842]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:59 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-a5d38d6a-5913-4b26-a778-033ed447a634 tempest-ProjectReaderTests-779709804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3d2e346e-3762-450f-a671-8425bf1f04e7" returned: 0 in 0.276s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:59 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-a5d38d6a-5913-4b26-a778-033ed447a634 tempest-ProjectReaderTests-779709804 None] <== create_volume: return (787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:24:59 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-a5d38d6a-5913-4b26-a778-033ed447a634 tempest-ProjectReaderTests-779709804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.790s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:24:59 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-667968ec-e091-4989-9256-e9ff8dd08330 tempest-ProjectReaderTests-1830827551 None] Acquiring lock "cinder-8f4e4857-e100-4aa3-ad78-4c2f115e56db-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:24:59 devstack sudo[105847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-df7dec79-7a52-4026-8016-a857736c8c52 Nov 02 10:24:59 devstack sudo[105847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:59 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-a5d38d6a-5913-4b26-a778-033ed447a634 tempest-ProjectReaderTests-779709804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e79d07d-e4b5-4cc7-ba23-01b4603f38e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d2e346e-3762-450f-a671-8425bf1f04e7', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:24:59 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-a5d38d6a-5913-4b26-a778-033ed447a634 tempest-ProjectReaderTests-779709804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2938ff8-9aa8-4763-9986-3b14e28fbb77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:24:59 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-667968ec-e091-4989-9256-e9ff8dd08330 tempest-ProjectReaderTests-1830827551 None] Lock "cinder-8f4e4857-e100-4aa3-ad78-4c2f115e56db-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:24:59 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-a5d38d6a-5913-4b26-a778-033ed447a634 tempest-ProjectReaderTests-779709804 None] Volume volume-3d2e346e-3762-450f-a671-8425bf1f04e7 (3d2e346e-3762-450f-a671-8425bf1f04e7): created successfully Nov 02 10:24:59 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-a5d38d6a-5913-4b26-a778-033ed447a634 tempest-ProjectReaderTests-779709804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2938ff8-9aa8-4763-9986-3b14e28fbb77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:24:59 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-a5d38d6a-5913-4b26-a778-033ed447a634 tempest-ProjectReaderTests-779709804 None] Flow 'volume_create_manager' (569022d3-3c99-4af6-958d-a210e42abc83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:24:59 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-a5d38d6a-5913-4b26-a778-033ed447a634 tempest-ProjectReaderTests-779709804 None] Created volume successfully. Nov 02 10:24:59 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-667968ec-e091-4989-9256-e9ff8dd08330 tempest-ProjectReaderTests-1830827551 None] Acquiring lock "cinder-quobyte-8f4e4857-e100-4aa3-ad78-4c2f115e56db" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:24:59 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-667968ec-e091-4989-9256-e9ff8dd08330 tempest-ProjectReaderTests-1830827551 None] Lock "cinder-quobyte-8f4e4857-e100-4aa3-ad78-4c2f115e56db" acquired by "delete_volume" :: waited 0.019s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:24:59 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e7662e7-b918-4885-b1aa-914c96866971]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:24:59 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-667968ec-e091-4989-9256-e9ff8dd08330 tempest-ProjectReaderTests-1830827551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-8f4e4857-e100-4aa3-ad78-4c2f115e56db {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:59 devstack sudo[105850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-8f4e4857-e100-4aa3-ad78-4c2f115e56db Nov 02 10:24:59 devstack sudo[105850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:59 devstack sudo[105847]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:59 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-bbb65bd6-73ac-45d2-b651-2d30e2dfc40c tempest-ProjectMemberTests-406093346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-df7dec79-7a52-4026-8016-a857736c8c52" returned: 0 in 0.423s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:59 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-bbb65bd6-73ac-45d2-b651-2d30e2dfc40c tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-df7dec79-7a52-4026-8016-a857736c8c52.8ac5fa67-7935-4f8d-964b-f4e83e652c98 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:59 devstack sudo[105855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-df7dec79-7a52-4026-8016-a857736c8c52.8ac5fa67-7935-4f8d-964b-f4e83e652c98 Nov 02 10:24:59 devstack sudo[105855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:59 devstack sudo[105850]: pam_unix(sudo:session): session closed for user root Nov 02 10:24:59 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-667968ec-e091-4989-9256-e9ff8dd08330 tempest-ProjectReaderTests-1830827551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-8f4e4857-e100-4aa3-ad78-4c2f115e56db" returned: 0 in 0.464s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:24:59 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-667968ec-e091-4989-9256-e9ff8dd08330 tempest-ProjectReaderTests-1830827551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-8f4e4857-e100-4aa3-ad78-4c2f115e56db {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:24:59 devstack sudo[105863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-8f4e4857-e100-4aa3-ad78-4c2f115e56db Nov 02 10:24:59 devstack sudo[105863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:24:59 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-d5c58a91-1fd6-4953-adc7-7d3152146651 tempest-ProjectReaderTests-779709804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:24:59 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-d5c58a91-1fd6-4953-adc7-7d3152146651 tempest-ProjectReaderTests-779709804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:24:59 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-d5c58a91-1fd6-4953-adc7-7d3152146651 tempest-ProjectReaderTests-779709804 None] Creating offline snapshot 462f6b75-753f-41ae-9360-a5cfa30e5a03 of volume 3d2e346e-3762-450f-a671-8425bf1f04e7 {{(pid=86890) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:25:00 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[6263b0d7-e5b0-416d-bbc6-479d6289c8d1]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:25:00 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-d5c58a91-1fd6-4953-adc7-7d3152146651 tempest-ProjectReaderTests-779709804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3d2e346e-3762-450f-a671-8425bf1f04e7 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:00 devstack sudo[105855]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:00 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-bbb65bd6-73ac-45d2-b651-2d30e2dfc40c tempest-ProjectMemberTests-406093346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-df7dec79-7a52-4026-8016-a857736c8c52.8ac5fa67-7935-4f8d-964b-f4e83e652c98" returned: 0 in 0.402s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:00 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-bbb65bd6-73ac-45d2-b651-2d30e2dfc40c tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-df7dec79-7a52-4026-8016-a857736c8c52.8ac5fa67-7935-4f8d-964b-f4e83e652c98 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:00 devstack sudo[105867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-df7dec79-7a52-4026-8016-a857736c8c52.8ac5fa67-7935-4f8d-964b-f4e83e652c98 Nov 02 10:25:00 devstack sudo[105867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:00 devstack sudo[105866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3d2e346e-3762-450f-a671-8425bf1f04e7 Nov 02 10:25:00 devstack sudo[105866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:00 devstack sudo[105863]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:00 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-667968ec-e091-4989-9256-e9ff8dd08330 tempest-ProjectReaderTests-1830827551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-8f4e4857-e100-4aa3-ad78-4c2f115e56db" returned: 0 in 0.300s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:00 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-667968ec-e091-4989-9256-e9ff8dd08330 tempest-ProjectReaderTests-1830827551 None] Lock "cinder-quobyte-8f4e4857-e100-4aa3-ad78-4c2f115e56db" released by "delete_volume" :: held 0.804s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:25:00 devstack sudo[105867]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:00 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-667968ec-e091-4989-9256-e9ff8dd08330 tempest-ProjectReaderTests-1830827551 None] Created reservations ['af51b69d-6561-4952-a56f-a8f9364300fe', '7d8cb18a-db63-4e23-acb9-ae16eef9557d', 'eda406fa-3727-40c9-8931-b943bf056c11', '5508d0ee-65fa-46ff-b158-5fa58f4b7315'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:25:00 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-bbb65bd6-73ac-45d2-b651-2d30e2dfc40c tempest-ProjectMemberTests-406093346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-df7dec79-7a52-4026-8016-a857736c8c52.8ac5fa67-7935-4f8d-964b-f4e83e652c98" returned: 0 in 0.274s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:00 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-bbb65bd6-73ac-45d2-b651-2d30e2dfc40c tempest-ProjectMemberTests-406093346 None] Lock "cinder-quobyte-8ac5fa67-7935-4f8d-964b-f4e83e652c98" released by "_delete_snapshot" :: held 1.598s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:25:00 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-bbb65bd6-73ac-45d2-b651-2d30e2dfc40c tempest-ProjectMemberTests-406093346 None] Lock "cinder-quobyte-df7dec79-7a52-4026-8016-a857736c8c52" released by "delete_snapshot" :: held 1.625s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:25:00 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-667968ec-e091-4989-9256-e9ff8dd08330 tempest-ProjectReaderTests-1830827551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:25:00 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-667968ec-e091-4989-9256-e9ff8dd08330 tempest-ProjectReaderTests-1830827551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:25:00 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-667968ec-e091-4989-9256-e9ff8dd08330 tempest-ProjectReaderTests-1830827551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:25:00 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-667968ec-e091-4989-9256-e9ff8dd08330 tempest-ProjectReaderTests-1830827551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:25:00 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-667968ec-e091-4989-9256-e9ff8dd08330 tempest-ProjectReaderTests-1830827551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:25:00 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-667968ec-e091-4989-9256-e9ff8dd08330 tempest-ProjectReaderTests-1830827551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:00 devstack sudo[105866]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:00 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-d5c58a91-1fd6-4953-adc7-7d3152146651 tempest-ProjectReaderTests-779709804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3d2e346e-3762-450f-a671-8425bf1f04e7" returned: 0 in 0.456s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:00 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-d5c58a91-1fd6-4953-adc7-7d3152146651 tempest-ProjectReaderTests-779709804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3d2e346e-3762-450f-a671-8425bf1f04e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3d2e346e-3762-450f-a671-8425bf1f04e7.462f6b75-753f-41ae-9360-a5cfa30e5a03 1G {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:00 devstack sudo[105875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:25:00 devstack sudo[105875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:00 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-bbb65bd6-73ac-45d2-b651-2d30e2dfc40c tempest-ProjectMemberTests-406093346 None] Created reservations ['35fe3862-fac1-47f0-8569-84ac18f11171', 'b2eb61bc-2fb0-43b3-8c47-64feb7e25b41', '3b66ab5f-fc57-4a14-9544-b4b9d820e2a7', 'ae46468a-64a8-456c-8df7-ed7689a09a77'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:25:00 devstack sudo[105877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3d2e346e-3762-450f-a671-8425bf1f04e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3d2e346e-3762-450f-a671-8425bf1f04e7.462f6b75-753f-41ae-9360-a5cfa30e5a03 1G Nov 02 10:25:00 devstack sudo[105877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:00 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-bbb65bd6-73ac-45d2-b651-2d30e2dfc40c tempest-ProjectMemberTests-406093346 None] Delete snapshot completed successfully. Nov 02 10:25:00 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-bbb65bd6-73ac-45d2-b651-2d30e2dfc40c tempest-ProjectMemberTests-406093346 None] Lock "cinder-8ac5fa67-7935-4f8d-964b-f4e83e652c98-delete_snapshot" released by "delete_snapshot" :: held 1.885s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:25:00 devstack sudo[105875]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:00 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-667968ec-e091-4989-9256-e9ff8dd08330 tempest-ProjectReaderTests-1830827551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.311s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:00 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-667968ec-e091-4989-9256-e9ff8dd08330 tempest-ProjectReaderTests-1830827551 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:25:00 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-667968ec-e091-4989-9256-e9ff8dd08330 tempest-ProjectReaderTests-1830827551 None] Deleted volume successfully. Nov 02 10:25:00 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-667968ec-e091-4989-9256-e9ff8dd08330 tempest-ProjectReaderTests-1830827551 None] Lock "cinder-8f4e4857-e100-4aa3-ad78-4c2f115e56db-delete_volume" released by "delete_volume" :: held 1.432s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:25:00 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-d0b537c8-ef27-4e6b-96e4-28fe6b0cc0b3 tempest-ProjectMemberTests-406093346 None] Acquiring lock "cinder-df7dec79-7a52-4026-8016-a857736c8c52-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:25:00 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-d0b537c8-ef27-4e6b-96e4-28fe6b0cc0b3 tempest-ProjectMemberTests-406093346 None] Lock "cinder-df7dec79-7a52-4026-8016-a857736c8c52-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:25:00 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-d0b537c8-ef27-4e6b-96e4-28fe6b0cc0b3 tempest-ProjectMemberTests-406093346 None] Acquiring lock "cinder-quobyte-df7dec79-7a52-4026-8016-a857736c8c52" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:25:01 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-d0b537c8-ef27-4e6b-96e4-28fe6b0cc0b3 tempest-ProjectMemberTests-406093346 None] Lock "cinder-quobyte-df7dec79-7a52-4026-8016-a857736c8c52" acquired by "delete_volume" :: waited 0.024s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:25:01 devstack sudo[105877]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:01 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-d5c58a91-1fd6-4953-adc7-7d3152146651 tempest-ProjectReaderTests-779709804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3d2e346e-3762-450f-a671-8425bf1f04e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3d2e346e-3762-450f-a671-8425bf1f04e7.462f6b75-753f-41ae-9360-a5cfa30e5a03 1G" returned: 0 in 0.588s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:01 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-d5c58a91-1fd6-4953-adc7-7d3152146651 tempest-ProjectReaderTests-779709804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d2e346e-3762-450f-a671-8425bf1f04e7 -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3d2e346e-3762-450f-a671-8425bf1f04e7.462f6b75-753f-41ae-9360-a5cfa30e5a03 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:01 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff984d9d-590f-42ef-be98-4616ca9fddce]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:25:01 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-d0b537c8-ef27-4e6b-96e4-28fe6b0cc0b3 tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-df7dec79-7a52-4026-8016-a857736c8c52 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:01 devstack sudo[105884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d2e346e-3762-450f-a671-8425bf1f04e7 -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3d2e346e-3762-450f-a671-8425bf1f04e7.462f6b75-753f-41ae-9360-a5cfa30e5a03 Nov 02 10:25:01 devstack sudo[105884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:01 devstack sudo[105885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-df7dec79-7a52-4026-8016-a857736c8c52 Nov 02 10:25:01 devstack sudo[105885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:01 devstack sudo[105884]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:01 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-d5c58a91-1fd6-4953-adc7-7d3152146651 tempest-ProjectReaderTests-779709804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d2e346e-3762-450f-a671-8425bf1f04e7 -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3d2e346e-3762-450f-a671-8425bf1f04e7.462f6b75-753f-41ae-9360-a5cfa30e5a03" returned: 0 in 0.341s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:01 devstack cinder-volume[86890]: WARNING cinder.volume.drivers.remotefs [None req-d5c58a91-1fd6-4953-adc7-7d3152146651 tempest-ProjectReaderTests-779709804 None] /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3d2e346e-3762-450f-a671-8425bf1f04e7.462f6b75-753f-41ae-9360-a5cfa30e5a03 is being set with open permissions: ugo+rw Nov 02 10:25:01 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-d5c58a91-1fd6-4953-adc7-7d3152146651 tempest-ProjectReaderTests-779709804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3d2e346e-3762-450f-a671-8425bf1f04e7.462f6b75-753f-41ae-9360-a5cfa30e5a03 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:01 devstack sudo[105896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3d2e346e-3762-450f-a671-8425bf1f04e7.462f6b75-753f-41ae-9360-a5cfa30e5a03 Nov 02 10:25:01 devstack sudo[105896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:01 devstack sudo[105885]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:01 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-d0b537c8-ef27-4e6b-96e4-28fe6b0cc0b3 tempest-ProjectMemberTests-406093346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-df7dec79-7a52-4026-8016-a857736c8c52" returned: 0 in 0.418s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:01 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-d0b537c8-ef27-4e6b-96e4-28fe6b0cc0b3 tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-df7dec79-7a52-4026-8016-a857736c8c52 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:01 devstack sudo[105899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-df7dec79-7a52-4026-8016-a857736c8c52 Nov 02 10:25:01 devstack sudo[105899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:01 devstack sudo[105896]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:01 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-d5c58a91-1fd6-4953-adc7-7d3152146651 tempest-ProjectReaderTests-779709804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3d2e346e-3762-450f-a671-8425bf1f04e7.462f6b75-753f-41ae-9360-a5cfa30e5a03" returned: 0 in 0.341s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:01 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-d5c58a91-1fd6-4953-adc7-7d3152146651 tempest-ProjectReaderTests-779709804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3d2e346e-3762-450f-a671-8425bf1f04e7.info {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:01 devstack sudo[105899]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:01 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-d0b537c8-ef27-4e6b-96e4-28fe6b0cc0b3 tempest-ProjectMemberTests-406093346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-df7dec79-7a52-4026-8016-a857736c8c52" returned: 0 in 0.292s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:01 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-d0b537c8-ef27-4e6b-96e4-28fe6b0cc0b3 tempest-ProjectMemberTests-406093346 None] Lock "cinder-quobyte-df7dec79-7a52-4026-8016-a857736c8c52" released by "delete_volume" :: held 0.811s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:25:01 devstack sudo[105906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3d2e346e-3762-450f-a671-8425bf1f04e7.info Nov 02 10:25:01 devstack sudo[105906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:01 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-d0b537c8-ef27-4e6b-96e4-28fe6b0cc0b3 tempest-ProjectMemberTests-406093346 None] Created reservations ['65be4cd4-6476-44b5-b49f-198c55e50efc', 'ba6bc32b-7753-41c0-94fb-6e65c28accd0', '39320546-dded-4f4d-8987-6cc8d6c7d9d5', 'ed1094b0-e191-4967-b1f0-a5879c0fb004'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:25:01 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-d0b537c8-ef27-4e6b-96e4-28fe6b0cc0b3 tempest-ProjectMemberTests-406093346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:25:01 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-d0b537c8-ef27-4e6b-96e4-28fe6b0cc0b3 tempest-ProjectMemberTests-406093346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:25:01 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-d0b537c8-ef27-4e6b-96e4-28fe6b0cc0b3 tempest-ProjectMemberTests-406093346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:25:01 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-d0b537c8-ef27-4e6b-96e4-28fe6b0cc0b3 tempest-ProjectMemberTests-406093346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:25:01 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-d0b537c8-ef27-4e6b-96e4-28fe6b0cc0b3 tempest-ProjectMemberTests-406093346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:25:01 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-d0b537c8-ef27-4e6b-96e4-28fe6b0cc0b3 tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:02 devstack sudo[105908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:25:02 devstack sudo[105908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:02 devstack sudo[105906]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:02 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-d5c58a91-1fd6-4953-adc7-7d3152146651 tempest-ProjectReaderTests-779709804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3d2e346e-3762-450f-a671-8425bf1f04e7.info" returned: 0 in 0.307s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:02 devstack cinder-volume[86890]: WARNING cinder.volume.drivers.remotefs [None req-d5c58a91-1fd6-4953-adc7-7d3152146651 tempest-ProjectReaderTests-779709804 None] /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3d2e346e-3762-450f-a671-8425bf1f04e7.info is being set with open permissions: ugo+rw Nov 02 10:25:02 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-d5c58a91-1fd6-4953-adc7-7d3152146651 tempest-ProjectReaderTests-779709804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3d2e346e-3762-450f-a671-8425bf1f04e7.info {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:02 devstack sudo[105911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3d2e346e-3762-450f-a671-8425bf1f04e7.info Nov 02 10:25:02 devstack sudo[105911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:02 devstack sudo[105908]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:02 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-d0b537c8-ef27-4e6b-96e4-28fe6b0cc0b3 tempest-ProjectMemberTests-406093346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.326s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:02 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-d0b537c8-ef27-4e6b-96e4-28fe6b0cc0b3 tempest-ProjectMemberTests-406093346 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:25:02 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-d0b537c8-ef27-4e6b-96e4-28fe6b0cc0b3 tempest-ProjectMemberTests-406093346 None] Deleted volume successfully. Nov 02 10:25:02 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-d0b537c8-ef27-4e6b-96e4-28fe6b0cc0b3 tempest-ProjectMemberTests-406093346 None] Lock "cinder-df7dec79-7a52-4026-8016-a857736c8c52-delete_volume" released by "delete_volume" :: held 1.433s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:25:02 devstack sudo[105911]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:02 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-d5c58a91-1fd6-4953-adc7-7d3152146651 tempest-ProjectReaderTests-779709804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3d2e346e-3762-450f-a671-8425bf1f04e7.info" returned: 0 in 0.310s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:02 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-d5c58a91-1fd6-4953-adc7-7d3152146651 tempest-ProjectReaderTests-779709804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.452s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:25:02 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-d5c58a91-1fd6-4953-adc7-7d3152146651 tempest-ProjectReaderTests-779709804 None] Create snapshot completed successfully Nov 02 10:25:02 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-1312ff3f-a3b2-43a6-8f87-1bf45e327217 tempest-ProjectMemberTests-406093346 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:25:02 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-1312ff3f-a3b2-43a6-8f87-1bf45e327217 tempest-ProjectMemberTests-406093346 None] Flow 'volume_create_manager' (86968642-2664-4a64-8d8c-a0470ca16c42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:25:02 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-1312ff3f-a3b2-43a6-8f87-1bf45e327217 tempest-ProjectMemberTests-406093346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4155ec75-a065-4b6b-90b5-8325de83d241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:25:02 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-1312ff3f-a3b2-43a6-8f87-1bf45e327217 tempest-ProjectMemberTests-406093346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4155ec75-a065-4b6b-90b5-8325de83d241) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:25:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1178040773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aefde75c-a78f-4f7e-bd57-92d74d5e46f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='639ad964aa1b416eb473afb3c18dd4e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:25:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:25:03Z,use_quota=True,user_id='076db3d85c064198aa1722b31937515d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:25:02 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-1312ff3f-a3b2-43a6-8f87-1bf45e327217 tempest-ProjectMemberTests-406093346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1698d5a4-2ea1-4964-85f0-ec3cb9cd0279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:25:02 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-1312ff3f-a3b2-43a6-8f87-1bf45e327217 tempest-ProjectMemberTests-406093346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1698d5a4-2ea1-4964-85f0-ec3cb9cd0279) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:25:02 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-1312ff3f-a3b2-43a6-8f87-1bf45e327217 tempest-ProjectMemberTests-406093346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4758b550-5c49-4f03-9c29-f4f80c446efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:25:02 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-1312ff3f-a3b2-43a6-8f87-1bf45e327217 tempest-ProjectMemberTests-406093346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4758b550-5c49-4f03-9c29-f4f80c446efc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aefde75c-a78f-4f7e-bd57-92d74d5e46f7', 'volume_name': 'volume-aefde75c-a78f-4f7e-bd57-92d74d5e46f7', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:25:02 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-1312ff3f-a3b2-43a6-8f87-1bf45e327217 tempest-ProjectMemberTests-406093346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38ef8b12-9cdd-4274-a250-ef8d16ee7814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:25:02 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-1312ff3f-a3b2-43a6-8f87-1bf45e327217 tempest-ProjectMemberTests-406093346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38ef8b12-9cdd-4274-a250-ef8d16ee7814) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:25:02 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-1312ff3f-a3b2-43a6-8f87-1bf45e327217 tempest-ProjectMemberTests-406093346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (921712a6-30b0-469b-948c-d0527180a04d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:25:02 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-1312ff3f-a3b2-43a6-8f87-1bf45e327217 tempest-ProjectMemberTests-406093346 None] Volume aefde75c-a78f-4f7e-bd57-92d74d5e46f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aefde75c-a78f-4f7e-bd57-92d74d5e46f7', 'volume_size': 1} Nov 02 10:25:02 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-1312ff3f-a3b2-43a6-8f87-1bf45e327217 tempest-ProjectMemberTests-406093346 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:25:02 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-1312ff3f-a3b2-43a6-8f87-1bf45e327217 tempest-ProjectMemberTests-406093346 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:25:02 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-1312ff3f-a3b2-43a6-8f87-1bf45e327217 tempest-ProjectMemberTests-406093346 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:25:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1178040773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aefde75c-a78f-4f7e-bd57-92d74d5e46f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='639ad964aa1b416eb473afb3c18dd4e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:25:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:25:03Z,use_quota=True,user_id='076db3d85c064198aa1722b31937515d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:25:02 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-1312ff3f-a3b2-43a6-8f87-1bf45e327217 tempest-ProjectMemberTests-406093346 None] Creating volume aefde75c-a78f-4f7e-bd57-92d74d5e46f7 {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:25:02 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-1312ff3f-a3b2-43a6-8f87-1bf45e327217 tempest-ProjectMemberTests-406093346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:25:02 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-1312ff3f-a3b2-43a6-8f87-1bf45e327217 tempest-ProjectMemberTests-406093346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:25:02 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-1312ff3f-a3b2-43a6-8f87-1bf45e327217 tempest-ProjectMemberTests-406093346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:25:02 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-1312ff3f-a3b2-43a6-8f87-1bf45e327217 tempest-ProjectMemberTests-406093346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:25:02 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-1312ff3f-a3b2-43a6-8f87-1bf45e327217 tempest-ProjectMemberTests-406093346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:25:02 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-1312ff3f-a3b2-43a6-8f87-1bf45e327217 tempest-ProjectMemberTests-406093346 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:25:02 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-1312ff3f-a3b2-43a6-8f87-1bf45e327217 tempest-ProjectMemberTests-406093346 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:25:02 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-1312ff3f-a3b2-43a6-8f87-1bf45e327217 tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-aefde75c-a78f-4f7e-bd57-92d74d5e46f7 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:02 devstack sudo[105915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-aefde75c-a78f-4f7e-bd57-92d74d5e46f7 1073741824 Nov 02 10:25:02 devstack sudo[105915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:03 devstack sudo[105915]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:03 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-38e253e3-dd57-476a-a063-808c95ce9540 tempest-ProjectReaderTests-779709804 None] Acquiring lock "cinder-462f6b75-753f-41ae-9360-a5cfa30e5a03-delete_snapshot" by "delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:25:03 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-1312ff3f-a3b2-43a6-8f87-1bf45e327217 tempest-ProjectMemberTests-406093346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-aefde75c-a78f-4f7e-bd57-92d74d5e46f7 1073741824" returned: 0 in 0.426s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:03 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-38e253e3-dd57-476a-a063-808c95ce9540 tempest-ProjectReaderTests-779709804 None] Lock "cinder-462f6b75-753f-41ae-9360-a5cfa30e5a03-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:25:03 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-38e253e3-dd57-476a-a063-808c95ce9540 tempest-ProjectReaderTests-779709804 None] Acquiring lock "cinder-quobyte-3d2e346e-3762-450f-a671-8425bf1f04e7" by "delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:25:03 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-38e253e3-dd57-476a-a063-808c95ce9540 tempest-ProjectReaderTests-779709804 None] Lock "cinder-quobyte-3d2e346e-3762-450f-a671-8425bf1f04e7" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:25:03 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-38e253e3-dd57-476a-a063-808c95ce9540 tempest-ProjectReaderTests-779709804 None] Acquiring lock "cinder-quobyte-462f6b75-753f-41ae-9360-a5cfa30e5a03" by "_delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:25:03 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-1312ff3f-a3b2-43a6-8f87-1bf45e327217 tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-aefde75c-a78f-4f7e-bd57-92d74d5e46f7 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:03 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-38e253e3-dd57-476a-a063-808c95ce9540 tempest-ProjectReaderTests-779709804 None] Lock "cinder-quobyte-462f6b75-753f-41ae-9360-a5cfa30e5a03" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:25:03 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-38e253e3-dd57-476a-a063-808c95ce9540 tempest-ProjectReaderTests-779709804 None] Deleting offline snapshot 462f6b75-753f-41ae-9360-a5cfa30e5a03 of volume 3d2e346e-3762-450f-a671-8425bf1f04e7 {{(pid=86890) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:25:03 devstack sudo[105921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-aefde75c-a78f-4f7e-bd57-92d74d5e46f7 Nov 02 10:25:03 devstack sudo[105921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:03 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-38e253e3-dd57-476a-a063-808c95ce9540 tempest-ProjectReaderTests-779709804 None] snapshot_file for this snap is: volume-3d2e346e-3762-450f-a671-8425bf1f04e7.462f6b75-753f-41ae-9360-a5cfa30e5a03 {{(pid=86890) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:25:03 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[85dc952b-70de-4b17-a0d0-0ec1efd809f9]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:25:03 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-38e253e3-dd57-476a-a063-808c95ce9540 tempest-ProjectReaderTests-779709804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3d2e346e-3762-450f-a671-8425bf1f04e7.462f6b75-753f-41ae-9360-a5cfa30e5a03 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:03 devstack sudo[105941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3d2e346e-3762-450f-a671-8425bf1f04e7.462f6b75-753f-41ae-9360-a5cfa30e5a03 Nov 02 10:25:03 devstack sudo[105941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:03 devstack sudo[105921]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:03 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-1312ff3f-a3b2-43a6-8f87-1bf45e327217 tempest-ProjectMemberTests-406093346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-aefde75c-a78f-4f7e-bd57-92d74d5e46f7" returned: 0 in 0.253s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:03 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-1312ff3f-a3b2-43a6-8f87-1bf45e327217 tempest-ProjectMemberTests-406093346 None] <== create_volume: return (746ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:25:03 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-1312ff3f-a3b2-43a6-8f87-1bf45e327217 tempest-ProjectMemberTests-406093346 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.748s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:25:03 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-1312ff3f-a3b2-43a6-8f87-1bf45e327217 tempest-ProjectMemberTests-406093346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (921712a6-30b0-469b-948c-d0527180a04d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aefde75c-a78f-4f7e-bd57-92d74d5e46f7', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:25:03 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-1312ff3f-a3b2-43a6-8f87-1bf45e327217 tempest-ProjectMemberTests-406093346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd0df5b7-730c-418e-8bd7-69c1211b6bed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:25:03 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-1312ff3f-a3b2-43a6-8f87-1bf45e327217 tempest-ProjectMemberTests-406093346 None] Volume volume-aefde75c-a78f-4f7e-bd57-92d74d5e46f7 (aefde75c-a78f-4f7e-bd57-92d74d5e46f7): created successfully Nov 02 10:25:03 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-1312ff3f-a3b2-43a6-8f87-1bf45e327217 tempest-ProjectMemberTests-406093346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd0df5b7-730c-418e-8bd7-69c1211b6bed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:25:03 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-1312ff3f-a3b2-43a6-8f87-1bf45e327217 tempest-ProjectMemberTests-406093346 None] Flow 'volume_create_manager' (86968642-2664-4a64-8d8c-a0470ca16c42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:25:03 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-1312ff3f-a3b2-43a6-8f87-1bf45e327217 tempest-ProjectMemberTests-406093346 None] Created volume successfully. Nov 02 10:25:03 devstack sudo[105941]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:03 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-38e253e3-dd57-476a-a063-808c95ce9540 tempest-ProjectReaderTests-779709804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3d2e346e-3762-450f-a671-8425bf1f04e7.462f6b75-753f-41ae-9360-a5cfa30e5a03" returned: 0 in 0.415s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:03 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-38e253e3-dd57-476a-a063-808c95ce9540 tempest-ProjectReaderTests-779709804 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d2e346e-3762-450f-a671-8425bf1f04e7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86890) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:25:03 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[6506b759-b499-4ee7-b08c-eba66e3dbfaf]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:25:03 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-38e253e3-dd57-476a-a063-808c95ce9540 tempest-ProjectReaderTests-779709804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3d2e346e-3762-450f-a671-8425bf1f04e7 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:03 devstack sudo[106191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3d2e346e-3762-450f-a671-8425bf1f04e7 Nov 02 10:25:03 devstack sudo[106191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:03 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-53788d80-be74-438e-b455-882388939e42 tempest-ProjectMemberTests-406093346 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:25:03 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-53788d80-be74-438e-b455-882388939e42 tempest-ProjectMemberTests-406093346 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:25:03 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-53788d80-be74-438e-b455-882388939e42 tempest-ProjectMemberTests-406093346 None] Creating offline snapshot 78c155e8-f5f6-48b4-b8b9-ee99090bde75 of volume aefde75c-a78f-4f7e-bd57-92d74d5e46f7 {{(pid=86890) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:25:03 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4bdb0b8-42e1-4c77-9b62-fab3a3590bd3]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:25:03 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-53788d80-be74-438e-b455-882388939e42 tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-aefde75c-a78f-4f7e-bd57-92d74d5e46f7 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:04 devstack sudo[106260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-aefde75c-a78f-4f7e-bd57-92d74d5e46f7 Nov 02 10:25:04 devstack sudo[106260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:04 devstack sudo[106191]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:04 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-38e253e3-dd57-476a-a063-808c95ce9540 tempest-ProjectReaderTests-779709804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3d2e346e-3762-450f-a671-8425bf1f04e7" returned: 0 in 0.384s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:04 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-38e253e3-dd57-476a-a063-808c95ce9540 tempest-ProjectReaderTests-779709804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3d2e346e-3762-450f-a671-8425bf1f04e7.462f6b75-753f-41ae-9360-a5cfa30e5a03 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:04 devstack sudo[106266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3d2e346e-3762-450f-a671-8425bf1f04e7.462f6b75-753f-41ae-9360-a5cfa30e5a03 Nov 02 10:25:04 devstack sudo[106266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:04 devstack sudo[106260]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:04 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-53788d80-be74-438e-b455-882388939e42 tempest-ProjectMemberTests-406093346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-aefde75c-a78f-4f7e-bd57-92d74d5e46f7" returned: 0 in 0.391s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:04 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-53788d80-be74-438e-b455-882388939e42 tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-aefde75c-a78f-4f7e-bd57-92d74d5e46f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-aefde75c-a78f-4f7e-bd57-92d74d5e46f7.78c155e8-f5f6-48b4-b8b9-ee99090bde75 1G {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:04 devstack sudo[106271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-aefde75c-a78f-4f7e-bd57-92d74d5e46f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-aefde75c-a78f-4f7e-bd57-92d74d5e46f7.78c155e8-f5f6-48b4-b8b9-ee99090bde75 1G Nov 02 10:25:04 devstack sudo[106271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:04 devstack sudo[106266]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:04 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-38e253e3-dd57-476a-a063-808c95ce9540 tempest-ProjectReaderTests-779709804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3d2e346e-3762-450f-a671-8425bf1f04e7.462f6b75-753f-41ae-9360-a5cfa30e5a03" returned: 0 in 0.340s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:04 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-38e253e3-dd57-476a-a063-808c95ce9540 tempest-ProjectReaderTests-779709804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3d2e346e-3762-450f-a671-8425bf1f04e7.462f6b75-753f-41ae-9360-a5cfa30e5a03 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:04 devstack sudo[106276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3d2e346e-3762-450f-a671-8425bf1f04e7.462f6b75-753f-41ae-9360-a5cfa30e5a03 Nov 02 10:25:04 devstack sudo[106276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:04 devstack sudo[106271]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:04 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-53788d80-be74-438e-b455-882388939e42 tempest-ProjectMemberTests-406093346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-aefde75c-a78f-4f7e-bd57-92d74d5e46f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-aefde75c-a78f-4f7e-bd57-92d74d5e46f7.78c155e8-f5f6-48b4-b8b9-ee99090bde75 1G" returned: 0 in 0.392s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:04 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-53788d80-be74-438e-b455-882388939e42 tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aefde75c-a78f-4f7e-bd57-92d74d5e46f7 -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-aefde75c-a78f-4f7e-bd57-92d74d5e46f7.78c155e8-f5f6-48b4-b8b9-ee99090bde75 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:04 devstack sudo[106276]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:04 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-38e253e3-dd57-476a-a063-808c95ce9540 tempest-ProjectReaderTests-779709804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3d2e346e-3762-450f-a671-8425bf1f04e7.462f6b75-753f-41ae-9360-a5cfa30e5a03" returned: 0 in 0.264s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:04 devstack sudo[106282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aefde75c-a78f-4f7e-bd57-92d74d5e46f7 -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-aefde75c-a78f-4f7e-bd57-92d74d5e46f7.78c155e8-f5f6-48b4-b8b9-ee99090bde75 Nov 02 10:25:04 devstack sudo[106282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:04 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-38e253e3-dd57-476a-a063-808c95ce9540 tempest-ProjectReaderTests-779709804 None] Lock "cinder-quobyte-462f6b75-753f-41ae-9360-a5cfa30e5a03" released by "_delete_snapshot" :: held 1.533s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:25:04 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-38e253e3-dd57-476a-a063-808c95ce9540 tempest-ProjectReaderTests-779709804 None] Lock "cinder-quobyte-3d2e346e-3762-450f-a671-8425bf1f04e7" released by "delete_snapshot" :: held 1.570s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:25:04 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-38e253e3-dd57-476a-a063-808c95ce9540 tempest-ProjectReaderTests-779709804 None] Created reservations ['176ee751-dc5a-4952-8df7-fb42f99b33b9', '8d3752fd-8d6c-4472-a985-8eaac4f909d1', 'a2110116-eb38-460a-8339-8a0d953aaca0', 'c5f2d37b-2dcc-4e4f-b5fd-1cdd66d9e3ab'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:25:04 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-38e253e3-dd57-476a-a063-808c95ce9540 tempest-ProjectReaderTests-779709804 None] Delete snapshot completed successfully. Nov 02 10:25:04 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-38e253e3-dd57-476a-a063-808c95ce9540 tempest-ProjectReaderTests-779709804 None] Lock "cinder-462f6b75-753f-41ae-9360-a5cfa30e5a03-delete_snapshot" released by "delete_snapshot" :: held 1.726s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:25:05 devstack sudo[106282]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:05 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-53788d80-be74-438e-b455-882388939e42 tempest-ProjectMemberTests-406093346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aefde75c-a78f-4f7e-bd57-92d74d5e46f7 -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-aefde75c-a78f-4f7e-bd57-92d74d5e46f7.78c155e8-f5f6-48b4-b8b9-ee99090bde75" returned: 0 in 0.289s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:05 devstack cinder-volume[86890]: WARNING cinder.volume.drivers.remotefs [None req-53788d80-be74-438e-b455-882388939e42 tempest-ProjectMemberTests-406093346 None] /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-aefde75c-a78f-4f7e-bd57-92d74d5e46f7.78c155e8-f5f6-48b4-b8b9-ee99090bde75 is being set with open permissions: ugo+rw Nov 02 10:25:05 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-53788d80-be74-438e-b455-882388939e42 tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-aefde75c-a78f-4f7e-bd57-92d74d5e46f7.78c155e8-f5f6-48b4-b8b9-ee99090bde75 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:05 devstack sudo[106287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-aefde75c-a78f-4f7e-bd57-92d74d5e46f7.78c155e8-f5f6-48b4-b8b9-ee99090bde75 Nov 02 10:25:05 devstack sudo[106287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:05 devstack sudo[106287]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:05 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-53788d80-be74-438e-b455-882388939e42 tempest-ProjectMemberTests-406093346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-aefde75c-a78f-4f7e-bd57-92d74d5e46f7.78c155e8-f5f6-48b4-b8b9-ee99090bde75" returned: 0 in 0.258s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:05 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-53788d80-be74-438e-b455-882388939e42 tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-aefde75c-a78f-4f7e-bd57-92d74d5e46f7.info {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:05 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-1b43ccd1-5424-48ee-83d2-8a22ff50e157 tempest-ProjectReaderTests-779709804 None] Acquiring lock "cinder-3d2e346e-3762-450f-a671-8425bf1f04e7-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:25:05 devstack sudo[106290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-aefde75c-a78f-4f7e-bd57-92d74d5e46f7.info Nov 02 10:25:05 devstack sudo[106290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:05 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-1b43ccd1-5424-48ee-83d2-8a22ff50e157 tempest-ProjectReaderTests-779709804 None] Lock "cinder-3d2e346e-3762-450f-a671-8425bf1f04e7-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:25:05 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-1b43ccd1-5424-48ee-83d2-8a22ff50e157 tempest-ProjectReaderTests-779709804 None] Acquiring lock "cinder-quobyte-3d2e346e-3762-450f-a671-8425bf1f04e7" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:25:05 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-1b43ccd1-5424-48ee-83d2-8a22ff50e157 tempest-ProjectReaderTests-779709804 None] Lock "cinder-quobyte-3d2e346e-3762-450f-a671-8425bf1f04e7" acquired by "delete_volume" :: waited 0.018s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:25:05 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f67de4a-a36b-47e0-a01a-cd2b72cf63a9]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:25:05 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-1b43ccd1-5424-48ee-83d2-8a22ff50e157 tempest-ProjectReaderTests-779709804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3d2e346e-3762-450f-a671-8425bf1f04e7 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:05 devstack sudo[106292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3d2e346e-3762-450f-a671-8425bf1f04e7 Nov 02 10:25:05 devstack sudo[106292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:05 devstack sudo[106290]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:05 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-53788d80-be74-438e-b455-882388939e42 tempest-ProjectMemberTests-406093346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-aefde75c-a78f-4f7e-bd57-92d74d5e46f7.info" returned: 0 in 0.306s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:05 devstack cinder-volume[86890]: WARNING cinder.volume.drivers.remotefs [None req-53788d80-be74-438e-b455-882388939e42 tempest-ProjectMemberTests-406093346 None] /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-aefde75c-a78f-4f7e-bd57-92d74d5e46f7.info is being set with open permissions: ugo+rw Nov 02 10:25:05 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-53788d80-be74-438e-b455-882388939e42 tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-aefde75c-a78f-4f7e-bd57-92d74d5e46f7.info {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:05 devstack sudo[106295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-aefde75c-a78f-4f7e-bd57-92d74d5e46f7.info Nov 02 10:25:05 devstack sudo[106295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:05 devstack sudo[106292]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:05 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-1b43ccd1-5424-48ee-83d2-8a22ff50e157 tempest-ProjectReaderTests-779709804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3d2e346e-3762-450f-a671-8425bf1f04e7" returned: 0 in 0.387s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:05 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-1b43ccd1-5424-48ee-83d2-8a22ff50e157 tempest-ProjectReaderTests-779709804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3d2e346e-3762-450f-a671-8425bf1f04e7 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:05 devstack sudo[106295]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:05 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-53788d80-be74-438e-b455-882388939e42 tempest-ProjectMemberTests-406093346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-aefde75c-a78f-4f7e-bd57-92d74d5e46f7.info" returned: 0 in 0.250s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:05 devstack sudo[106301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3d2e346e-3762-450f-a671-8425bf1f04e7 Nov 02 10:25:05 devstack sudo[106301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:05 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-53788d80-be74-438e-b455-882388939e42 tempest-ProjectMemberTests-406093346 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.989s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:25:05 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-53788d80-be74-438e-b455-882388939e42 tempest-ProjectMemberTests-406093346 None] Create snapshot completed successfully Nov 02 10:25:06 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-02224582-de8f-4b95-85cf-aa9b50701b0f tempest-ProjectMemberTests-406093346 None] Acquiring lock "cinder-78c155e8-f5f6-48b4-b8b9-ee99090bde75-delete_snapshot" by "delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:25:06 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-02224582-de8f-4b95-85cf-aa9b50701b0f tempest-ProjectMemberTests-406093346 None] Lock "cinder-78c155e8-f5f6-48b4-b8b9-ee99090bde75-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:25:06 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-02224582-de8f-4b95-85cf-aa9b50701b0f tempest-ProjectMemberTests-406093346 None] Acquiring lock "cinder-quobyte-aefde75c-a78f-4f7e-bd57-92d74d5e46f7" by "delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:25:06 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-02224582-de8f-4b95-85cf-aa9b50701b0f tempest-ProjectMemberTests-406093346 None] Lock "cinder-quobyte-aefde75c-a78f-4f7e-bd57-92d74d5e46f7" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:25:06 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-02224582-de8f-4b95-85cf-aa9b50701b0f tempest-ProjectMemberTests-406093346 None] Acquiring lock "cinder-quobyte-78c155e8-f5f6-48b4-b8b9-ee99090bde75" by "_delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:25:06 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-02224582-de8f-4b95-85cf-aa9b50701b0f tempest-ProjectMemberTests-406093346 None] Lock "cinder-quobyte-78c155e8-f5f6-48b4-b8b9-ee99090bde75" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:25:06 devstack sudo[106301]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:06 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-02224582-de8f-4b95-85cf-aa9b50701b0f tempest-ProjectMemberTests-406093346 None] Deleting offline snapshot 78c155e8-f5f6-48b4-b8b9-ee99090bde75 of volume aefde75c-a78f-4f7e-bd57-92d74d5e46f7 {{(pid=86890) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:25:06 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-02224582-de8f-4b95-85cf-aa9b50701b0f tempest-ProjectMemberTests-406093346 None] snapshot_file for this snap is: volume-aefde75c-a78f-4f7e-bd57-92d74d5e46f7.78c155e8-f5f6-48b4-b8b9-ee99090bde75 {{(pid=86890) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:25:06 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-1b43ccd1-5424-48ee-83d2-8a22ff50e157 tempest-ProjectReaderTests-779709804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-3d2e346e-3762-450f-a671-8425bf1f04e7" returned: 0 in 0.281s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:06 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c23040a-4584-4ec8-a0ec-1dd6c7f942b5]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:25:06 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-02224582-de8f-4b95-85cf-aa9b50701b0f tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-aefde75c-a78f-4f7e-bd57-92d74d5e46f7.78c155e8-f5f6-48b4-b8b9-ee99090bde75 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:06 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-1b43ccd1-5424-48ee-83d2-8a22ff50e157 tempest-ProjectReaderTests-779709804 None] Lock "cinder-quobyte-3d2e346e-3762-450f-a671-8425bf1f04e7" released by "delete_volume" :: held 0.735s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:25:06 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-1b43ccd1-5424-48ee-83d2-8a22ff50e157 tempest-ProjectReaderTests-779709804 None] Created reservations ['20f335e9-88fb-410c-8571-586bc7020ebc', 'd99c35d8-4d08-4c5c-9a2e-d3f45d0d7dba', '3d96ab21-fa54-47ce-9908-55c80a1ee4f4', '4f35dbc9-852a-4c99-a1da-cea1a8c97bda'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:25:06 devstack sudo[106304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-aefde75c-a78f-4f7e-bd57-92d74d5e46f7.78c155e8-f5f6-48b4-b8b9-ee99090bde75 Nov 02 10:25:06 devstack sudo[106304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:06 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-1b43ccd1-5424-48ee-83d2-8a22ff50e157 tempest-ProjectReaderTests-779709804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:25:06 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-1b43ccd1-5424-48ee-83d2-8a22ff50e157 tempest-ProjectReaderTests-779709804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:25:06 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-1b43ccd1-5424-48ee-83d2-8a22ff50e157 tempest-ProjectReaderTests-779709804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:25:06 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-1b43ccd1-5424-48ee-83d2-8a22ff50e157 tempest-ProjectReaderTests-779709804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:25:06 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-1b43ccd1-5424-48ee-83d2-8a22ff50e157 tempest-ProjectReaderTests-779709804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:25:06 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-1b43ccd1-5424-48ee-83d2-8a22ff50e157 tempest-ProjectReaderTests-779709804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:06 devstack sudo[106306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:25:06 devstack sudo[106306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:06 devstack sudo[106304]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:06 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-02224582-de8f-4b95-85cf-aa9b50701b0f tempest-ProjectMemberTests-406093346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-aefde75c-a78f-4f7e-bd57-92d74d5e46f7.78c155e8-f5f6-48b4-b8b9-ee99090bde75" returned: 0 in 0.407s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:06 devstack sudo[106306]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:06 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-02224582-de8f-4b95-85cf-aa9b50701b0f tempest-ProjectMemberTests-406093346 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aefde75c-a78f-4f7e-bd57-92d74d5e46f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86890) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:25:06 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-1b43ccd1-5424-48ee-83d2-8a22ff50e157 tempest-ProjectReaderTests-779709804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.306s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:06 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-1b43ccd1-5424-48ee-83d2-8a22ff50e157 tempest-ProjectReaderTests-779709804 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:25:06 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-1b43ccd1-5424-48ee-83d2-8a22ff50e157 tempest-ProjectReaderTests-779709804 None] Deleted volume successfully. Nov 02 10:25:06 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9db6fd0-fac0-4752-b5b6-393bec16fcbd]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:25:06 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-02224582-de8f-4b95-85cf-aa9b50701b0f tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-aefde75c-a78f-4f7e-bd57-92d74d5e46f7 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:06 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-1b43ccd1-5424-48ee-83d2-8a22ff50e157 tempest-ProjectReaderTests-779709804 None] Lock "cinder-3d2e346e-3762-450f-a671-8425bf1f04e7-delete_volume" released by "delete_volume" :: held 1.272s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:25:06 devstack sudo[106312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-aefde75c-a78f-4f7e-bd57-92d74d5e46f7 Nov 02 10:25:06 devstack sudo[106312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:07 devstack sudo[106312]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:07 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-02224582-de8f-4b95-85cf-aa9b50701b0f tempest-ProjectMemberTests-406093346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-aefde75c-a78f-4f7e-bd57-92d74d5e46f7" returned: 0 in 0.435s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:07 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-02224582-de8f-4b95-85cf-aa9b50701b0f tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-aefde75c-a78f-4f7e-bd57-92d74d5e46f7.78c155e8-f5f6-48b4-b8b9-ee99090bde75 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:07 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-6482f126-31f3-44f5-8684-77c9ee5fd0c4 tempest-ProjectReaderTests-779709804 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:25:07 devstack sudo[106317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-aefde75c-a78f-4f7e-bd57-92d74d5e46f7.78c155e8-f5f6-48b4-b8b9-ee99090bde75 Nov 02 10:25:07 devstack sudo[106317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:07 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-6482f126-31f3-44f5-8684-77c9ee5fd0c4 tempest-ProjectReaderTests-779709804 None] Flow 'volume_create_manager' (38c6025b-281f-4485-be03-642d19badcbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:25:07 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-6482f126-31f3-44f5-8684-77c9ee5fd0c4 tempest-ProjectReaderTests-779709804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f46ae540-a6e4-4d49-888c-40155d3d9033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:25:07 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-6482f126-31f3-44f5-8684-77c9ee5fd0c4 tempest-ProjectReaderTests-779709804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f46ae540-a6e4-4d49-888c-40155d3d9033) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:25:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-629386653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=307cb443-a108-4d3a-a9a3-c475d949dccc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a88c80344544473c8d2457c14d0db292',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:25:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:25:07Z,use_quota=True,user_id='830d06ded8694a4dae7d1bfd5f316394',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:25:07 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-6482f126-31f3-44f5-8684-77c9ee5fd0c4 tempest-ProjectReaderTests-779709804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (624689b1-fa7d-4eb7-bf01-f41037d9183d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:25:07 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-6482f126-31f3-44f5-8684-77c9ee5fd0c4 tempest-ProjectReaderTests-779709804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (624689b1-fa7d-4eb7-bf01-f41037d9183d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:25:07 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-6482f126-31f3-44f5-8684-77c9ee5fd0c4 tempest-ProjectReaderTests-779709804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4201a29-8049-485c-9f3e-2e80d967f486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:25:07 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-6482f126-31f3-44f5-8684-77c9ee5fd0c4 tempest-ProjectReaderTests-779709804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4201a29-8049-485c-9f3e-2e80d967f486) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '307cb443-a108-4d3a-a9a3-c475d949dccc', 'volume_name': 'volume-307cb443-a108-4d3a-a9a3-c475d949dccc', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:25:07 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-6482f126-31f3-44f5-8684-77c9ee5fd0c4 tempest-ProjectReaderTests-779709804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (145ae741-6835-4e5f-854f-98a14de7eac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:25:07 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-6482f126-31f3-44f5-8684-77c9ee5fd0c4 tempest-ProjectReaderTests-779709804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (145ae741-6835-4e5f-854f-98a14de7eac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:25:07 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-6482f126-31f3-44f5-8684-77c9ee5fd0c4 tempest-ProjectReaderTests-779709804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8039eb4-f543-40fd-80ce-805fc71e1d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:25:07 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-6482f126-31f3-44f5-8684-77c9ee5fd0c4 tempest-ProjectReaderTests-779709804 None] Volume 307cb443-a108-4d3a-a9a3-c475d949dccc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-307cb443-a108-4d3a-a9a3-c475d949dccc', 'volume_size': 1} Nov 02 10:25:07 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-6482f126-31f3-44f5-8684-77c9ee5fd0c4 tempest-ProjectReaderTests-779709804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:25:07 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-6482f126-31f3-44f5-8684-77c9ee5fd0c4 tempest-ProjectReaderTests-779709804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:25:07 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-6482f126-31f3-44f5-8684-77c9ee5fd0c4 tempest-ProjectReaderTests-779709804 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:25:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-629386653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=307cb443-a108-4d3a-a9a3-c475d949dccc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a88c80344544473c8d2457c14d0db292',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:25:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:25:07Z,use_quota=True,user_id='830d06ded8694a4dae7d1bfd5f316394',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:25:07 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-6482f126-31f3-44f5-8684-77c9ee5fd0c4 tempest-ProjectReaderTests-779709804 None] Creating volume 307cb443-a108-4d3a-a9a3-c475d949dccc {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:25:07 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-6482f126-31f3-44f5-8684-77c9ee5fd0c4 tempest-ProjectReaderTests-779709804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:25:07 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-6482f126-31f3-44f5-8684-77c9ee5fd0c4 tempest-ProjectReaderTests-779709804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:25:07 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-6482f126-31f3-44f5-8684-77c9ee5fd0c4 tempest-ProjectReaderTests-779709804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:25:07 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-6482f126-31f3-44f5-8684-77c9ee5fd0c4 tempest-ProjectReaderTests-779709804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:25:07 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-6482f126-31f3-44f5-8684-77c9ee5fd0c4 tempest-ProjectReaderTests-779709804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:25:07 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-6482f126-31f3-44f5-8684-77c9ee5fd0c4 tempest-ProjectReaderTests-779709804 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:25:07 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-6482f126-31f3-44f5-8684-77c9ee5fd0c4 tempest-ProjectReaderTests-779709804 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:25:07 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6482f126-31f3-44f5-8684-77c9ee5fd0c4 tempest-ProjectReaderTests-779709804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-307cb443-a108-4d3a-a9a3-c475d949dccc 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:07 devstack sudo[106319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-307cb443-a108-4d3a-a9a3-c475d949dccc 1073741824 Nov 02 10:25:07 devstack sudo[106319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:07 devstack sudo[106317]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:07 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-02224582-de8f-4b95-85cf-aa9b50701b0f tempest-ProjectMemberTests-406093346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-aefde75c-a78f-4f7e-bd57-92d74d5e46f7.78c155e8-f5f6-48b4-b8b9-ee99090bde75" returned: 0 in 0.361s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:07 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-02224582-de8f-4b95-85cf-aa9b50701b0f tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-aefde75c-a78f-4f7e-bd57-92d74d5e46f7.78c155e8-f5f6-48b4-b8b9-ee99090bde75 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:07 devstack sudo[106326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-aefde75c-a78f-4f7e-bd57-92d74d5e46f7.78c155e8-f5f6-48b4-b8b9-ee99090bde75 Nov 02 10:25:07 devstack sudo[106326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:07 devstack sudo[106319]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:07 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6482f126-31f3-44f5-8684-77c9ee5fd0c4 tempest-ProjectReaderTests-779709804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-307cb443-a108-4d3a-a9a3-c475d949dccc 1073741824" returned: 0 in 0.462s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:07 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6482f126-31f3-44f5-8684-77c9ee5fd0c4 tempest-ProjectReaderTests-779709804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-307cb443-a108-4d3a-a9a3-c475d949dccc {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:07 devstack sudo[106326]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:07 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-02224582-de8f-4b95-85cf-aa9b50701b0f tempest-ProjectMemberTests-406093346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-aefde75c-a78f-4f7e-bd57-92d74d5e46f7.78c155e8-f5f6-48b4-b8b9-ee99090bde75" returned: 0 in 0.278s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:07 devstack sudo[106331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-307cb443-a108-4d3a-a9a3-c475d949dccc Nov 02 10:25:07 devstack sudo[106331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:07 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-02224582-de8f-4b95-85cf-aa9b50701b0f tempest-ProjectMemberTests-406093346 None] Lock "cinder-quobyte-78c155e8-f5f6-48b4-b8b9-ee99090bde75" released by "_delete_snapshot" :: held 1.612s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:25:07 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-02224582-de8f-4b95-85cf-aa9b50701b0f tempest-ProjectMemberTests-406093346 None] Lock "cinder-quobyte-aefde75c-a78f-4f7e-bd57-92d74d5e46f7" released by "delete_snapshot" :: held 1.639s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:25:07 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-02224582-de8f-4b95-85cf-aa9b50701b0f tempest-ProjectMemberTests-406093346 None] Created reservations ['96c6007c-0fca-4dbe-a2b6-3d09f5991832', 'b2de3cc6-ed50-4de4-8149-98ed9369aad7', '454ad6e5-4155-404c-b149-caeb21964d3c', '0b42d833-108f-4b72-a202-0db8a7507ebe'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:25:07 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-02224582-de8f-4b95-85cf-aa9b50701b0f tempest-ProjectMemberTests-406093346 None] Delete snapshot completed successfully. Nov 02 10:25:07 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-02224582-de8f-4b95-85cf-aa9b50701b0f tempest-ProjectMemberTests-406093346 None] Lock "cinder-78c155e8-f5f6-48b4-b8b9-ee99090bde75-delete_snapshot" released by "delete_snapshot" :: held 1.819s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:25:07 devstack sudo[106331]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:07 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6482f126-31f3-44f5-8684-77c9ee5fd0c4 tempest-ProjectReaderTests-779709804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-307cb443-a108-4d3a-a9a3-c475d949dccc" returned: 0 in 0.270s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:07 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-6482f126-31f3-44f5-8684-77c9ee5fd0c4 tempest-ProjectReaderTests-779709804 None] <== create_volume: return (781ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:25:07 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-6482f126-31f3-44f5-8684-77c9ee5fd0c4 tempest-ProjectReaderTests-779709804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.785s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:25:07 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-6482f126-31f3-44f5-8684-77c9ee5fd0c4 tempest-ProjectReaderTests-779709804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8039eb4-f543-40fd-80ce-805fc71e1d8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-307cb443-a108-4d3a-a9a3-c475d949dccc', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:25:07 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-6482f126-31f3-44f5-8684-77c9ee5fd0c4 tempest-ProjectReaderTests-779709804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72a3b862-be44-4c06-bf94-f0da1087aa6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:25:07 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-6482f126-31f3-44f5-8684-77c9ee5fd0c4 tempest-ProjectReaderTests-779709804 None] Volume volume-307cb443-a108-4d3a-a9a3-c475d949dccc (307cb443-a108-4d3a-a9a3-c475d949dccc): created successfully Nov 02 10:25:07 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-6482f126-31f3-44f5-8684-77c9ee5fd0c4 tempest-ProjectReaderTests-779709804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72a3b862-be44-4c06-bf94-f0da1087aa6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:25:07 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-6482f126-31f3-44f5-8684-77c9ee5fd0c4 tempest-ProjectReaderTests-779709804 None] Flow 'volume_create_manager' (38c6025b-281f-4485-be03-642d19badcbe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:25:08 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-6482f126-31f3-44f5-8684-77c9ee5fd0c4 tempest-ProjectReaderTests-779709804 None] Created volume successfully. Nov 02 10:25:08 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-8c0a6dda-7bd6-4ea6-9158-ddb03faab848 tempest-ProjectMemberTests-406093346 None] Acquiring lock "cinder-aefde75c-a78f-4f7e-bd57-92d74d5e46f7-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:25:08 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-8c0a6dda-7bd6-4ea6-9158-ddb03faab848 tempest-ProjectMemberTests-406093346 None] Lock "cinder-aefde75c-a78f-4f7e-bd57-92d74d5e46f7-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:25:08 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-8c0a6dda-7bd6-4ea6-9158-ddb03faab848 tempest-ProjectMemberTests-406093346 None] Acquiring lock "cinder-quobyte-aefde75c-a78f-4f7e-bd57-92d74d5e46f7" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:25:08 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-8c0a6dda-7bd6-4ea6-9158-ddb03faab848 tempest-ProjectMemberTests-406093346 None] Lock "cinder-quobyte-aefde75c-a78f-4f7e-bd57-92d74d5e46f7" acquired by "delete_volume" :: waited 0.013s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:25:08 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c5d1dbd-0b59-4fdb-be8f-107ced1daa8a]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:25:08 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8c0a6dda-7bd6-4ea6-9158-ddb03faab848 tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-aefde75c-a78f-4f7e-bd57-92d74d5e46f7 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:08 devstack sudo[106334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-aefde75c-a78f-4f7e-bd57-92d74d5e46f7 Nov 02 10:25:08 devstack sudo[106334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:08 devstack sudo[106334]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:08 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8c0a6dda-7bd6-4ea6-9158-ddb03faab848 tempest-ProjectMemberTests-406093346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-aefde75c-a78f-4f7e-bd57-92d74d5e46f7" returned: 0 in 0.417s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:08 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8c0a6dda-7bd6-4ea6-9158-ddb03faab848 tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-aefde75c-a78f-4f7e-bd57-92d74d5e46f7 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:08 devstack sudo[106339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-aefde75c-a78f-4f7e-bd57-92d74d5e46f7 Nov 02 10:25:08 devstack sudo[106339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:09 devstack sudo[106339]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:09 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8c0a6dda-7bd6-4ea6-9158-ddb03faab848 tempest-ProjectMemberTests-406093346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-aefde75c-a78f-4f7e-bd57-92d74d5e46f7" returned: 0 in 0.264s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:09 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-8c0a6dda-7bd6-4ea6-9158-ddb03faab848 tempest-ProjectMemberTests-406093346 None] Lock "cinder-quobyte-aefde75c-a78f-4f7e-bd57-92d74d5e46f7" released by "delete_volume" :: held 0.761s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:25:09 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-8c0a6dda-7bd6-4ea6-9158-ddb03faab848 tempest-ProjectMemberTests-406093346 None] Created reservations ['933c592d-7e6c-4850-85e5-53baf80a6b9c', '8c1c8cb3-e5bd-428b-b9d9-910bfd8d7e38', '8c2565a4-d26f-4a33-9ce5-7e1ec872572b', 'ee2956be-43ae-4e94-a294-2cfa2b7d4874'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:25:09 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-8c0a6dda-7bd6-4ea6-9158-ddb03faab848 tempest-ProjectMemberTests-406093346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:25:09 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-8c0a6dda-7bd6-4ea6-9158-ddb03faab848 tempest-ProjectMemberTests-406093346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:25:09 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-8c0a6dda-7bd6-4ea6-9158-ddb03faab848 tempest-ProjectMemberTests-406093346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:25:09 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-8c0a6dda-7bd6-4ea6-9158-ddb03faab848 tempest-ProjectMemberTests-406093346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:25:09 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-8c0a6dda-7bd6-4ea6-9158-ddb03faab848 tempest-ProjectMemberTests-406093346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:25:09 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8c0a6dda-7bd6-4ea6-9158-ddb03faab848 tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:09 devstack sudo[106342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:25:09 devstack sudo[106342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:09 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-8e7c381a-542a-493f-9a94-ae5b7a11918b tempest-ProjectReaderTests-779709804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:25:09 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-8e7c381a-542a-493f-9a94-ae5b7a11918b tempest-ProjectReaderTests-779709804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:25:09 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-8e7c381a-542a-493f-9a94-ae5b7a11918b tempest-ProjectReaderTests-779709804 None] Creating offline snapshot 136fe035-f15f-4769-8dd5-25907031ca27 of volume 307cb443-a108-4d3a-a9a3-c475d949dccc {{(pid=86890) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:25:09 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[74dc7e6c-d38c-4081-b0aa-421480b8a6b2]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:25:09 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8e7c381a-542a-493f-9a94-ae5b7a11918b tempest-ProjectReaderTests-779709804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-307cb443-a108-4d3a-a9a3-c475d949dccc {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:09 devstack sudo[106342]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:09 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8c0a6dda-7bd6-4ea6-9158-ddb03faab848 tempest-ProjectMemberTests-406093346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.285s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:09 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-8c0a6dda-7bd6-4ea6-9158-ddb03faab848 tempest-ProjectMemberTests-406093346 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:25:09 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-8c0a6dda-7bd6-4ea6-9158-ddb03faab848 tempest-ProjectMemberTests-406093346 None] Deleted volume successfully. Nov 02 10:25:09 devstack sudo[106344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-307cb443-a108-4d3a-a9a3-c475d949dccc Nov 02 10:25:09 devstack sudo[106344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:09 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-8c0a6dda-7bd6-4ea6-9158-ddb03faab848 tempest-ProjectMemberTests-406093346 None] Lock "cinder-aefde75c-a78f-4f7e-bd57-92d74d5e46f7-delete_volume" released by "delete_volume" :: held 1.282s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:25:09 devstack sudo[106344]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:09 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8e7c381a-542a-493f-9a94-ae5b7a11918b tempest-ProjectReaderTests-779709804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-307cb443-a108-4d3a-a9a3-c475d949dccc" returned: 0 in 0.432s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:09 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8e7c381a-542a-493f-9a94-ae5b7a11918b tempest-ProjectReaderTests-779709804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-307cb443-a108-4d3a-a9a3-c475d949dccc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-307cb443-a108-4d3a-a9a3-c475d949dccc.136fe035-f15f-4769-8dd5-25907031ca27 1G {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:09 devstack sudo[106350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-307cb443-a108-4d3a-a9a3-c475d949dccc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-307cb443-a108-4d3a-a9a3-c475d949dccc.136fe035-f15f-4769-8dd5-25907031ca27 1G Nov 02 10:25:09 devstack sudo[106350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:09 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d2e6de1-865b-4232-b88b-e6ce598f0dc4 tempest-ProjectMemberTests-406093346 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:25:09 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-6d2e6de1-865b-4232-b88b-e6ce598f0dc4 tempest-ProjectMemberTests-406093346 None] Flow 'volume_create_manager' (3edc77c6-f1a7-4f39-910c-5491031d9a38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:25:09 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-6d2e6de1-865b-4232-b88b-e6ce598f0dc4 tempest-ProjectMemberTests-406093346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92faa4a5-aa34-4d8c-9a06-e225bd8000c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:25:09 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-6d2e6de1-865b-4232-b88b-e6ce598f0dc4 tempest-ProjectMemberTests-406093346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92faa4a5-aa34-4d8c-9a06-e225bd8000c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:25:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-960131168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51894945-587d-4323-8ca7-d9a2c84b62bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='639ad964aa1b416eb473afb3c18dd4e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:25:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:25:10Z,use_quota=True,user_id='076db3d85c064198aa1722b31937515d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:25:09 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-6d2e6de1-865b-4232-b88b-e6ce598f0dc4 tempest-ProjectMemberTests-406093346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8da38d6-15bc-42bb-a43f-51d0457ea719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:25:09 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-6d2e6de1-865b-4232-b88b-e6ce598f0dc4 tempest-ProjectMemberTests-406093346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8da38d6-15bc-42bb-a43f-51d0457ea719) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:25:09 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-6d2e6de1-865b-4232-b88b-e6ce598f0dc4 tempest-ProjectMemberTests-406093346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (320dd7dd-8bb6-45f5-ae00-230d7d416890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:25:09 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-6d2e6de1-865b-4232-b88b-e6ce598f0dc4 tempest-ProjectMemberTests-406093346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (320dd7dd-8bb6-45f5-ae00-230d7d416890) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51894945-587d-4323-8ca7-d9a2c84b62bf', 'volume_name': 'volume-51894945-587d-4323-8ca7-d9a2c84b62bf', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:25:09 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-6d2e6de1-865b-4232-b88b-e6ce598f0dc4 tempest-ProjectMemberTests-406093346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a187f448-2da0-4b9e-a67d-7b5519138075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:25:09 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-6d2e6de1-865b-4232-b88b-e6ce598f0dc4 tempest-ProjectMemberTests-406093346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a187f448-2da0-4b9e-a67d-7b5519138075) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:25:09 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-6d2e6de1-865b-4232-b88b-e6ce598f0dc4 tempest-ProjectMemberTests-406093346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7600056a-93b7-4694-ab67-1800b78cb7b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:25:09 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-6d2e6de1-865b-4232-b88b-e6ce598f0dc4 tempest-ProjectMemberTests-406093346 None] Volume 51894945-587d-4323-8ca7-d9a2c84b62bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51894945-587d-4323-8ca7-d9a2c84b62bf', 'volume_size': 1} Nov 02 10:25:09 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-6d2e6de1-865b-4232-b88b-e6ce598f0dc4 tempest-ProjectMemberTests-406093346 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:25:10 devstack sudo[106350]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:10 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8e7c381a-542a-493f-9a94-ae5b7a11918b tempest-ProjectReaderTests-779709804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-307cb443-a108-4d3a-a9a3-c475d949dccc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-307cb443-a108-4d3a-a9a3-c475d949dccc.136fe035-f15f-4769-8dd5-25907031ca27 1G" returned: 0 in 0.407s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:10 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8e7c381a-542a-493f-9a94-ae5b7a11918b tempest-ProjectReaderTests-779709804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-307cb443-a108-4d3a-a9a3-c475d949dccc -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-307cb443-a108-4d3a-a9a3-c475d949dccc.136fe035-f15f-4769-8dd5-25907031ca27 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:10 devstack sudo[106355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-307cb443-a108-4d3a-a9a3-c475d949dccc -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-307cb443-a108-4d3a-a9a3-c475d949dccc.136fe035-f15f-4769-8dd5-25907031ca27 Nov 02 10:25:10 devstack sudo[106355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:10 devstack sudo[106355]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:10 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8e7c381a-542a-493f-9a94-ae5b7a11918b tempest-ProjectReaderTests-779709804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-307cb443-a108-4d3a-a9a3-c475d949dccc -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-307cb443-a108-4d3a-a9a3-c475d949dccc.136fe035-f15f-4769-8dd5-25907031ca27" returned: 0 in 0.308s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:10 devstack cinder-volume[86890]: WARNING cinder.volume.drivers.remotefs [None req-8e7c381a-542a-493f-9a94-ae5b7a11918b tempest-ProjectReaderTests-779709804 None] /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-307cb443-a108-4d3a-a9a3-c475d949dccc.136fe035-f15f-4769-8dd5-25907031ca27 is being set with open permissions: ugo+rw Nov 02 10:25:10 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8e7c381a-542a-493f-9a94-ae5b7a11918b tempest-ProjectReaderTests-779709804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-307cb443-a108-4d3a-a9a3-c475d949dccc.136fe035-f15f-4769-8dd5-25907031ca27 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:10 devstack sudo[106360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-307cb443-a108-4d3a-a9a3-c475d949dccc.136fe035-f15f-4769-8dd5-25907031ca27 Nov 02 10:25:10 devstack sudo[106360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:10 devstack sudo[106360]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:10 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8e7c381a-542a-493f-9a94-ae5b7a11918b tempest-ProjectReaderTests-779709804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-307cb443-a108-4d3a-a9a3-c475d949dccc.136fe035-f15f-4769-8dd5-25907031ca27" returned: 0 in 0.252s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:10 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8e7c381a-542a-493f-9a94-ae5b7a11918b tempest-ProjectReaderTests-779709804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-307cb443-a108-4d3a-a9a3-c475d949dccc.info {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:10 devstack sudo[106363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-307cb443-a108-4d3a-a9a3-c475d949dccc.info Nov 02 10:25:10 devstack sudo[106363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:11 devstack sudo[106363]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:11 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8e7c381a-542a-493f-9a94-ae5b7a11918b tempest-ProjectReaderTests-779709804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-307cb443-a108-4d3a-a9a3-c475d949dccc.info" returned: 0 in 0.264s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:11 devstack cinder-volume[86890]: WARNING cinder.volume.drivers.remotefs [None req-8e7c381a-542a-493f-9a94-ae5b7a11918b tempest-ProjectReaderTests-779709804 None] /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-307cb443-a108-4d3a-a9a3-c475d949dccc.info is being set with open permissions: ugo+rw Nov 02 10:25:11 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8e7c381a-542a-493f-9a94-ae5b7a11918b tempest-ProjectReaderTests-779709804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-307cb443-a108-4d3a-a9a3-c475d949dccc.info {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:11 devstack sudo[106366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-307cb443-a108-4d3a-a9a3-c475d949dccc.info Nov 02 10:25:11 devstack sudo[106366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:11 devstack sudo[106366]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:11 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-8e7c381a-542a-493f-9a94-ae5b7a11918b tempest-ProjectReaderTests-779709804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-307cb443-a108-4d3a-a9a3-c475d949dccc.info" returned: 0 in 0.264s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:11 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-8e7c381a-542a-493f-9a94-ae5b7a11918b tempest-ProjectReaderTests-779709804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.026s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:25:11 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-6d2e6de1-865b-4232-b88b-e6ce598f0dc4 tempest-ProjectMemberTests-406093346 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.406s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:25:11 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-6d2e6de1-865b-4232-b88b-e6ce598f0dc4 tempest-ProjectMemberTests-406093346 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:25:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-960131168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51894945-587d-4323-8ca7-d9a2c84b62bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='639ad964aa1b416eb473afb3c18dd4e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:25:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:25:10Z,use_quota=True,user_id='076db3d85c064198aa1722b31937515d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:25:11 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-6d2e6de1-865b-4232-b88b-e6ce598f0dc4 tempest-ProjectMemberTests-406093346 None] Creating volume 51894945-587d-4323-8ca7-d9a2c84b62bf {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:25:11 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-6d2e6de1-865b-4232-b88b-e6ce598f0dc4 tempest-ProjectMemberTests-406093346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:25:11 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-6d2e6de1-865b-4232-b88b-e6ce598f0dc4 tempest-ProjectMemberTests-406093346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:25:11 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-6d2e6de1-865b-4232-b88b-e6ce598f0dc4 tempest-ProjectMemberTests-406093346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:25:11 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-6d2e6de1-865b-4232-b88b-e6ce598f0dc4 tempest-ProjectMemberTests-406093346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:25:11 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-6d2e6de1-865b-4232-b88b-e6ce598f0dc4 tempest-ProjectMemberTests-406093346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:25:11 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-6d2e6de1-865b-4232-b88b-e6ce598f0dc4 tempest-ProjectMemberTests-406093346 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:25:11 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-6d2e6de1-865b-4232-b88b-e6ce598f0dc4 tempest-ProjectMemberTests-406093346 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:25:11 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6d2e6de1-865b-4232-b88b-e6ce598f0dc4 tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-51894945-587d-4323-8ca7-d9a2c84b62bf 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:11 devstack sudo[106369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-51894945-587d-4323-8ca7-d9a2c84b62bf 1073741824 Nov 02 10:25:11 devstack sudo[106369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:11 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-8e7c381a-542a-493f-9a94-ae5b7a11918b tempest-ProjectReaderTests-779709804 None] Create snapshot completed successfully Nov 02 10:25:11 devstack sudo[106369]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:11 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6d2e6de1-865b-4232-b88b-e6ce598f0dc4 tempest-ProjectMemberTests-406093346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-51894945-587d-4323-8ca7-d9a2c84b62bf 1073741824" returned: 0 in 0.414s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:11 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6d2e6de1-865b-4232-b88b-e6ce598f0dc4 tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-51894945-587d-4323-8ca7-d9a2c84b62bf {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:11 devstack sudo[106375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-51894945-587d-4323-8ca7-d9a2c84b62bf Nov 02 10:25:11 devstack sudo[106375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:12 devstack sudo[106375]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:12 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6d2e6de1-865b-4232-b88b-e6ce598f0dc4 tempest-ProjectMemberTests-406093346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-51894945-587d-4323-8ca7-d9a2c84b62bf" returned: 0 in 0.258s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:12 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-6d2e6de1-865b-4232-b88b-e6ce598f0dc4 tempest-ProjectMemberTests-406093346 None] <== create_volume: return (720ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:25:12 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-6d2e6de1-865b-4232-b88b-e6ce598f0dc4 tempest-ProjectMemberTests-406093346 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.724s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:25:12 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-6d2e6de1-865b-4232-b88b-e6ce598f0dc4 tempest-ProjectMemberTests-406093346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7600056a-93b7-4694-ab67-1800b78cb7b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51894945-587d-4323-8ca7-d9a2c84b62bf', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:25:12 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-6d2e6de1-865b-4232-b88b-e6ce598f0dc4 tempest-ProjectMemberTests-406093346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd214809-3ccf-46ff-83e9-42638583b742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:25:12 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-6d2e6de1-865b-4232-b88b-e6ce598f0dc4 tempest-ProjectMemberTests-406093346 None] Volume volume-51894945-587d-4323-8ca7-d9a2c84b62bf (51894945-587d-4323-8ca7-d9a2c84b62bf): created successfully Nov 02 10:25:12 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-6d2e6de1-865b-4232-b88b-e6ce598f0dc4 tempest-ProjectMemberTests-406093346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd214809-3ccf-46ff-83e9-42638583b742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:25:12 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-6d2e6de1-865b-4232-b88b-e6ce598f0dc4 tempest-ProjectMemberTests-406093346 None] Flow 'volume_create_manager' (3edc77c6-f1a7-4f39-910c-5491031d9a38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:25:12 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-6d2e6de1-865b-4232-b88b-e6ce598f0dc4 tempest-ProjectMemberTests-406093346 None] Created volume successfully. Nov 02 10:25:12 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-7905579e-417d-4702-9c1d-f6cef6cd2bfe tempest-ProjectReaderTests-779709804 None] Acquiring lock "cinder-136fe035-f15f-4769-8dd5-25907031ca27-delete_snapshot" by "delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:25:12 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-7905579e-417d-4702-9c1d-f6cef6cd2bfe tempest-ProjectReaderTests-779709804 None] Lock "cinder-136fe035-f15f-4769-8dd5-25907031ca27-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:25:12 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-7905579e-417d-4702-9c1d-f6cef6cd2bfe tempest-ProjectReaderTests-779709804 None] Acquiring lock "cinder-quobyte-307cb443-a108-4d3a-a9a3-c475d949dccc" by "delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:25:12 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-7905579e-417d-4702-9c1d-f6cef6cd2bfe tempest-ProjectReaderTests-779709804 None] Lock "cinder-quobyte-307cb443-a108-4d3a-a9a3-c475d949dccc" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:25:12 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-7905579e-417d-4702-9c1d-f6cef6cd2bfe tempest-ProjectReaderTests-779709804 None] Acquiring lock "cinder-quobyte-136fe035-f15f-4769-8dd5-25907031ca27" by "_delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:25:12 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-7905579e-417d-4702-9c1d-f6cef6cd2bfe tempest-ProjectReaderTests-779709804 None] Lock "cinder-quobyte-136fe035-f15f-4769-8dd5-25907031ca27" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:25:12 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-7905579e-417d-4702-9c1d-f6cef6cd2bfe tempest-ProjectReaderTests-779709804 None] Deleting offline snapshot 136fe035-f15f-4769-8dd5-25907031ca27 of volume 307cb443-a108-4d3a-a9a3-c475d949dccc {{(pid=86890) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:25:12 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-7905579e-417d-4702-9c1d-f6cef6cd2bfe tempest-ProjectReaderTests-779709804 None] snapshot_file for this snap is: volume-307cb443-a108-4d3a-a9a3-c475d949dccc.136fe035-f15f-4769-8dd5-25907031ca27 {{(pid=86890) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:25:12 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[54111cf9-38c8-468d-a27a-38049ac55345]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:25:12 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-7905579e-417d-4702-9c1d-f6cef6cd2bfe tempest-ProjectReaderTests-779709804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-307cb443-a108-4d3a-a9a3-c475d949dccc.136fe035-f15f-4769-8dd5-25907031ca27 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:12 devstack sudo[106378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-307cb443-a108-4d3a-a9a3-c475d949dccc.136fe035-f15f-4769-8dd5-25907031ca27 Nov 02 10:25:12 devstack sudo[106378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:12 devstack sudo[106378]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:12 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-7905579e-417d-4702-9c1d-f6cef6cd2bfe tempest-ProjectReaderTests-779709804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-307cb443-a108-4d3a-a9a3-c475d949dccc.136fe035-f15f-4769-8dd5-25907031ca27" returned: 0 in 0.452s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:12 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-7905579e-417d-4702-9c1d-f6cef6cd2bfe tempest-ProjectReaderTests-779709804 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-307cb443-a108-4d3a-a9a3-c475d949dccc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86890) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:25:13 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[7488cd97-e446-4962-9530-464c433ebe51]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:25:13 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-7905579e-417d-4702-9c1d-f6cef6cd2bfe tempest-ProjectReaderTests-779709804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-307cb443-a108-4d3a-a9a3-c475d949dccc {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:13 devstack sudo[106384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-307cb443-a108-4d3a-a9a3-c475d949dccc Nov 02 10:25:13 devstack sudo[106384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:13 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-9c3864d2-a292-4866-8c93-ea31ef05a673 tempest-ProjectMemberTests-406093346 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:25:13 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-9c3864d2-a292-4866-8c93-ea31ef05a673 tempest-ProjectMemberTests-406093346 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:25:13 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-9c3864d2-a292-4866-8c93-ea31ef05a673 tempest-ProjectMemberTests-406093346 None] Creating offline snapshot 9859f5c5-8563-4a4d-8f28-d3a2bd7a9f26 of volume 51894945-587d-4323-8ca7-d9a2c84b62bf {{(pid=86890) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:25:13 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbb7087a-e208-4ff9-a378-d9e13191d3cd]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:25:13 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-9c3864d2-a292-4866-8c93-ea31ef05a673 tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-51894945-587d-4323-8ca7-d9a2c84b62bf {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:13 devstack sudo[106386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-51894945-587d-4323-8ca7-d9a2c84b62bf Nov 02 10:25:13 devstack sudo[106386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:13 devstack sudo[106384]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:13 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-7905579e-417d-4702-9c1d-f6cef6cd2bfe tempest-ProjectReaderTests-779709804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-307cb443-a108-4d3a-a9a3-c475d949dccc" returned: 0 in 0.423s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:13 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-7905579e-417d-4702-9c1d-f6cef6cd2bfe tempest-ProjectReaderTests-779709804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-307cb443-a108-4d3a-a9a3-c475d949dccc.136fe035-f15f-4769-8dd5-25907031ca27 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:13 devstack sudo[106391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-307cb443-a108-4d3a-a9a3-c475d949dccc.136fe035-f15f-4769-8dd5-25907031ca27 Nov 02 10:25:13 devstack sudo[106391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:13 devstack sudo[106386]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:13 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-9c3864d2-a292-4866-8c93-ea31ef05a673 tempest-ProjectMemberTests-406093346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-51894945-587d-4323-8ca7-d9a2c84b62bf" returned: 0 in 0.429s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:13 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-9c3864d2-a292-4866-8c93-ea31ef05a673 tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-51894945-587d-4323-8ca7-d9a2c84b62bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-51894945-587d-4323-8ca7-d9a2c84b62bf.9859f5c5-8563-4a4d-8f28-d3a2bd7a9f26 1G {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:13 devstack sudo[106396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-51894945-587d-4323-8ca7-d9a2c84b62bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-51894945-587d-4323-8ca7-d9a2c84b62bf.9859f5c5-8563-4a4d-8f28-d3a2bd7a9f26 1G Nov 02 10:25:13 devstack sudo[106396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:13 devstack sudo[106391]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:13 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-7905579e-417d-4702-9c1d-f6cef6cd2bfe tempest-ProjectReaderTests-779709804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-307cb443-a108-4d3a-a9a3-c475d949dccc.136fe035-f15f-4769-8dd5-25907031ca27" returned: 0 in 0.354s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:13 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-7905579e-417d-4702-9c1d-f6cef6cd2bfe tempest-ProjectReaderTests-779709804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-307cb443-a108-4d3a-a9a3-c475d949dccc.136fe035-f15f-4769-8dd5-25907031ca27 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:13 devstack sudo[106401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-307cb443-a108-4d3a-a9a3-c475d949dccc.136fe035-f15f-4769-8dd5-25907031ca27 Nov 02 10:25:13 devstack sudo[106401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:14 devstack sudo[106401]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:14 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-7905579e-417d-4702-9c1d-f6cef6cd2bfe tempest-ProjectReaderTests-779709804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-307cb443-a108-4d3a-a9a3-c475d949dccc.136fe035-f15f-4769-8dd5-25907031ca27" returned: 0 in 0.266s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:14 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-7905579e-417d-4702-9c1d-f6cef6cd2bfe tempest-ProjectReaderTests-779709804 None] Lock "cinder-quobyte-136fe035-f15f-4769-8dd5-25907031ca27" released by "_delete_snapshot" :: held 1.615s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:25:14 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-7905579e-417d-4702-9c1d-f6cef6cd2bfe tempest-ProjectReaderTests-779709804 None] Lock "cinder-quobyte-307cb443-a108-4d3a-a9a3-c475d949dccc" released by "delete_snapshot" :: held 1.639s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:25:14 devstack sudo[106396]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:14 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-9c3864d2-a292-4866-8c93-ea31ef05a673 tempest-ProjectMemberTests-406093346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-51894945-587d-4323-8ca7-d9a2c84b62bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-51894945-587d-4323-8ca7-d9a2c84b62bf.9859f5c5-8563-4a4d-8f28-d3a2bd7a9f26 1G" returned: 0 in 0.497s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:14 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-9c3864d2-a292-4866-8c93-ea31ef05a673 tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51894945-587d-4323-8ca7-d9a2c84b62bf -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-51894945-587d-4323-8ca7-d9a2c84b62bf.9859f5c5-8563-4a4d-8f28-d3a2bd7a9f26 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:14 devstack sudo[106409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51894945-587d-4323-8ca7-d9a2c84b62bf -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-51894945-587d-4323-8ca7-d9a2c84b62bf.9859f5c5-8563-4a4d-8f28-d3a2bd7a9f26 Nov 02 10:25:14 devstack sudo[106409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:14 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-7905579e-417d-4702-9c1d-f6cef6cd2bfe tempest-ProjectReaderTests-779709804 None] Created reservations ['00526e73-16b8-493f-9ef5-e7ee27865351', '45218e98-ae45-48ef-9abe-9a2122f8200c', '60be78ad-c465-452e-963c-f02ed0021bf5', 'a7611899-e795-4a1d-8686-49684d04ab12'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:25:14 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-7905579e-417d-4702-9c1d-f6cef6cd2bfe tempest-ProjectReaderTests-779709804 None] Delete snapshot completed successfully. Nov 02 10:25:14 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-7905579e-417d-4702-9c1d-f6cef6cd2bfe tempest-ProjectReaderTests-779709804 None] Lock "cinder-136fe035-f15f-4769-8dd5-25907031ca27-delete_snapshot" released by "delete_snapshot" :: held 1.793s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:25:14 devstack sudo[106409]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:14 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-9c3864d2-a292-4866-8c93-ea31ef05a673 tempest-ProjectMemberTests-406093346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51894945-587d-4323-8ca7-d9a2c84b62bf -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-51894945-587d-4323-8ca7-d9a2c84b62bf.9859f5c5-8563-4a4d-8f28-d3a2bd7a9f26" returned: 0 in 0.316s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:14 devstack cinder-volume[86890]: WARNING cinder.volume.drivers.remotefs [None req-9c3864d2-a292-4866-8c93-ea31ef05a673 tempest-ProjectMemberTests-406093346 None] /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-51894945-587d-4323-8ca7-d9a2c84b62bf.9859f5c5-8563-4a4d-8f28-d3a2bd7a9f26 is being set with open permissions: ugo+rw Nov 02 10:25:14 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-9c3864d2-a292-4866-8c93-ea31ef05a673 tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-51894945-587d-4323-8ca7-d9a2c84b62bf.9859f5c5-8563-4a4d-8f28-d3a2bd7a9f26 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:14 devstack sudo[106414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-51894945-587d-4323-8ca7-d9a2c84b62bf.9859f5c5-8563-4a4d-8f28-d3a2bd7a9f26 Nov 02 10:25:14 devstack sudo[106414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:14 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-1d0cc1cd-6bc6-4414-bf66-fb60a334f56d tempest-ProjectReaderTests-779709804 None] Acquiring lock "cinder-307cb443-a108-4d3a-a9a3-c475d949dccc-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:25:14 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-1d0cc1cd-6bc6-4414-bf66-fb60a334f56d tempest-ProjectReaderTests-779709804 None] Lock "cinder-307cb443-a108-4d3a-a9a3-c475d949dccc-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:25:14 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-1d0cc1cd-6bc6-4414-bf66-fb60a334f56d tempest-ProjectReaderTests-779709804 None] Acquiring lock "cinder-quobyte-307cb443-a108-4d3a-a9a3-c475d949dccc" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:25:14 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-1d0cc1cd-6bc6-4414-bf66-fb60a334f56d tempest-ProjectReaderTests-779709804 None] Lock "cinder-quobyte-307cb443-a108-4d3a-a9a3-c475d949dccc" acquired by "delete_volume" :: waited 0.016s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:25:14 devstack sudo[106414]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:14 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-9c3864d2-a292-4866-8c93-ea31ef05a673 tempest-ProjectMemberTests-406093346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-51894945-587d-4323-8ca7-d9a2c84b62bf.9859f5c5-8563-4a4d-8f28-d3a2bd7a9f26" returned: 0 in 0.284s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:14 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9657c4b-f982-47de-af4c-b41b2fa6a74c]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:25:14 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-1d0cc1cd-6bc6-4414-bf66-fb60a334f56d tempest-ProjectReaderTests-779709804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-307cb443-a108-4d3a-a9a3-c475d949dccc {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:14 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-9c3864d2-a292-4866-8c93-ea31ef05a673 tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-51894945-587d-4323-8ca7-d9a2c84b62bf.info {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:14 devstack sudo[106418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-51894945-587d-4323-8ca7-d9a2c84b62bf.info Nov 02 10:25:14 devstack sudo[106418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:14 devstack sudo[106417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-307cb443-a108-4d3a-a9a3-c475d949dccc Nov 02 10:25:14 devstack sudo[106417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:15 devstack sudo[106418]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:15 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-9c3864d2-a292-4866-8c93-ea31ef05a673 tempest-ProjectMemberTests-406093346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-51894945-587d-4323-8ca7-d9a2c84b62bf.info" returned: 0 in 0.251s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:15 devstack cinder-volume[86890]: WARNING cinder.volume.drivers.remotefs [None req-9c3864d2-a292-4866-8c93-ea31ef05a673 tempest-ProjectMemberTests-406093346 None] /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-51894945-587d-4323-8ca7-d9a2c84b62bf.info is being set with open permissions: ugo+rw Nov 02 10:25:15 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-9c3864d2-a292-4866-8c93-ea31ef05a673 tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-51894945-587d-4323-8ca7-d9a2c84b62bf.info {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:15 devstack sudo[106422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-51894945-587d-4323-8ca7-d9a2c84b62bf.info Nov 02 10:25:15 devstack sudo[106422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:15 devstack sudo[106417]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:15 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-1d0cc1cd-6bc6-4414-bf66-fb60a334f56d tempest-ProjectReaderTests-779709804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-307cb443-a108-4d3a-a9a3-c475d949dccc" returned: 0 in 0.392s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:15 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-1d0cc1cd-6bc6-4414-bf66-fb60a334f56d tempest-ProjectReaderTests-779709804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-307cb443-a108-4d3a-a9a3-c475d949dccc {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:15 devstack sudo[106427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-307cb443-a108-4d3a-a9a3-c475d949dccc Nov 02 10:25:15 devstack sudo[106427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:15 devstack sudo[106422]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:15 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-9c3864d2-a292-4866-8c93-ea31ef05a673 tempest-ProjectMemberTests-406093346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-51894945-587d-4323-8ca7-d9a2c84b62bf.info" returned: 0 in 0.278s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:15 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-9c3864d2-a292-4866-8c93-ea31ef05a673 tempest-ProjectMemberTests-406093346 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.152s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:25:15 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-9c3864d2-a292-4866-8c93-ea31ef05a673 tempest-ProjectMemberTests-406093346 None] Create snapshot completed successfully Nov 02 10:25:15 devstack sudo[106427]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:15 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-1d0cc1cd-6bc6-4414-bf66-fb60a334f56d tempest-ProjectReaderTests-779709804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-307cb443-a108-4d3a-a9a3-c475d949dccc" returned: 0 in 0.273s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:15 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-1d0cc1cd-6bc6-4414-bf66-fb60a334f56d tempest-ProjectReaderTests-779709804 None] Lock "cinder-quobyte-307cb443-a108-4d3a-a9a3-c475d949dccc" released by "delete_volume" :: held 0.733s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:25:15 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-1d0cc1cd-6bc6-4414-bf66-fb60a334f56d tempest-ProjectReaderTests-779709804 None] Created reservations ['02af40de-e1dc-4006-89e1-b66ab2694da5', '6013b8c9-152f-45c0-b051-0abba06c8748', 'd41ea757-33fd-4893-87c1-6417fe0ff11f', '3a27e4c4-18ef-4908-bf7c-6e215b0d1dae'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:25:15 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-1d0cc1cd-6bc6-4414-bf66-fb60a334f56d tempest-ProjectReaderTests-779709804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:25:15 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-1d0cc1cd-6bc6-4414-bf66-fb60a334f56d tempest-ProjectReaderTests-779709804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:25:15 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-1d0cc1cd-6bc6-4414-bf66-fb60a334f56d tempest-ProjectReaderTests-779709804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:25:15 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-1d0cc1cd-6bc6-4414-bf66-fb60a334f56d tempest-ProjectReaderTests-779709804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:25:15 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-1d0cc1cd-6bc6-4414-bf66-fb60a334f56d tempest-ProjectReaderTests-779709804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:25:15 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-1d0cc1cd-6bc6-4414-bf66-fb60a334f56d tempest-ProjectReaderTests-779709804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:15 devstack sudo[106431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:25:15 devstack sudo[106431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:15 devstack sudo[106431]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:15 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-1d0cc1cd-6bc6-4414-bf66-fb60a334f56d tempest-ProjectReaderTests-779709804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.279s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:15 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-1d0cc1cd-6bc6-4414-bf66-fb60a334f56d tempest-ProjectReaderTests-779709804 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:25:15 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-1d0cc1cd-6bc6-4414-bf66-fb60a334f56d tempest-ProjectReaderTests-779709804 None] Deleted volume successfully. Nov 02 10:25:15 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-1d0cc1cd-6bc6-4414-bf66-fb60a334f56d tempest-ProjectReaderTests-779709804 None] Lock "cinder-307cb443-a108-4d3a-a9a3-c475d949dccc-delete_volume" released by "delete_volume" :: held 1.232s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:25:16 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-82506abd-5eea-4a64-9f17-6c77d3ab25fa tempest-ProjectReaderTests-779709804 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:25:16 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-82506abd-5eea-4a64-9f17-6c77d3ab25fa tempest-ProjectReaderTests-779709804 None] Flow 'volume_create_manager' (06985d8b-1eed-4600-8eca-7c07d0e1f05a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:25:16 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-82506abd-5eea-4a64-9f17-6c77d3ab25fa tempest-ProjectReaderTests-779709804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddc409e2-b7e8-4f3d-abd1-cd2c6ab67927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:25:16 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-82506abd-5eea-4a64-9f17-6c77d3ab25fa tempest-ProjectReaderTests-779709804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddc409e2-b7e8-4f3d-abd1-cd2c6ab67927) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:25:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1717363146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9868f4f6-9dac-462e-9878-0ed6cbefe5bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a88c80344544473c8d2457c14d0db292',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:25:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:25:16Z,use_quota=True,user_id='830d06ded8694a4dae7d1bfd5f316394',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:25:16 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-82506abd-5eea-4a64-9f17-6c77d3ab25fa tempest-ProjectReaderTests-779709804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20622425-7e67-41c3-923a-e707653337f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:25:16 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-82506abd-5eea-4a64-9f17-6c77d3ab25fa tempest-ProjectReaderTests-779709804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20622425-7e67-41c3-923a-e707653337f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:25:16 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-82506abd-5eea-4a64-9f17-6c77d3ab25fa tempest-ProjectReaderTests-779709804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0319400c-0fcf-4068-80fd-9ae8864d9702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:25:16 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-82506abd-5eea-4a64-9f17-6c77d3ab25fa tempest-ProjectReaderTests-779709804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0319400c-0fcf-4068-80fd-9ae8864d9702) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9868f4f6-9dac-462e-9878-0ed6cbefe5bc', 'volume_name': 'volume-9868f4f6-9dac-462e-9878-0ed6cbefe5bc', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:25:16 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-82506abd-5eea-4a64-9f17-6c77d3ab25fa tempest-ProjectReaderTests-779709804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c627c2cb-4464-4275-a7db-91abdf5f6877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:25:16 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-82506abd-5eea-4a64-9f17-6c77d3ab25fa tempest-ProjectReaderTests-779709804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c627c2cb-4464-4275-a7db-91abdf5f6877) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:25:16 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-82506abd-5eea-4a64-9f17-6c77d3ab25fa tempest-ProjectReaderTests-779709804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (116eef1c-97bf-4f99-a5d5-5029e0c8acb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:25:16 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-82506abd-5eea-4a64-9f17-6c77d3ab25fa tempest-ProjectReaderTests-779709804 None] Volume 9868f4f6-9dac-462e-9878-0ed6cbefe5bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9868f4f6-9dac-462e-9878-0ed6cbefe5bc', 'volume_size': 1} Nov 02 10:25:16 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-82506abd-5eea-4a64-9f17-6c77d3ab25fa tempest-ProjectReaderTests-779709804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:25:16 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-82506abd-5eea-4a64-9f17-6c77d3ab25fa tempest-ProjectReaderTests-779709804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:25:16 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-82506abd-5eea-4a64-9f17-6c77d3ab25fa tempest-ProjectReaderTests-779709804 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:25:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1717363146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9868f4f6-9dac-462e-9878-0ed6cbefe5bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a88c80344544473c8d2457c14d0db292',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:25:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:25:16Z,use_quota=True,user_id='830d06ded8694a4dae7d1bfd5f316394',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:25:16 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-82506abd-5eea-4a64-9f17-6c77d3ab25fa tempest-ProjectReaderTests-779709804 None] Creating volume 9868f4f6-9dac-462e-9878-0ed6cbefe5bc {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:25:16 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-82506abd-5eea-4a64-9f17-6c77d3ab25fa tempest-ProjectReaderTests-779709804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:25:16 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-82506abd-5eea-4a64-9f17-6c77d3ab25fa tempest-ProjectReaderTests-779709804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:25:16 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-82506abd-5eea-4a64-9f17-6c77d3ab25fa tempest-ProjectReaderTests-779709804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:25:16 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-82506abd-5eea-4a64-9f17-6c77d3ab25fa tempest-ProjectReaderTests-779709804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:25:16 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-82506abd-5eea-4a64-9f17-6c77d3ab25fa tempest-ProjectReaderTests-779709804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:25:16 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-82506abd-5eea-4a64-9f17-6c77d3ab25fa tempest-ProjectReaderTests-779709804 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:25:16 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-82506abd-5eea-4a64-9f17-6c77d3ab25fa tempest-ProjectReaderTests-779709804 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:25:16 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-82506abd-5eea-4a64-9f17-6c77d3ab25fa tempest-ProjectReaderTests-779709804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-9868f4f6-9dac-462e-9878-0ed6cbefe5bc 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:16 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-6d8f0168-3b73-4280-8bed-b6dd89e8fbde tempest-ProjectMemberTests-406093346 None] Acquiring lock "cinder-9859f5c5-8563-4a4d-8f28-d3a2bd7a9f26-delete_snapshot" by "delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:25:16 devstack sudo[106434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-9868f4f6-9dac-462e-9878-0ed6cbefe5bc 1073741824 Nov 02 10:25:16 devstack sudo[106434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:16 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-6d8f0168-3b73-4280-8bed-b6dd89e8fbde tempest-ProjectMemberTests-406093346 None] Lock "cinder-9859f5c5-8563-4a4d-8f28-d3a2bd7a9f26-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:25:16 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-6d8f0168-3b73-4280-8bed-b6dd89e8fbde tempest-ProjectMemberTests-406093346 None] Acquiring lock "cinder-quobyte-51894945-587d-4323-8ca7-d9a2c84b62bf" by "delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:25:16 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-6d8f0168-3b73-4280-8bed-b6dd89e8fbde tempest-ProjectMemberTests-406093346 None] Lock "cinder-quobyte-51894945-587d-4323-8ca7-d9a2c84b62bf" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:25:16 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-6d8f0168-3b73-4280-8bed-b6dd89e8fbde tempest-ProjectMemberTests-406093346 None] Acquiring lock "cinder-quobyte-9859f5c5-8563-4a4d-8f28-d3a2bd7a9f26" by "_delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:25:16 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-6d8f0168-3b73-4280-8bed-b6dd89e8fbde tempest-ProjectMemberTests-406093346 None] Lock "cinder-quobyte-9859f5c5-8563-4a4d-8f28-d3a2bd7a9f26" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:25:16 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-6d8f0168-3b73-4280-8bed-b6dd89e8fbde tempest-ProjectMemberTests-406093346 None] Deleting offline snapshot 9859f5c5-8563-4a4d-8f28-d3a2bd7a9f26 of volume 51894945-587d-4323-8ca7-d9a2c84b62bf {{(pid=86890) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:25:16 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-6d8f0168-3b73-4280-8bed-b6dd89e8fbde tempest-ProjectMemberTests-406093346 None] snapshot_file for this snap is: volume-51894945-587d-4323-8ca7-d9a2c84b62bf.9859f5c5-8563-4a4d-8f28-d3a2bd7a9f26 {{(pid=86890) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:25:16 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ca5a0d6-b0b7-4432-8fdf-87579243af4a]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:25:16 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6d8f0168-3b73-4280-8bed-b6dd89e8fbde tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-51894945-587d-4323-8ca7-d9a2c84b62bf.9859f5c5-8563-4a4d-8f28-d3a2bd7a9f26 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:16 devstack sudo[106436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-51894945-587d-4323-8ca7-d9a2c84b62bf.9859f5c5-8563-4a4d-8f28-d3a2bd7a9f26 Nov 02 10:25:16 devstack sudo[106436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:16 devstack sudo[106434]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:16 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-82506abd-5eea-4a64-9f17-6c77d3ab25fa tempest-ProjectReaderTests-779709804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-9868f4f6-9dac-462e-9878-0ed6cbefe5bc 1073741824" returned: 0 in 0.461s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:16 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-82506abd-5eea-4a64-9f17-6c77d3ab25fa tempest-ProjectReaderTests-779709804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-9868f4f6-9dac-462e-9878-0ed6cbefe5bc {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:16 devstack sudo[106436]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:16 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6d8f0168-3b73-4280-8bed-b6dd89e8fbde tempest-ProjectMemberTests-406093346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-51894945-587d-4323-8ca7-d9a2c84b62bf.9859f5c5-8563-4a4d-8f28-d3a2bd7a9f26" returned: 0 in 0.425s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:16 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-6d8f0168-3b73-4280-8bed-b6dd89e8fbde tempest-ProjectMemberTests-406093346 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-51894945-587d-4323-8ca7-d9a2c84b62bf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86890) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:25:16 devstack sudo[106450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-9868f4f6-9dac-462e-9878-0ed6cbefe5bc Nov 02 10:25:16 devstack sudo[106450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:16 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[a44da67b-6cf3-4f2a-af03-901c83766256]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:25:16 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6d8f0168-3b73-4280-8bed-b6dd89e8fbde tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-51894945-587d-4323-8ca7-d9a2c84b62bf {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:17 devstack sudo[106455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-51894945-587d-4323-8ca7-d9a2c84b62bf Nov 02 10:25:17 devstack sudo[106455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:17 devstack sudo[106450]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:17 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-82506abd-5eea-4a64-9f17-6c77d3ab25fa tempest-ProjectReaderTests-779709804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-9868f4f6-9dac-462e-9878-0ed6cbefe5bc" returned: 0 in 0.276s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:17 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-82506abd-5eea-4a64-9f17-6c77d3ab25fa tempest-ProjectReaderTests-779709804 None] <== create_volume: return (794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:25:17 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-82506abd-5eea-4a64-9f17-6c77d3ab25fa tempest-ProjectReaderTests-779709804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.797s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:25:17 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-82506abd-5eea-4a64-9f17-6c77d3ab25fa tempest-ProjectReaderTests-779709804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (116eef1c-97bf-4f99-a5d5-5029e0c8acb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9868f4f6-9dac-462e-9878-0ed6cbefe5bc', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:25:17 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-82506abd-5eea-4a64-9f17-6c77d3ab25fa tempest-ProjectReaderTests-779709804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77cf39fb-1ced-4643-92ac-9341e3936056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:25:17 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-82506abd-5eea-4a64-9f17-6c77d3ab25fa tempest-ProjectReaderTests-779709804 None] Volume volume-9868f4f6-9dac-462e-9878-0ed6cbefe5bc (9868f4f6-9dac-462e-9878-0ed6cbefe5bc): created successfully Nov 02 10:25:17 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-82506abd-5eea-4a64-9f17-6c77d3ab25fa tempest-ProjectReaderTests-779709804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77cf39fb-1ced-4643-92ac-9341e3936056) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:25:17 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-82506abd-5eea-4a64-9f17-6c77d3ab25fa tempest-ProjectReaderTests-779709804 None] Flow 'volume_create_manager' (06985d8b-1eed-4600-8eca-7c07d0e1f05a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:25:17 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-82506abd-5eea-4a64-9f17-6c77d3ab25fa tempest-ProjectReaderTests-779709804 None] Created volume successfully. Nov 02 10:25:17 devstack sudo[106455]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:17 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6d8f0168-3b73-4280-8bed-b6dd89e8fbde tempest-ProjectMemberTests-406093346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-51894945-587d-4323-8ca7-d9a2c84b62bf" returned: 0 in 0.415s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:17 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6d8f0168-3b73-4280-8bed-b6dd89e8fbde tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-51894945-587d-4323-8ca7-d9a2c84b62bf.9859f5c5-8563-4a4d-8f28-d3a2bd7a9f26 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:17 devstack sudo[106461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-51894945-587d-4323-8ca7-d9a2c84b62bf.9859f5c5-8563-4a4d-8f28-d3a2bd7a9f26 Nov 02 10:25:17 devstack sudo[106461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:17 devstack sudo[106461]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:17 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6d8f0168-3b73-4280-8bed-b6dd89e8fbde tempest-ProjectMemberTests-406093346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-51894945-587d-4323-8ca7-d9a2c84b62bf.9859f5c5-8563-4a4d-8f28-d3a2bd7a9f26" returned: 0 in 0.353s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:17 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6d8f0168-3b73-4280-8bed-b6dd89e8fbde tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-51894945-587d-4323-8ca7-d9a2c84b62bf.9859f5c5-8563-4a4d-8f28-d3a2bd7a9f26 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:17 devstack sudo[106467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-51894945-587d-4323-8ca7-d9a2c84b62bf.9859f5c5-8563-4a4d-8f28-d3a2bd7a9f26 Nov 02 10:25:17 devstack sudo[106467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:17 devstack sudo[106467]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:17 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6d8f0168-3b73-4280-8bed-b6dd89e8fbde tempest-ProjectMemberTests-406093346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-51894945-587d-4323-8ca7-d9a2c84b62bf.9859f5c5-8563-4a4d-8f28-d3a2bd7a9f26" returned: 0 in 0.254s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:17 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-6d8f0168-3b73-4280-8bed-b6dd89e8fbde tempest-ProjectMemberTests-406093346 None] Lock "cinder-quobyte-9859f5c5-8563-4a4d-8f28-d3a2bd7a9f26" released by "_delete_snapshot" :: held 1.557s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:25:17 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-6d8f0168-3b73-4280-8bed-b6dd89e8fbde tempest-ProjectMemberTests-406093346 None] Lock "cinder-quobyte-51894945-587d-4323-8ca7-d9a2c84b62bf" released by "delete_snapshot" :: held 1.578s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:25:18 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-6d8f0168-3b73-4280-8bed-b6dd89e8fbde tempest-ProjectMemberTests-406093346 None] Created reservations ['48fd8120-d38c-419c-b22a-3ed712c373eb', '782c58c3-3af5-41ee-88a8-2a4216270d6d', '4f32885c-1e58-4f09-958f-bbd7a21de073', 'e41fcc95-0288-4e9d-9f48-66edb2a743fb'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:25:18 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-6d8f0168-3b73-4280-8bed-b6dd89e8fbde tempest-ProjectMemberTests-406093346 None] Delete snapshot completed successfully. Nov 02 10:25:18 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-6d8f0168-3b73-4280-8bed-b6dd89e8fbde tempest-ProjectMemberTests-406093346 None] Lock "cinder-9859f5c5-8563-4a4d-8f28-d3a2bd7a9f26-delete_snapshot" released by "delete_snapshot" :: held 1.725s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:25:18 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-74df61a3-6762-495a-8db4-0098d8c75779 tempest-ProjectReaderTests-779709804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:25:18 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-74df61a3-6762-495a-8db4-0098d8c75779 tempest-ProjectReaderTests-779709804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:25:18 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-25f5f47c-0ef3-4fe4-a3e0-2a42d019ac98 tempest-ProjectMemberTests-406093346 None] Acquiring lock "cinder-51894945-587d-4323-8ca7-d9a2c84b62bf-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:25:18 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-74df61a3-6762-495a-8db4-0098d8c75779 tempest-ProjectReaderTests-779709804 None] Creating offline snapshot 450044ae-6689-4dd6-9093-747dc8b162ea of volume 9868f4f6-9dac-462e-9878-0ed6cbefe5bc {{(pid=86890) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:25:18 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-25f5f47c-0ef3-4fe4-a3e0-2a42d019ac98 tempest-ProjectMemberTests-406093346 None] Lock "cinder-51894945-587d-4323-8ca7-d9a2c84b62bf-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:25:18 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d229072-5c4b-40ed-84f5-34e797c6969e]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:25:18 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-74df61a3-6762-495a-8db4-0098d8c75779 tempest-ProjectReaderTests-779709804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-9868f4f6-9dac-462e-9878-0ed6cbefe5bc {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:18 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-25f5f47c-0ef3-4fe4-a3e0-2a42d019ac98 tempest-ProjectMemberTests-406093346 None] Acquiring lock "cinder-quobyte-51894945-587d-4323-8ca7-d9a2c84b62bf" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:25:18 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-25f5f47c-0ef3-4fe4-a3e0-2a42d019ac98 tempest-ProjectMemberTests-406093346 None] Lock "cinder-quobyte-51894945-587d-4323-8ca7-d9a2c84b62bf" acquired by "delete_volume" :: waited 0.019s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:25:18 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8bddd7a-f4eb-43b9-a219-b86bd0ac44f5]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:25:18 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-25f5f47c-0ef3-4fe4-a3e0-2a42d019ac98 tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-51894945-587d-4323-8ca7-d9a2c84b62bf {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:18 devstack sudo[106470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-9868f4f6-9dac-462e-9878-0ed6cbefe5bc Nov 02 10:25:18 devstack sudo[106470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:18 devstack sudo[106472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-51894945-587d-4323-8ca7-d9a2c84b62bf Nov 02 10:25:18 devstack sudo[106472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:18 devstack sudo[106470]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:18 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-74df61a3-6762-495a-8db4-0098d8c75779 tempest-ProjectReaderTests-779709804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-9868f4f6-9dac-462e-9878-0ed6cbefe5bc" returned: 0 in 0.414s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:18 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-74df61a3-6762-495a-8db4-0098d8c75779 tempest-ProjectReaderTests-779709804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-9868f4f6-9dac-462e-9878-0ed6cbefe5bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-9868f4f6-9dac-462e-9878-0ed6cbefe5bc.450044ae-6689-4dd6-9093-747dc8b162ea 1G {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:19 devstack sudo[106477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-9868f4f6-9dac-462e-9878-0ed6cbefe5bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-9868f4f6-9dac-462e-9878-0ed6cbefe5bc.450044ae-6689-4dd6-9093-747dc8b162ea 1G Nov 02 10:25:19 devstack sudo[106477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:19 devstack sudo[106472]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:19 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-25f5f47c-0ef3-4fe4-a3e0-2a42d019ac98 tempest-ProjectMemberTests-406093346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-51894945-587d-4323-8ca7-d9a2c84b62bf" returned: 0 in 0.394s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:19 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-25f5f47c-0ef3-4fe4-a3e0-2a42d019ac98 tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-51894945-587d-4323-8ca7-d9a2c84b62bf {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:19 devstack sudo[106482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-51894945-587d-4323-8ca7-d9a2c84b62bf Nov 02 10:25:19 devstack sudo[106482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:19 devstack sudo[106482]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:19 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-25f5f47c-0ef3-4fe4-a3e0-2a42d019ac98 tempest-ProjectMemberTests-406093346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-51894945-587d-4323-8ca7-d9a2c84b62bf" returned: 0 in 0.324s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:19 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-25f5f47c-0ef3-4fe4-a3e0-2a42d019ac98 tempest-ProjectMemberTests-406093346 None] Lock "cinder-quobyte-51894945-587d-4323-8ca7-d9a2c84b62bf" released by "delete_volume" :: held 0.796s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:25:19 devstack sudo[106477]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:19 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-74df61a3-6762-495a-8db4-0098d8c75779 tempest-ProjectReaderTests-779709804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-9868f4f6-9dac-462e-9878-0ed6cbefe5bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-9868f4f6-9dac-462e-9878-0ed6cbefe5bc.450044ae-6689-4dd6-9093-747dc8b162ea 1G" returned: 0 in 0.462s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:19 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-74df61a3-6762-495a-8db4-0098d8c75779 tempest-ProjectReaderTests-779709804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9868f4f6-9dac-462e-9878-0ed6cbefe5bc -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-9868f4f6-9dac-462e-9878-0ed6cbefe5bc.450044ae-6689-4dd6-9093-747dc8b162ea {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:19 devstack sudo[106489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9868f4f6-9dac-462e-9878-0ed6cbefe5bc -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-9868f4f6-9dac-462e-9878-0ed6cbefe5bc.450044ae-6689-4dd6-9093-747dc8b162ea Nov 02 10:25:19 devstack sudo[106489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:19 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-25f5f47c-0ef3-4fe4-a3e0-2a42d019ac98 tempest-ProjectMemberTests-406093346 None] Created reservations ['0d4542b4-95a5-4a7e-a1c6-b9c03cbf414a', 'f0deb114-6209-4165-9b80-d72abf516234', '3c07e907-2fdd-4af5-be84-9b2dc3488438', 'd48d2020-866b-4a30-9dca-b81718806725'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:25:19 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-25f5f47c-0ef3-4fe4-a3e0-2a42d019ac98 tempest-ProjectMemberTests-406093346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:25:19 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-25f5f47c-0ef3-4fe4-a3e0-2a42d019ac98 tempest-ProjectMemberTests-406093346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:25:19 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-25f5f47c-0ef3-4fe4-a3e0-2a42d019ac98 tempest-ProjectMemberTests-406093346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:25:19 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-25f5f47c-0ef3-4fe4-a3e0-2a42d019ac98 tempest-ProjectMemberTests-406093346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:25:19 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-25f5f47c-0ef3-4fe4-a3e0-2a42d019ac98 tempest-ProjectMemberTests-406093346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:25:19 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-25f5f47c-0ef3-4fe4-a3e0-2a42d019ac98 tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:19 devstack sudo[106491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:25:19 devstack sudo[106491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:19 devstack sudo[106489]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:19 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-74df61a3-6762-495a-8db4-0098d8c75779 tempest-ProjectReaderTests-779709804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9868f4f6-9dac-462e-9878-0ed6cbefe5bc -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-9868f4f6-9dac-462e-9878-0ed6cbefe5bc.450044ae-6689-4dd6-9093-747dc8b162ea" returned: 0 in 0.374s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:19 devstack cinder-volume[86890]: WARNING cinder.volume.drivers.remotefs [None req-74df61a3-6762-495a-8db4-0098d8c75779 tempest-ProjectReaderTests-779709804 None] /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-9868f4f6-9dac-462e-9878-0ed6cbefe5bc.450044ae-6689-4dd6-9093-747dc8b162ea is being set with open permissions: ugo+rw Nov 02 10:25:19 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-74df61a3-6762-495a-8db4-0098d8c75779 tempest-ProjectReaderTests-779709804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-9868f4f6-9dac-462e-9878-0ed6cbefe5bc.450044ae-6689-4dd6-9093-747dc8b162ea {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:19 devstack sudo[106496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-9868f4f6-9dac-462e-9878-0ed6cbefe5bc.450044ae-6689-4dd6-9093-747dc8b162ea Nov 02 10:25:19 devstack sudo[106496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:19 devstack sudo[106491]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:19 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-25f5f47c-0ef3-4fe4-a3e0-2a42d019ac98 tempest-ProjectMemberTests-406093346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.306s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:19 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-25f5f47c-0ef3-4fe4-a3e0-2a42d019ac98 tempest-ProjectMemberTests-406093346 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:25:19 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-25f5f47c-0ef3-4fe4-a3e0-2a42d019ac98 tempest-ProjectMemberTests-406093346 None] Deleted volume successfully. Nov 02 10:25:19 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-25f5f47c-0ef3-4fe4-a3e0-2a42d019ac98 tempest-ProjectMemberTests-406093346 None] Lock "cinder-51894945-587d-4323-8ca7-d9a2c84b62bf-delete_volume" released by "delete_volume" :: held 1.391s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:25:20 devstack sudo[106496]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:20 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-74df61a3-6762-495a-8db4-0098d8c75779 tempest-ProjectReaderTests-779709804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-9868f4f6-9dac-462e-9878-0ed6cbefe5bc.450044ae-6689-4dd6-9093-747dc8b162ea" returned: 0 in 0.326s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:20 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-74df61a3-6762-495a-8db4-0098d8c75779 tempest-ProjectReaderTests-779709804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-9868f4f6-9dac-462e-9878-0ed6cbefe5bc.info {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:20 devstack sudo[106500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-9868f4f6-9dac-462e-9878-0ed6cbefe5bc.info Nov 02 10:25:20 devstack sudo[106500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:20 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-069268ca-d6f2-4fa8-9471-967b0fe8a28e tempest-ProjectMemberTests-406093346 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:25:20 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-069268ca-d6f2-4fa8-9471-967b0fe8a28e tempest-ProjectMemberTests-406093346 None] Flow 'volume_create_manager' (ccf6e39c-a3e9-4ca7-9159-e9694b2c8e16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:25:20 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-069268ca-d6f2-4fa8-9471-967b0fe8a28e tempest-ProjectMemberTests-406093346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3c25e5e-33ba-4bbd-ad67-b6f5c136cc28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:25:20 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-069268ca-d6f2-4fa8-9471-967b0fe8a28e tempest-ProjectMemberTests-406093346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3c25e5e-33ba-4bbd-ad67-b6f5c136cc28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:25:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-528916472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94d15e72-8c33-4e2c-b9b3-9ef7584407bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='639ad964aa1b416eb473afb3c18dd4e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:25:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:25:20Z,use_quota=True,user_id='076db3d85c064198aa1722b31937515d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:25:20 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-069268ca-d6f2-4fa8-9471-967b0fe8a28e tempest-ProjectMemberTests-406093346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ecba3ce-95ef-480d-861a-61133b39ab04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:25:20 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-069268ca-d6f2-4fa8-9471-967b0fe8a28e tempest-ProjectMemberTests-406093346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ecba3ce-95ef-480d-861a-61133b39ab04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:25:20 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-069268ca-d6f2-4fa8-9471-967b0fe8a28e tempest-ProjectMemberTests-406093346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc736879-b05c-42a5-9b28-bcc9522daee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:25:20 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-069268ca-d6f2-4fa8-9471-967b0fe8a28e tempest-ProjectMemberTests-406093346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc736879-b05c-42a5-9b28-bcc9522daee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94d15e72-8c33-4e2c-b9b3-9ef7584407bb', 'volume_name': 'volume-94d15e72-8c33-4e2c-b9b3-9ef7584407bb', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:25:20 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-069268ca-d6f2-4fa8-9471-967b0fe8a28e tempest-ProjectMemberTests-406093346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f37ee6b2-403b-4406-80e5-f8256f9dc8a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:25:20 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-069268ca-d6f2-4fa8-9471-967b0fe8a28e tempest-ProjectMemberTests-406093346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f37ee6b2-403b-4406-80e5-f8256f9dc8a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:25:20 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-069268ca-d6f2-4fa8-9471-967b0fe8a28e tempest-ProjectMemberTests-406093346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5413ba7c-6810-46aa-ab5d-9077c24c8214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:25:20 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-069268ca-d6f2-4fa8-9471-967b0fe8a28e tempest-ProjectMemberTests-406093346 None] Volume 94d15e72-8c33-4e2c-b9b3-9ef7584407bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94d15e72-8c33-4e2c-b9b3-9ef7584407bb', 'volume_size': 1} Nov 02 10:25:20 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-069268ca-d6f2-4fa8-9471-967b0fe8a28e tempest-ProjectMemberTests-406093346 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:25:20 devstack sudo[106500]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:20 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-74df61a3-6762-495a-8db4-0098d8c75779 tempest-ProjectReaderTests-779709804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-9868f4f6-9dac-462e-9878-0ed6cbefe5bc.info" returned: 0 in 0.272s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:20 devstack cinder-volume[86890]: WARNING cinder.volume.drivers.remotefs [None req-74df61a3-6762-495a-8db4-0098d8c75779 tempest-ProjectReaderTests-779709804 None] /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-9868f4f6-9dac-462e-9878-0ed6cbefe5bc.info is being set with open permissions: ugo+rw Nov 02 10:25:20 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-74df61a3-6762-495a-8db4-0098d8c75779 tempest-ProjectReaderTests-779709804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-9868f4f6-9dac-462e-9878-0ed6cbefe5bc.info {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:20 devstack sudo[106503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-9868f4f6-9dac-462e-9878-0ed6cbefe5bc.info Nov 02 10:25:20 devstack sudo[106503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:20 devstack sudo[106503]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:20 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-74df61a3-6762-495a-8db4-0098d8c75779 tempest-ProjectReaderTests-779709804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-9868f4f6-9dac-462e-9878-0ed6cbefe5bc.info" returned: 0 in 0.279s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:20 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-74df61a3-6762-495a-8db4-0098d8c75779 tempest-ProjectReaderTests-779709804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.249s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:25:20 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-069268ca-d6f2-4fa8-9471-967b0fe8a28e tempest-ProjectMemberTests-406093346 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.438s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:25:20 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-069268ca-d6f2-4fa8-9471-967b0fe8a28e tempest-ProjectMemberTests-406093346 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:25:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-528916472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94d15e72-8c33-4e2c-b9b3-9ef7584407bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='639ad964aa1b416eb473afb3c18dd4e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:25:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:25:20Z,use_quota=True,user_id='076db3d85c064198aa1722b31937515d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:25:20 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-069268ca-d6f2-4fa8-9471-967b0fe8a28e tempest-ProjectMemberTests-406093346 None] Creating volume 94d15e72-8c33-4e2c-b9b3-9ef7584407bb {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:25:20 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-069268ca-d6f2-4fa8-9471-967b0fe8a28e tempest-ProjectMemberTests-406093346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:25:20 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-069268ca-d6f2-4fa8-9471-967b0fe8a28e tempest-ProjectMemberTests-406093346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:25:20 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-069268ca-d6f2-4fa8-9471-967b0fe8a28e tempest-ProjectMemberTests-406093346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:25:20 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-069268ca-d6f2-4fa8-9471-967b0fe8a28e tempest-ProjectMemberTests-406093346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:25:20 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-069268ca-d6f2-4fa8-9471-967b0fe8a28e tempest-ProjectMemberTests-406093346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:25:20 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-069268ca-d6f2-4fa8-9471-967b0fe8a28e tempest-ProjectMemberTests-406093346 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:25:20 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-069268ca-d6f2-4fa8-9471-967b0fe8a28e tempest-ProjectMemberTests-406093346 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:25:20 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-069268ca-d6f2-4fa8-9471-967b0fe8a28e tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-94d15e72-8c33-4e2c-b9b3-9ef7584407bb 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:20 devstack sudo[106579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-94d15e72-8c33-4e2c-b9b3-9ef7584407bb 1073741824 Nov 02 10:25:20 devstack sudo[106579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:20 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-74df61a3-6762-495a-8db4-0098d8c75779 tempest-ProjectReaderTests-779709804 None] Create snapshot completed successfully Nov 02 10:25:21 devstack sudo[106579]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:21 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-069268ca-d6f2-4fa8-9471-967b0fe8a28e tempest-ProjectMemberTests-406093346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-94d15e72-8c33-4e2c-b9b3-9ef7584407bb 1073741824" returned: 0 in 0.475s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:21 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-069268ca-d6f2-4fa8-9471-967b0fe8a28e tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-94d15e72-8c33-4e2c-b9b3-9ef7584407bb {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:21 devstack sudo[106635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-94d15e72-8c33-4e2c-b9b3-9ef7584407bb Nov 02 10:25:21 devstack sudo[106635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:21 devstack sudo[106635]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:21 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-069268ca-d6f2-4fa8-9471-967b0fe8a28e tempest-ProjectMemberTests-406093346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-94d15e72-8c33-4e2c-b9b3-9ef7584407bb" returned: 0 in 0.253s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:21 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-069268ca-d6f2-4fa8-9471-967b0fe8a28e tempest-ProjectMemberTests-406093346 None] <== create_volume: return (796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:25:21 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-069268ca-d6f2-4fa8-9471-967b0fe8a28e tempest-ProjectMemberTests-406093346 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.803s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:25:21 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-069268ca-d6f2-4fa8-9471-967b0fe8a28e tempest-ProjectMemberTests-406093346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5413ba7c-6810-46aa-ab5d-9077c24c8214) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94d15e72-8c33-4e2c-b9b3-9ef7584407bb', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:25:21 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-069268ca-d6f2-4fa8-9471-967b0fe8a28e tempest-ProjectMemberTests-406093346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0d3f916-468c-47e8-a964-d5f7d5164971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:25:21 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-069268ca-d6f2-4fa8-9471-967b0fe8a28e tempest-ProjectMemberTests-406093346 None] Volume volume-94d15e72-8c33-4e2c-b9b3-9ef7584407bb (94d15e72-8c33-4e2c-b9b3-9ef7584407bb): created successfully Nov 02 10:25:21 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-069268ca-d6f2-4fa8-9471-967b0fe8a28e tempest-ProjectMemberTests-406093346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0d3f916-468c-47e8-a964-d5f7d5164971) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:25:21 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-069268ca-d6f2-4fa8-9471-967b0fe8a28e tempest-ProjectMemberTests-406093346 None] Flow 'volume_create_manager' (ccf6e39c-a3e9-4ca7-9159-e9694b2c8e16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:25:21 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-069268ca-d6f2-4fa8-9471-967b0fe8a28e tempest-ProjectMemberTests-406093346 None] Created volume successfully. Nov 02 10:25:21 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-ed06a5d1-4280-4ab0-a31d-2622081198bd tempest-ProjectReaderTests-779709804 None] Acquiring lock "cinder-450044ae-6689-4dd6-9093-747dc8b162ea-delete_snapshot" by "delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:25:21 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-ed06a5d1-4280-4ab0-a31d-2622081198bd tempest-ProjectReaderTests-779709804 None] Lock "cinder-450044ae-6689-4dd6-9093-747dc8b162ea-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:25:21 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-ed06a5d1-4280-4ab0-a31d-2622081198bd tempest-ProjectReaderTests-779709804 None] Acquiring lock "cinder-quobyte-9868f4f6-9dac-462e-9878-0ed6cbefe5bc" by "delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:25:21 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-ed06a5d1-4280-4ab0-a31d-2622081198bd tempest-ProjectReaderTests-779709804 None] Lock "cinder-quobyte-9868f4f6-9dac-462e-9878-0ed6cbefe5bc" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:25:21 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-ed06a5d1-4280-4ab0-a31d-2622081198bd tempest-ProjectReaderTests-779709804 None] Acquiring lock "cinder-quobyte-450044ae-6689-4dd6-9093-747dc8b162ea" by "_delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:25:21 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-ed06a5d1-4280-4ab0-a31d-2622081198bd tempest-ProjectReaderTests-779709804 None] Lock "cinder-quobyte-450044ae-6689-4dd6-9093-747dc8b162ea" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:25:21 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-ed06a5d1-4280-4ab0-a31d-2622081198bd tempest-ProjectReaderTests-779709804 None] Deleting offline snapshot 450044ae-6689-4dd6-9093-747dc8b162ea of volume 9868f4f6-9dac-462e-9878-0ed6cbefe5bc {{(pid=86890) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:25:21 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-ed06a5d1-4280-4ab0-a31d-2622081198bd tempest-ProjectReaderTests-779709804 None] snapshot_file for this snap is: volume-9868f4f6-9dac-462e-9878-0ed6cbefe5bc.450044ae-6689-4dd6-9093-747dc8b162ea {{(pid=86890) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:25:21 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[afcac77d-dd99-4cdb-92c1-a5e439dd8f30]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:25:21 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ed06a5d1-4280-4ab0-a31d-2622081198bd tempest-ProjectReaderTests-779709804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-9868f4f6-9dac-462e-9878-0ed6cbefe5bc.450044ae-6689-4dd6-9093-747dc8b162ea {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:21 devstack sudo[106638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-9868f4f6-9dac-462e-9878-0ed6cbefe5bc.450044ae-6689-4dd6-9093-747dc8b162ea Nov 02 10:25:21 devstack sudo[106638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:22 devstack sudo[106638]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:22 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ed06a5d1-4280-4ab0-a31d-2622081198bd tempest-ProjectReaderTests-779709804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-9868f4f6-9dac-462e-9878-0ed6cbefe5bc.450044ae-6689-4dd6-9093-747dc8b162ea" returned: 0 in 0.370s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:22 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-ed06a5d1-4280-4ab0-a31d-2622081198bd tempest-ProjectReaderTests-779709804 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9868f4f6-9dac-462e-9878-0ed6cbefe5bc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86890) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:25:22 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[f310a4ef-93f9-4b02-9b10-8c9433ab4619]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:25:22 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ed06a5d1-4280-4ab0-a31d-2622081198bd tempest-ProjectReaderTests-779709804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-9868f4f6-9dac-462e-9878-0ed6cbefe5bc {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:22 devstack sudo[106643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-9868f4f6-9dac-462e-9878-0ed6cbefe5bc Nov 02 10:25:22 devstack sudo[106643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:22 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-e6e25fb6-ac53-4862-b92b-9a3349a08a86 tempest-ProjectMemberTests-406093346 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:25:22 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-e6e25fb6-ac53-4862-b92b-9a3349a08a86 tempest-ProjectMemberTests-406093346 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:25:22 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-e6e25fb6-ac53-4862-b92b-9a3349a08a86 tempest-ProjectMemberTests-406093346 None] Creating offline snapshot da4e1286-b42a-428f-8934-809d922b4199 of volume 94d15e72-8c33-4e2c-b9b3-9ef7584407bb {{(pid=86890) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:25:22 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[953fe66e-9390-480c-99a6-6b88aab12275]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:25:22 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-e6e25fb6-ac53-4862-b92b-9a3349a08a86 tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-94d15e72-8c33-4e2c-b9b3-9ef7584407bb {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:22 devstack sudo[106643]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:22 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ed06a5d1-4280-4ab0-a31d-2622081198bd tempest-ProjectReaderTests-779709804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-9868f4f6-9dac-462e-9878-0ed6cbefe5bc" returned: 0 in 0.400s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:22 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ed06a5d1-4280-4ab0-a31d-2622081198bd tempest-ProjectReaderTests-779709804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-9868f4f6-9dac-462e-9878-0ed6cbefe5bc.450044ae-6689-4dd6-9093-747dc8b162ea {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:22 devstack sudo[106645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-94d15e72-8c33-4e2c-b9b3-9ef7584407bb Nov 02 10:25:22 devstack sudo[106645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:22 devstack sudo[106650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-9868f4f6-9dac-462e-9878-0ed6cbefe5bc.450044ae-6689-4dd6-9093-747dc8b162ea Nov 02 10:25:22 devstack sudo[106650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:22 devstack sudo[106645]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:22 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-e6e25fb6-ac53-4862-b92b-9a3349a08a86 tempest-ProjectMemberTests-406093346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-94d15e72-8c33-4e2c-b9b3-9ef7584407bb" returned: 0 in 0.396s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:22 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-e6e25fb6-ac53-4862-b92b-9a3349a08a86 tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-94d15e72-8c33-4e2c-b9b3-9ef7584407bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-94d15e72-8c33-4e2c-b9b3-9ef7584407bb.da4e1286-b42a-428f-8934-809d922b4199 1G {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:22 devstack sudo[106658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-94d15e72-8c33-4e2c-b9b3-9ef7584407bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-94d15e72-8c33-4e2c-b9b3-9ef7584407bb.da4e1286-b42a-428f-8934-809d922b4199 1G Nov 02 10:25:22 devstack sudo[106658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:22 devstack sudo[106650]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:22 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ed06a5d1-4280-4ab0-a31d-2622081198bd tempest-ProjectReaderTests-779709804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-9868f4f6-9dac-462e-9878-0ed6cbefe5bc.450044ae-6689-4dd6-9093-747dc8b162ea" returned: 0 in 0.366s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:22 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ed06a5d1-4280-4ab0-a31d-2622081198bd tempest-ProjectReaderTests-779709804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-9868f4f6-9dac-462e-9878-0ed6cbefe5bc.450044ae-6689-4dd6-9093-747dc8b162ea {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:23 devstack sudo[106660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-9868f4f6-9dac-462e-9878-0ed6cbefe5bc.450044ae-6689-4dd6-9093-747dc8b162ea Nov 02 10:25:23 devstack sudo[106660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:23 devstack sudo[106660]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:23 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ed06a5d1-4280-4ab0-a31d-2622081198bd tempest-ProjectReaderTests-779709804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-9868f4f6-9dac-462e-9878-0ed6cbefe5bc.450044ae-6689-4dd6-9093-747dc8b162ea" returned: 0 in 0.263s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:23 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-ed06a5d1-4280-4ab0-a31d-2622081198bd tempest-ProjectReaderTests-779709804 None] Lock "cinder-quobyte-450044ae-6689-4dd6-9093-747dc8b162ea" released by "_delete_snapshot" :: held 1.510s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:25:23 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-ed06a5d1-4280-4ab0-a31d-2622081198bd tempest-ProjectReaderTests-779709804 None] Lock "cinder-quobyte-9868f4f6-9dac-462e-9878-0ed6cbefe5bc" released by "delete_snapshot" :: held 1.538s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:25:23 devstack sudo[106658]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:23 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-e6e25fb6-ac53-4862-b92b-9a3349a08a86 tempest-ProjectMemberTests-406093346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-94d15e72-8c33-4e2c-b9b3-9ef7584407bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-94d15e72-8c33-4e2c-b9b3-9ef7584407bb.da4e1286-b42a-428f-8934-809d922b4199 1G" returned: 0 in 0.439s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:23 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-e6e25fb6-ac53-4862-b92b-9a3349a08a86 tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94d15e72-8c33-4e2c-b9b3-9ef7584407bb -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-94d15e72-8c33-4e2c-b9b3-9ef7584407bb.da4e1286-b42a-428f-8934-809d922b4199 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:23 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-ed06a5d1-4280-4ab0-a31d-2622081198bd tempest-ProjectReaderTests-779709804 None] Created reservations ['6e524e02-a506-4980-b18d-38826c859ebe', '210218e6-9cc3-4d59-8b75-b45be62a172c', 'd8fd79b7-0f84-4ab5-81f1-c0696501c86f', '5bb6fb95-6515-4cf8-a41b-b7100a607254'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:25:23 devstack sudo[106666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94d15e72-8c33-4e2c-b9b3-9ef7584407bb -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-94d15e72-8c33-4e2c-b9b3-9ef7584407bb.da4e1286-b42a-428f-8934-809d922b4199 Nov 02 10:25:23 devstack sudo[106666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:23 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-ed06a5d1-4280-4ab0-a31d-2622081198bd tempest-ProjectReaderTests-779709804 None] Delete snapshot completed successfully. Nov 02 10:25:23 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-ed06a5d1-4280-4ab0-a31d-2622081198bd tempest-ProjectReaderTests-779709804 None] Lock "cinder-450044ae-6689-4dd6-9093-747dc8b162ea-delete_snapshot" released by "delete_snapshot" :: held 1.707s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:25:23 devstack sudo[106666]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:23 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-e6e25fb6-ac53-4862-b92b-9a3349a08a86 tempest-ProjectMemberTests-406093346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94d15e72-8c33-4e2c-b9b3-9ef7584407bb -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-94d15e72-8c33-4e2c-b9b3-9ef7584407bb.da4e1286-b42a-428f-8934-809d922b4199" returned: 0 in 0.292s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:23 devstack cinder-volume[86890]: WARNING cinder.volume.drivers.remotefs [None req-e6e25fb6-ac53-4862-b92b-9a3349a08a86 tempest-ProjectMemberTests-406093346 None] /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-94d15e72-8c33-4e2c-b9b3-9ef7584407bb.da4e1286-b42a-428f-8934-809d922b4199 is being set with open permissions: ugo+rw Nov 02 10:25:23 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-e6e25fb6-ac53-4862-b92b-9a3349a08a86 tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-94d15e72-8c33-4e2c-b9b3-9ef7584407bb.da4e1286-b42a-428f-8934-809d922b4199 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:23 devstack sudo[106671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-94d15e72-8c33-4e2c-b9b3-9ef7584407bb.da4e1286-b42a-428f-8934-809d922b4199 Nov 02 10:25:23 devstack sudo[106671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:23 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-48615fac-3837-4aa2-ab8f-73544fde071b tempest-ProjectReaderTests-779709804 None] Acquiring lock "cinder-9868f4f6-9dac-462e-9878-0ed6cbefe5bc-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:25:23 devstack sudo[106671]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:23 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-e6e25fb6-ac53-4862-b92b-9a3349a08a86 tempest-ProjectMemberTests-406093346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-94d15e72-8c33-4e2c-b9b3-9ef7584407bb.da4e1286-b42a-428f-8934-809d922b4199" returned: 0 in 0.276s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:23 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-48615fac-3837-4aa2-ab8f-73544fde071b tempest-ProjectReaderTests-779709804 None] Lock "cinder-9868f4f6-9dac-462e-9878-0ed6cbefe5bc-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:25:23 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-e6e25fb6-ac53-4862-b92b-9a3349a08a86 tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-94d15e72-8c33-4e2c-b9b3-9ef7584407bb.info {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:23 devstack sudo[106674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-94d15e72-8c33-4e2c-b9b3-9ef7584407bb.info Nov 02 10:25:23 devstack sudo[106674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:23 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-48615fac-3837-4aa2-ab8f-73544fde071b tempest-ProjectReaderTests-779709804 None] Acquiring lock "cinder-quobyte-9868f4f6-9dac-462e-9878-0ed6cbefe5bc" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:25:24 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-48615fac-3837-4aa2-ab8f-73544fde071b tempest-ProjectReaderTests-779709804 None] Lock "cinder-quobyte-9868f4f6-9dac-462e-9878-0ed6cbefe5bc" acquired by "delete_volume" :: waited 0.025s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:25:24 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[173d8a25-1255-4e96-9fbf-36ef545c97e8]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:25:24 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-48615fac-3837-4aa2-ab8f-73544fde071b tempest-ProjectReaderTests-779709804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-9868f4f6-9dac-462e-9878-0ed6cbefe5bc {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:24 devstack sudo[106677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-9868f4f6-9dac-462e-9878-0ed6cbefe5bc Nov 02 10:25:24 devstack sudo[106677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:24 devstack sudo[106674]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:24 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-e6e25fb6-ac53-4862-b92b-9a3349a08a86 tempest-ProjectMemberTests-406093346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-94d15e72-8c33-4e2c-b9b3-9ef7584407bb.info" returned: 0 in 0.302s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:24 devstack cinder-volume[86890]: WARNING cinder.volume.drivers.remotefs [None req-e6e25fb6-ac53-4862-b92b-9a3349a08a86 tempest-ProjectMemberTests-406093346 None] /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-94d15e72-8c33-4e2c-b9b3-9ef7584407bb.info is being set with open permissions: ugo+rw Nov 02 10:25:24 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-e6e25fb6-ac53-4862-b92b-9a3349a08a86 tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-94d15e72-8c33-4e2c-b9b3-9ef7584407bb.info {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:24 devstack sudo[106680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-94d15e72-8c33-4e2c-b9b3-9ef7584407bb.info Nov 02 10:25:24 devstack sudo[106680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:24 devstack sudo[106677]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:24 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-48615fac-3837-4aa2-ab8f-73544fde071b tempest-ProjectReaderTests-779709804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-9868f4f6-9dac-462e-9878-0ed6cbefe5bc" returned: 0 in 0.404s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:24 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-48615fac-3837-4aa2-ab8f-73544fde071b tempest-ProjectReaderTests-779709804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-9868f4f6-9dac-462e-9878-0ed6cbefe5bc {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:24 devstack sudo[106686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-9868f4f6-9dac-462e-9878-0ed6cbefe5bc Nov 02 10:25:24 devstack sudo[106686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:24 devstack sudo[106680]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:24 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-e6e25fb6-ac53-4862-b92b-9a3349a08a86 tempest-ProjectMemberTests-406093346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-94d15e72-8c33-4e2c-b9b3-9ef7584407bb.info" returned: 0 in 0.269s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:24 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-e6e25fb6-ac53-4862-b92b-9a3349a08a86 tempest-ProjectMemberTests-406093346 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.076s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:25:24 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-e6e25fb6-ac53-4862-b92b-9a3349a08a86 tempest-ProjectMemberTests-406093346 None] Create snapshot completed successfully Nov 02 10:25:24 devstack sudo[106686]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:24 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-48615fac-3837-4aa2-ab8f-73544fde071b tempest-ProjectReaderTests-779709804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-9868f4f6-9dac-462e-9878-0ed6cbefe5bc" returned: 0 in 0.282s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:24 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-48615fac-3837-4aa2-ab8f-73544fde071b tempest-ProjectReaderTests-779709804 None] Lock "cinder-quobyte-9868f4f6-9dac-462e-9878-0ed6cbefe5bc" released by "delete_volume" :: held 0.750s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:25:24 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-48615fac-3837-4aa2-ab8f-73544fde071b tempest-ProjectReaderTests-779709804 None] Created reservations ['d010dbff-218d-4747-9489-1b9ef1cfb7ca', 'ad763f3e-bab9-4918-a5aa-02ef7c657bcb', '5c181686-4b2c-4312-821f-a3359a62d10d', '4bd7f6f0-91db-4f56-90a7-c9a61fafe07b'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:25:24 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-48615fac-3837-4aa2-ab8f-73544fde071b tempest-ProjectReaderTests-779709804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:25:24 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-48615fac-3837-4aa2-ab8f-73544fde071b tempest-ProjectReaderTests-779709804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:25:24 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-48615fac-3837-4aa2-ab8f-73544fde071b tempest-ProjectReaderTests-779709804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:25:24 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-48615fac-3837-4aa2-ab8f-73544fde071b tempest-ProjectReaderTests-779709804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:25:24 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-48615fac-3837-4aa2-ab8f-73544fde071b tempest-ProjectReaderTests-779709804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:25:24 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-48615fac-3837-4aa2-ab8f-73544fde071b tempest-ProjectReaderTests-779709804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:24 devstack sudo[106689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:25:24 devstack sudo[106689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:25 devstack sudo[106689]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:25 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-48615fac-3837-4aa2-ab8f-73544fde071b tempest-ProjectReaderTests-779709804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.291s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:25 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-48615fac-3837-4aa2-ab8f-73544fde071b tempest-ProjectReaderTests-779709804 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:25:25 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-48615fac-3837-4aa2-ab8f-73544fde071b tempest-ProjectReaderTests-779709804 None] Deleted volume successfully. Nov 02 10:25:25 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-48615fac-3837-4aa2-ab8f-73544fde071b tempest-ProjectReaderTests-779709804 None] Lock "cinder-9868f4f6-9dac-462e-9878-0ed6cbefe5bc-delete_volume" released by "delete_volume" :: held 1.301s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:25:25 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-3c468dee-ef41-4658-983d-55a4c69d1af8 tempest-ProjectMemberTests-406093346 None] Acquiring lock "cinder-da4e1286-b42a-428f-8934-809d922b4199-delete_snapshot" by "delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:25:25 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-3c468dee-ef41-4658-983d-55a4c69d1af8 tempest-ProjectMemberTests-406093346 None] Lock "cinder-da4e1286-b42a-428f-8934-809d922b4199-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:25:25 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-3c468dee-ef41-4658-983d-55a4c69d1af8 tempest-ProjectMemberTests-406093346 None] Acquiring lock "cinder-quobyte-94d15e72-8c33-4e2c-b9b3-9ef7584407bb" by "delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:25:25 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-3c468dee-ef41-4658-983d-55a4c69d1af8 tempest-ProjectMemberTests-406093346 None] Lock "cinder-quobyte-94d15e72-8c33-4e2c-b9b3-9ef7584407bb" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:25:25 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-3c468dee-ef41-4658-983d-55a4c69d1af8 tempest-ProjectMemberTests-406093346 None] Acquiring lock "cinder-quobyte-da4e1286-b42a-428f-8934-809d922b4199" by "_delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:25:25 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-3c468dee-ef41-4658-983d-55a4c69d1af8 tempest-ProjectMemberTests-406093346 None] Lock "cinder-quobyte-da4e1286-b42a-428f-8934-809d922b4199" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:25:25 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-3c468dee-ef41-4658-983d-55a4c69d1af8 tempest-ProjectMemberTests-406093346 None] Deleting offline snapshot da4e1286-b42a-428f-8934-809d922b4199 of volume 94d15e72-8c33-4e2c-b9b3-9ef7584407bb {{(pid=86890) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:25:25 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-3c468dee-ef41-4658-983d-55a4c69d1af8 tempest-ProjectMemberTests-406093346 None] snapshot_file for this snap is: volume-94d15e72-8c33-4e2c-b9b3-9ef7584407bb.da4e1286-b42a-428f-8934-809d922b4199 {{(pid=86890) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:25:25 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[96b2a41d-2c82-418f-ba22-128355471a83]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:25:25 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-3c468dee-ef41-4658-983d-55a4c69d1af8 tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-94d15e72-8c33-4e2c-b9b3-9ef7584407bb.da4e1286-b42a-428f-8934-809d922b4199 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:25 devstack sudo[106692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-94d15e72-8c33-4e2c-b9b3-9ef7584407bb.da4e1286-b42a-428f-8934-809d922b4199 Nov 02 10:25:25 devstack sudo[106692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:26 devstack sudo[106692]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:26 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-3c468dee-ef41-4658-983d-55a4c69d1af8 tempest-ProjectMemberTests-406093346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-94d15e72-8c33-4e2c-b9b3-9ef7584407bb.da4e1286-b42a-428f-8934-809d922b4199" returned: 0 in 0.438s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:26 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-3c468dee-ef41-4658-983d-55a4c69d1af8 tempest-ProjectMemberTests-406093346 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-94d15e72-8c33-4e2c-b9b3-9ef7584407bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86890) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:25:26 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a7cc89a-b3d2-436b-b04b-771372147b67]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:25:26 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-3c468dee-ef41-4658-983d-55a4c69d1af8 tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-94d15e72-8c33-4e2c-b9b3-9ef7584407bb {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:26 devstack sudo[106697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-94d15e72-8c33-4e2c-b9b3-9ef7584407bb Nov 02 10:25:26 devstack sudo[106697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:26 devstack sudo[106697]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:26 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-3c468dee-ef41-4658-983d-55a4c69d1af8 tempest-ProjectMemberTests-406093346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-94d15e72-8c33-4e2c-b9b3-9ef7584407bb" returned: 0 in 0.461s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:26 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-3c468dee-ef41-4658-983d-55a4c69d1af8 tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-94d15e72-8c33-4e2c-b9b3-9ef7584407bb.da4e1286-b42a-428f-8934-809d922b4199 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:26 devstack sudo[106703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-94d15e72-8c33-4e2c-b9b3-9ef7584407bb.da4e1286-b42a-428f-8934-809d922b4199 Nov 02 10:25:26 devstack sudo[106703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:27 devstack sudo[106703]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:27 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-3c468dee-ef41-4658-983d-55a4c69d1af8 tempest-ProjectMemberTests-406093346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-94d15e72-8c33-4e2c-b9b3-9ef7584407bb.da4e1286-b42a-428f-8934-809d922b4199" returned: 0 in 0.398s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:27 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-3c468dee-ef41-4658-983d-55a4c69d1af8 tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-94d15e72-8c33-4e2c-b9b3-9ef7584407bb.da4e1286-b42a-428f-8934-809d922b4199 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:27 devstack sudo[106708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-94d15e72-8c33-4e2c-b9b3-9ef7584407bb.da4e1286-b42a-428f-8934-809d922b4199 Nov 02 10:25:27 devstack sudo[106708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:27 devstack sudo[106708]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:27 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-3c468dee-ef41-4658-983d-55a4c69d1af8 tempest-ProjectMemberTests-406093346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-94d15e72-8c33-4e2c-b9b3-9ef7584407bb.da4e1286-b42a-428f-8934-809d922b4199" returned: 0 in 0.279s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:27 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-3c468dee-ef41-4658-983d-55a4c69d1af8 tempest-ProjectMemberTests-406093346 None] Lock "cinder-quobyte-da4e1286-b42a-428f-8934-809d922b4199" released by "_delete_snapshot" :: held 1.693s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:25:27 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-3c468dee-ef41-4658-983d-55a4c69d1af8 tempest-ProjectMemberTests-406093346 None] Lock "cinder-quobyte-94d15e72-8c33-4e2c-b9b3-9ef7584407bb" released by "delete_snapshot" :: held 1.717s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:25:27 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-3c468dee-ef41-4658-983d-55a4c69d1af8 tempest-ProjectMemberTests-406093346 None] Created reservations ['66ceb3e9-5cc3-466c-b2c4-e9f7d8acda98', '80bd9cee-5fad-4131-b2d0-8873faeb473c', 'c6ba718e-3adf-49f9-b9d0-1c2b5d1c80c4', '3dbbe871-dd00-47e5-b002-008bdb920305'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:25:27 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-3c468dee-ef41-4658-983d-55a4c69d1af8 tempest-ProjectMemberTests-406093346 None] Delete snapshot completed successfully. Nov 02 10:25:27 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-3c468dee-ef41-4658-983d-55a4c69d1af8 tempest-ProjectMemberTests-406093346 None] Lock "cinder-da4e1286-b42a-428f-8934-809d922b4199-delete_snapshot" released by "delete_snapshot" :: held 1.865s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:25:27 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-ab2d7904-c780-46d3-b61c-c6d8f7120bf8 tempest-ProjectMemberTests-406093346 None] Acquiring lock "cinder-94d15e72-8c33-4e2c-b9b3-9ef7584407bb-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:25:27 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-ab2d7904-c780-46d3-b61c-c6d8f7120bf8 tempest-ProjectMemberTests-406093346 None] Lock "cinder-94d15e72-8c33-4e2c-b9b3-9ef7584407bb-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:25:27 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-ab2d7904-c780-46d3-b61c-c6d8f7120bf8 tempest-ProjectMemberTests-406093346 None] Acquiring lock "cinder-quobyte-94d15e72-8c33-4e2c-b9b3-9ef7584407bb" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:25:27 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-ab2d7904-c780-46d3-b61c-c6d8f7120bf8 tempest-ProjectMemberTests-406093346 None] Lock "cinder-quobyte-94d15e72-8c33-4e2c-b9b3-9ef7584407bb" acquired by "delete_volume" :: waited 0.014s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:25:27 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[50591cce-d683-4374-95a5-fe6b344ff426]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:25:27 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ab2d7904-c780-46d3-b61c-c6d8f7120bf8 tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-94d15e72-8c33-4e2c-b9b3-9ef7584407bb {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:28 devstack sudo[106711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-94d15e72-8c33-4e2c-b9b3-9ef7584407bb Nov 02 10:25:28 devstack sudo[106711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:28 devstack sudo[106711]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:28 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ab2d7904-c780-46d3-b61c-c6d8f7120bf8 tempest-ProjectMemberTests-406093346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-94d15e72-8c33-4e2c-b9b3-9ef7584407bb" returned: 0 in 0.377s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:28 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ab2d7904-c780-46d3-b61c-c6d8f7120bf8 tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-94d15e72-8c33-4e2c-b9b3-9ef7584407bb {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:28 devstack sudo[106716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-94d15e72-8c33-4e2c-b9b3-9ef7584407bb Nov 02 10:25:28 devstack sudo[106716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:28 devstack sudo[106716]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:28 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ab2d7904-c780-46d3-b61c-c6d8f7120bf8 tempest-ProjectMemberTests-406093346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-94d15e72-8c33-4e2c-b9b3-9ef7584407bb" returned: 0 in 0.283s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:28 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-ab2d7904-c780-46d3-b61c-c6d8f7120bf8 tempest-ProjectMemberTests-406093346 None] Lock "cinder-quobyte-94d15e72-8c33-4e2c-b9b3-9ef7584407bb" released by "delete_volume" :: held 0.736s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:25:28 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-ab2d7904-c780-46d3-b61c-c6d8f7120bf8 tempest-ProjectMemberTests-406093346 None] Created reservations ['83e25b43-0cb9-4247-8db2-e8086f86459c', 'e8bc63f4-43ed-41f0-bf5c-c03053ab0951', '3673d1f4-5374-4956-8b6f-913a48e54f3e', '5c5c2fcc-f8d8-4aa2-b20d-cb7db9bbe425'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:25:28 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-ab2d7904-c780-46d3-b61c-c6d8f7120bf8 tempest-ProjectMemberTests-406093346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:25:28 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-ab2d7904-c780-46d3-b61c-c6d8f7120bf8 tempest-ProjectMemberTests-406093346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:25:28 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-ab2d7904-c780-46d3-b61c-c6d8f7120bf8 tempest-ProjectMemberTests-406093346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:25:28 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-ab2d7904-c780-46d3-b61c-c6d8f7120bf8 tempest-ProjectMemberTests-406093346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:25:28 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-ab2d7904-c780-46d3-b61c-c6d8f7120bf8 tempest-ProjectMemberTests-406093346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:25:28 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ab2d7904-c780-46d3-b61c-c6d8f7120bf8 tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:28 devstack sudo[106719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:25:28 devstack sudo[106719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:29 devstack sudo[106719]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:29 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-ab2d7904-c780-46d3-b61c-c6d8f7120bf8 tempest-ProjectMemberTests-406093346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.291s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:29 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-ab2d7904-c780-46d3-b61c-c6d8f7120bf8 tempest-ProjectMemberTests-406093346 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:25:29 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-ab2d7904-c780-46d3-b61c-c6d8f7120bf8 tempest-ProjectMemberTests-406093346 None] Deleted volume successfully. Nov 02 10:25:29 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-ab2d7904-c780-46d3-b61c-c6d8f7120bf8 tempest-ProjectMemberTests-406093346 None] Lock "cinder-94d15e72-8c33-4e2c-b9b3-9ef7584407bb-delete_volume" released by "delete_volume" :: held 1.233s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:25:29 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e07cd20-fa57-4b32-8f50-f1def0554ef7 tempest-ProjectMemberTests-406093346 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:25:29 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-6e07cd20-fa57-4b32-8f50-f1def0554ef7 tempest-ProjectMemberTests-406093346 None] Flow 'volume_create_manager' (c755edcc-ed1e-41e4-ade5-12a66b6841e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:25:29 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-6e07cd20-fa57-4b32-8f50-f1def0554ef7 tempest-ProjectMemberTests-406093346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecfc77fb-f496-4f00-a507-5301dd1e9809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:25:29 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-6e07cd20-fa57-4b32-8f50-f1def0554ef7 tempest-ProjectMemberTests-406093346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecfc77fb-f496-4f00-a507-5301dd1e9809) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:25:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1259017810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f41ae5f3-62a5-4680-81bb-577c8664fe24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='639ad964aa1b416eb473afb3c18dd4e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:25:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:25:29Z,use_quota=True,user_id='076db3d85c064198aa1722b31937515d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:25:29 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-6e07cd20-fa57-4b32-8f50-f1def0554ef7 tempest-ProjectMemberTests-406093346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdb0065e-404c-4c01-b536-ff97abe696a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:25:29 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-6e07cd20-fa57-4b32-8f50-f1def0554ef7 tempest-ProjectMemberTests-406093346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdb0065e-404c-4c01-b536-ff97abe696a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:25:29 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-6e07cd20-fa57-4b32-8f50-f1def0554ef7 tempest-ProjectMemberTests-406093346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd3c1789-655d-43b3-98dd-dedfedcff00c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:25:29 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-6e07cd20-fa57-4b32-8f50-f1def0554ef7 tempest-ProjectMemberTests-406093346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd3c1789-655d-43b3-98dd-dedfedcff00c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f41ae5f3-62a5-4680-81bb-577c8664fe24', 'volume_name': 'volume-f41ae5f3-62a5-4680-81bb-577c8664fe24', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:25:29 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-6e07cd20-fa57-4b32-8f50-f1def0554ef7 tempest-ProjectMemberTests-406093346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcdc876a-9d6e-4bb3-849d-2825e4c29ec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:25:29 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-6e07cd20-fa57-4b32-8f50-f1def0554ef7 tempest-ProjectMemberTests-406093346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcdc876a-9d6e-4bb3-849d-2825e4c29ec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:25:29 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-6e07cd20-fa57-4b32-8f50-f1def0554ef7 tempest-ProjectMemberTests-406093346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af367e5b-05e2-4386-877c-30d6b001207f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:25:29 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-6e07cd20-fa57-4b32-8f50-f1def0554ef7 tempest-ProjectMemberTests-406093346 None] Volume f41ae5f3-62a5-4680-81bb-577c8664fe24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f41ae5f3-62a5-4680-81bb-577c8664fe24', 'volume_size': 1} Nov 02 10:25:29 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-6e07cd20-fa57-4b32-8f50-f1def0554ef7 tempest-ProjectMemberTests-406093346 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:25:29 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-6e07cd20-fa57-4b32-8f50-f1def0554ef7 tempest-ProjectMemberTests-406093346 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:25:29 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-6e07cd20-fa57-4b32-8f50-f1def0554ef7 tempest-ProjectMemberTests-406093346 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:25:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1259017810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f41ae5f3-62a5-4680-81bb-577c8664fe24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='639ad964aa1b416eb473afb3c18dd4e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:25:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:25:29Z,use_quota=True,user_id='076db3d85c064198aa1722b31937515d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:25:29 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-6e07cd20-fa57-4b32-8f50-f1def0554ef7 tempest-ProjectMemberTests-406093346 None] Creating volume f41ae5f3-62a5-4680-81bb-577c8664fe24 {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:25:29 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-6e07cd20-fa57-4b32-8f50-f1def0554ef7 tempest-ProjectMemberTests-406093346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:25:29 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-6e07cd20-fa57-4b32-8f50-f1def0554ef7 tempest-ProjectMemberTests-406093346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:25:29 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-6e07cd20-fa57-4b32-8f50-f1def0554ef7 tempest-ProjectMemberTests-406093346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:25:29 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-6e07cd20-fa57-4b32-8f50-f1def0554ef7 tempest-ProjectMemberTests-406093346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:25:29 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-6e07cd20-fa57-4b32-8f50-f1def0554ef7 tempest-ProjectMemberTests-406093346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:25:29 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-6e07cd20-fa57-4b32-8f50-f1def0554ef7 tempest-ProjectMemberTests-406093346 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:25:29 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-6e07cd20-fa57-4b32-8f50-f1def0554ef7 tempest-ProjectMemberTests-406093346 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:25:29 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6e07cd20-fa57-4b32-8f50-f1def0554ef7 tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-f41ae5f3-62a5-4680-81bb-577c8664fe24 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:29 devstack sudo[106722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-f41ae5f3-62a5-4680-81bb-577c8664fe24 1073741824 Nov 02 10:25:29 devstack sudo[106722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:30 devstack sudo[106722]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:30 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6e07cd20-fa57-4b32-8f50-f1def0554ef7 tempest-ProjectMemberTests-406093346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-f41ae5f3-62a5-4680-81bb-577c8664fe24 1073741824" returned: 0 in 0.456s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:30 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6e07cd20-fa57-4b32-8f50-f1def0554ef7 tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-f41ae5f3-62a5-4680-81bb-577c8664fe24 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:30 devstack sudo[106727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-f41ae5f3-62a5-4680-81bb-577c8664fe24 Nov 02 10:25:30 devstack sudo[106727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:30 devstack sudo[106727]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:30 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-6e07cd20-fa57-4b32-8f50-f1def0554ef7 tempest-ProjectMemberTests-406093346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-f41ae5f3-62a5-4680-81bb-577c8664fe24" returned: 0 in 0.253s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:30 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-6e07cd20-fa57-4b32-8f50-f1def0554ef7 tempest-ProjectMemberTests-406093346 None] <== create_volume: return (754ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:25:30 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-6e07cd20-fa57-4b32-8f50-f1def0554ef7 tempest-ProjectMemberTests-406093346 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.756s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:25:30 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-6e07cd20-fa57-4b32-8f50-f1def0554ef7 tempest-ProjectMemberTests-406093346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af367e5b-05e2-4386-877c-30d6b001207f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f41ae5f3-62a5-4680-81bb-577c8664fe24', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:25:30 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-6e07cd20-fa57-4b32-8f50-f1def0554ef7 tempest-ProjectMemberTests-406093346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fef9bee0-ef90-4b82-9196-7e0e18c2c6a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:25:30 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-6e07cd20-fa57-4b32-8f50-f1def0554ef7 tempest-ProjectMemberTests-406093346 None] Volume volume-f41ae5f3-62a5-4680-81bb-577c8664fe24 (f41ae5f3-62a5-4680-81bb-577c8664fe24): created successfully Nov 02 10:25:30 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-6e07cd20-fa57-4b32-8f50-f1def0554ef7 tempest-ProjectMemberTests-406093346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fef9bee0-ef90-4b82-9196-7e0e18c2c6a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:25:30 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-6e07cd20-fa57-4b32-8f50-f1def0554ef7 tempest-ProjectMemberTests-406093346 None] Flow 'volume_create_manager' (c755edcc-ed1e-41e4-ade5-12a66b6841e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:25:30 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-6e07cd20-fa57-4b32-8f50-f1def0554ef7 tempest-ProjectMemberTests-406093346 None] Created volume successfully. Nov 02 10:25:30 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-90495479-695c-4b0d-9b1e-4e25ea7825ee tempest-ProjectMemberTests-406093346 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:25:30 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-90495479-695c-4b0d-9b1e-4e25ea7825ee tempest-ProjectMemberTests-406093346 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:25:30 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-90495479-695c-4b0d-9b1e-4e25ea7825ee tempest-ProjectMemberTests-406093346 None] Creating offline snapshot 7badcb32-7835-4119-980b-bc799d1e5ae6 of volume f41ae5f3-62a5-4680-81bb-577c8664fe24 {{(pid=86890) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:25:30 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[f86d6038-9d47-4e63-af8d-6dd414578b41]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:25:30 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-90495479-695c-4b0d-9b1e-4e25ea7825ee tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-f41ae5f3-62a5-4680-81bb-577c8664fe24 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:30 devstack sudo[106730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-f41ae5f3-62a5-4680-81bb-577c8664fe24 Nov 02 10:25:30 devstack sudo[106730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:31 devstack sudo[106730]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:31 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-90495479-695c-4b0d-9b1e-4e25ea7825ee tempest-ProjectMemberTests-406093346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-f41ae5f3-62a5-4680-81bb-577c8664fe24" returned: 0 in 0.367s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:31 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-90495479-695c-4b0d-9b1e-4e25ea7825ee tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-f41ae5f3-62a5-4680-81bb-577c8664fe24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-f41ae5f3-62a5-4680-81bb-577c8664fe24.7badcb32-7835-4119-980b-bc799d1e5ae6 1G {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:31 devstack sudo[106735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-f41ae5f3-62a5-4680-81bb-577c8664fe24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-f41ae5f3-62a5-4680-81bb-577c8664fe24.7badcb32-7835-4119-980b-bc799d1e5ae6 1G Nov 02 10:25:31 devstack sudo[106735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:31 devstack sudo[106735]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:31 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-90495479-695c-4b0d-9b1e-4e25ea7825ee tempest-ProjectMemberTests-406093346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-f41ae5f3-62a5-4680-81bb-577c8664fe24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-f41ae5f3-62a5-4680-81bb-577c8664fe24.7badcb32-7835-4119-980b-bc799d1e5ae6 1G" returned: 0 in 0.421s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:31 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-90495479-695c-4b0d-9b1e-4e25ea7825ee tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f41ae5f3-62a5-4680-81bb-577c8664fe24 -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-f41ae5f3-62a5-4680-81bb-577c8664fe24.7badcb32-7835-4119-980b-bc799d1e5ae6 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:31 devstack sudo[106740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f41ae5f3-62a5-4680-81bb-577c8664fe24 -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-f41ae5f3-62a5-4680-81bb-577c8664fe24.7badcb32-7835-4119-980b-bc799d1e5ae6 Nov 02 10:25:31 devstack sudo[106740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:31 devstack sudo[106740]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:31 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-90495479-695c-4b0d-9b1e-4e25ea7825ee tempest-ProjectMemberTests-406093346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f41ae5f3-62a5-4680-81bb-577c8664fe24 -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-f41ae5f3-62a5-4680-81bb-577c8664fe24.7badcb32-7835-4119-980b-bc799d1e5ae6" returned: 0 in 0.307s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:31 devstack cinder-volume[86890]: WARNING cinder.volume.drivers.remotefs [None req-90495479-695c-4b0d-9b1e-4e25ea7825ee tempest-ProjectMemberTests-406093346 None] /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-f41ae5f3-62a5-4680-81bb-577c8664fe24.7badcb32-7835-4119-980b-bc799d1e5ae6 is being set with open permissions: ugo+rw Nov 02 10:25:31 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-90495479-695c-4b0d-9b1e-4e25ea7825ee tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-f41ae5f3-62a5-4680-81bb-577c8664fe24.7badcb32-7835-4119-980b-bc799d1e5ae6 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:31 devstack sudo[106745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-f41ae5f3-62a5-4680-81bb-577c8664fe24.7badcb32-7835-4119-980b-bc799d1e5ae6 Nov 02 10:25:31 devstack sudo[106745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:32 devstack sudo[106745]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:32 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-90495479-695c-4b0d-9b1e-4e25ea7825ee tempest-ProjectMemberTests-406093346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-f41ae5f3-62a5-4680-81bb-577c8664fe24.7badcb32-7835-4119-980b-bc799d1e5ae6" returned: 0 in 0.246s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:32 devstack cinder-volume[86890]: DEBUG dbcounter [-] [86890] Writing DB stats cinder:SELECT=205,cinder:INSERT=66,cinder:UPDATE=259,cinder:DELETE=22 {{(pid=86890) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:25:32 devstack cinder-volume[86890]: DEBUG dbcounter [-] [86890] Writing DB stats cinder:SELECT=202,cinder:INSERT=77,cinder:UPDATE=277,cinder:DELETE=22 {{(pid=86890) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:25:32 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-90495479-695c-4b0d-9b1e-4e25ea7825ee tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-f41ae5f3-62a5-4680-81bb-577c8664fe24.info {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:32 devstack sudo[106748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-f41ae5f3-62a5-4680-81bb-577c8664fe24.info Nov 02 10:25:32 devstack sudo[106748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:32 devstack sudo[106748]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:32 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-90495479-695c-4b0d-9b1e-4e25ea7825ee tempest-ProjectMemberTests-406093346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-f41ae5f3-62a5-4680-81bb-577c8664fe24.info" returned: 0 in 0.273s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:32 devstack cinder-volume[86890]: WARNING cinder.volume.drivers.remotefs [None req-90495479-695c-4b0d-9b1e-4e25ea7825ee tempest-ProjectMemberTests-406093346 None] /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-f41ae5f3-62a5-4680-81bb-577c8664fe24.info is being set with open permissions: ugo+rw Nov 02 10:25:32 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-90495479-695c-4b0d-9b1e-4e25ea7825ee tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-f41ae5f3-62a5-4680-81bb-577c8664fe24.info {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:32 devstack sudo[106751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-f41ae5f3-62a5-4680-81bb-577c8664fe24.info Nov 02 10:25:32 devstack sudo[106751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:32 devstack sudo[106751]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:32 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-90495479-695c-4b0d-9b1e-4e25ea7825ee tempest-ProjectMemberTests-406093346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-f41ae5f3-62a5-4680-81bb-577c8664fe24.info" returned: 0 in 0.240s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:32 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-90495479-695c-4b0d-9b1e-4e25ea7825ee tempest-ProjectMemberTests-406093346 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.948s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:25:32 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-90495479-695c-4b0d-9b1e-4e25ea7825ee tempest-ProjectMemberTests-406093346 None] Create snapshot completed successfully Nov 02 10:25:32 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-d6a52223-5045-4844-b55a-d502885cb1b1 tempest-ProjectMemberTests-406093346 None] Acquiring lock "cinder-7badcb32-7835-4119-980b-bc799d1e5ae6-delete_snapshot" by "delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:25:32 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-d6a52223-5045-4844-b55a-d502885cb1b1 tempest-ProjectMemberTests-406093346 None] Lock "cinder-7badcb32-7835-4119-980b-bc799d1e5ae6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:25:32 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-d6a52223-5045-4844-b55a-d502885cb1b1 tempest-ProjectMemberTests-406093346 None] Acquiring lock "cinder-quobyte-f41ae5f3-62a5-4680-81bb-577c8664fe24" by "delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:25:32 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-d6a52223-5045-4844-b55a-d502885cb1b1 tempest-ProjectMemberTests-406093346 None] Lock "cinder-quobyte-f41ae5f3-62a5-4680-81bb-577c8664fe24" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:25:32 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-d6a52223-5045-4844-b55a-d502885cb1b1 tempest-ProjectMemberTests-406093346 None] Acquiring lock "cinder-quobyte-7badcb32-7835-4119-980b-bc799d1e5ae6" by "_delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:25:32 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-d6a52223-5045-4844-b55a-d502885cb1b1 tempest-ProjectMemberTests-406093346 None] Lock "cinder-quobyte-7badcb32-7835-4119-980b-bc799d1e5ae6" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:25:32 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-d6a52223-5045-4844-b55a-d502885cb1b1 tempest-ProjectMemberTests-406093346 None] Deleting offline snapshot 7badcb32-7835-4119-980b-bc799d1e5ae6 of volume f41ae5f3-62a5-4680-81bb-577c8664fe24 {{(pid=86890) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:25:32 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-d6a52223-5045-4844-b55a-d502885cb1b1 tempest-ProjectMemberTests-406093346 None] snapshot_file for this snap is: volume-f41ae5f3-62a5-4680-81bb-577c8664fe24.7badcb32-7835-4119-980b-bc799d1e5ae6 {{(pid=86890) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:25:32 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[f35d9d8e-f0cd-43c7-a71e-176b0b9f57ff]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:25:32 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-d6a52223-5045-4844-b55a-d502885cb1b1 tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-f41ae5f3-62a5-4680-81bb-577c8664fe24.7badcb32-7835-4119-980b-bc799d1e5ae6 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:33 devstack sudo[106754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-f41ae5f3-62a5-4680-81bb-577c8664fe24.7badcb32-7835-4119-980b-bc799d1e5ae6 Nov 02 10:25:33 devstack sudo[106754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:33 devstack sudo[106754]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:33 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-d6a52223-5045-4844-b55a-d502885cb1b1 tempest-ProjectMemberTests-406093346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-f41ae5f3-62a5-4680-81bb-577c8664fe24.7badcb32-7835-4119-980b-bc799d1e5ae6" returned: 0 in 0.378s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:33 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-d6a52223-5045-4844-b55a-d502885cb1b1 tempest-ProjectMemberTests-406093346 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f41ae5f3-62a5-4680-81bb-577c8664fe24(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86890) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:25:33 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e46ae30-171b-4ac9-9c17-367a65f1d6cb]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:25:33 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-d6a52223-5045-4844-b55a-d502885cb1b1 tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-f41ae5f3-62a5-4680-81bb-577c8664fe24 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:33 devstack sudo[106759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-f41ae5f3-62a5-4680-81bb-577c8664fe24 Nov 02 10:25:33 devstack sudo[106759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:33 devstack sudo[106759]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:33 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-d6a52223-5045-4844-b55a-d502885cb1b1 tempest-ProjectMemberTests-406093346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-f41ae5f3-62a5-4680-81bb-577c8664fe24" returned: 0 in 0.357s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:33 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-d6a52223-5045-4844-b55a-d502885cb1b1 tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-f41ae5f3-62a5-4680-81bb-577c8664fe24.7badcb32-7835-4119-980b-bc799d1e5ae6 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:33 devstack sudo[106764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-f41ae5f3-62a5-4680-81bb-577c8664fe24.7badcb32-7835-4119-980b-bc799d1e5ae6 Nov 02 10:25:33 devstack sudo[106764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:34 devstack sudo[106764]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-d6a52223-5045-4844-b55a-d502885cb1b1 tempest-ProjectMemberTests-406093346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-f41ae5f3-62a5-4680-81bb-577c8664fe24.7badcb32-7835-4119-980b-bc799d1e5ae6" returned: 0 in 0.330s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-d6a52223-5045-4844-b55a-d502885cb1b1 tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-f41ae5f3-62a5-4680-81bb-577c8664fe24.7badcb32-7835-4119-980b-bc799d1e5ae6 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:34 devstack sudo[106769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-f41ae5f3-62a5-4680-81bb-577c8664fe24.7badcb32-7835-4119-980b-bc799d1e5ae6 Nov 02 10:25:34 devstack sudo[106769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:34 devstack sudo[106769]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-d6a52223-5045-4844-b55a-d502885cb1b1 tempest-ProjectMemberTests-406093346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-f41ae5f3-62a5-4680-81bb-577c8664fe24.7badcb32-7835-4119-980b-bc799d1e5ae6" returned: 0 in 0.246s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:34 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-d6a52223-5045-4844-b55a-d502885cb1b1 tempest-ProjectMemberTests-406093346 None] Lock "cinder-quobyte-7badcb32-7835-4119-980b-bc799d1e5ae6" released by "_delete_snapshot" :: held 1.417s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:25:34 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-d6a52223-5045-4844-b55a-d502885cb1b1 tempest-ProjectMemberTests-406093346 None] Lock "cinder-quobyte-f41ae5f3-62a5-4680-81bb-577c8664fe24" released by "delete_snapshot" :: held 1.445s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:25:34 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-d6a52223-5045-4844-b55a-d502885cb1b1 tempest-ProjectMemberTests-406093346 None] Created reservations ['325e6a82-ea6d-4cf9-9e5d-2ae0848bfcc4', 'bcaff3e4-24d6-4c40-9700-6ba952ed2971', 'dd2351ea-d8d2-4cfe-a358-0371a3a22bb2', '4a52c94a-7455-4db5-bb5f-d3124a4417b5'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:25:34 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-d6a52223-5045-4844-b55a-d502885cb1b1 tempest-ProjectMemberTests-406093346 None] Delete snapshot completed successfully. Nov 02 10:25:34 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-d6a52223-5045-4844-b55a-d502885cb1b1 tempest-ProjectMemberTests-406093346 None] Lock "cinder-7badcb32-7835-4119-980b-bc799d1e5ae6-delete_snapshot" released by "delete_snapshot" :: held 1.578s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:25:34 devstack cinder-volume[86890]: DEBUG oslo_service.periodic_task [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86890) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:25:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:25:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:25:34 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:25:34 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:25:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:25:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:34 devstack sudo[106773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:25:34 devstack sudo[106773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:34 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-3da8df78-c91f-407b-9ef9-e36ab6a5325c tempest-ProjectMemberTests-406093346 None] Acquiring lock "cinder-f41ae5f3-62a5-4680-81bb-577c8664fe24-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:25:35 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-3da8df78-c91f-407b-9ef9-e36ab6a5325c tempest-ProjectMemberTests-406093346 None] Lock "cinder-f41ae5f3-62a5-4680-81bb-577c8664fe24-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:25:35 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-3da8df78-c91f-407b-9ef9-e36ab6a5325c tempest-ProjectMemberTests-406093346 None] Acquiring lock "cinder-quobyte-f41ae5f3-62a5-4680-81bb-577c8664fe24" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:25:35 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-3da8df78-c91f-407b-9ef9-e36ab6a5325c tempest-ProjectMemberTests-406093346 None] Lock "cinder-quobyte-f41ae5f3-62a5-4680-81bb-577c8664fe24" acquired by "delete_volume" :: waited 0.021s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:25:35 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf6d4b45-9b49-49a5-8097-957bddab594e]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:25:35 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-3da8df78-c91f-407b-9ef9-e36ab6a5325c tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-f41ae5f3-62a5-4680-81bb-577c8664fe24 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:35 devstack sudo[106773]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:35 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.296s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:35 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:25:35 devstack cinder-volume[86890]: DEBUG oslo_service.periodic_task [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Running periodic task VolumeManager._thread_info {{(pid=86890) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:25:35 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] thread count: 29 {{(pid=86890) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:25:35 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] thread info: [<_MainThread(MainThread, started 133913319395456)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86890) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:25:35 devstack sudo[106775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-f41ae5f3-62a5-4680-81bb-577c8664fe24 Nov 02 10:25:35 devstack sudo[106775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:35 devstack sudo[106775]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:35 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-3da8df78-c91f-407b-9ef9-e36ab6a5325c tempest-ProjectMemberTests-406093346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-f41ae5f3-62a5-4680-81bb-577c8664fe24" returned: 0 in 0.367s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:35 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-3da8df78-c91f-407b-9ef9-e36ab6a5325c tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-f41ae5f3-62a5-4680-81bb-577c8664fe24 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:35 devstack sudo[106781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-f41ae5f3-62a5-4680-81bb-577c8664fe24 Nov 02 10:25:35 devstack sudo[106781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:35 devstack sudo[106781]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:35 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-3da8df78-c91f-407b-9ef9-e36ab6a5325c tempest-ProjectMemberTests-406093346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-f41ae5f3-62a5-4680-81bb-577c8664fe24" returned: 0 in 0.255s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:35 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-3da8df78-c91f-407b-9ef9-e36ab6a5325c tempest-ProjectMemberTests-406093346 None] Lock "cinder-quobyte-f41ae5f3-62a5-4680-81bb-577c8664fe24" released by "delete_volume" :: held 0.683s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:25:35 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-3da8df78-c91f-407b-9ef9-e36ab6a5325c tempest-ProjectMemberTests-406093346 None] Created reservations ['d043bb47-edc4-418f-8112-95f2087f20d4', '539c37eb-caa5-4762-8c5c-4fb11ad57dd9', 'c35c6d30-2c0f-431d-a2dd-e5f69d7bbdd4', 'e64b473e-9036-4631-bd94-57f9f53b9577'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:25:35 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-3da8df78-c91f-407b-9ef9-e36ab6a5325c tempest-ProjectMemberTests-406093346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:25:35 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-3da8df78-c91f-407b-9ef9-e36ab6a5325c tempest-ProjectMemberTests-406093346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:25:35 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-3da8df78-c91f-407b-9ef9-e36ab6a5325c tempest-ProjectMemberTests-406093346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:25:35 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-3da8df78-c91f-407b-9ef9-e36ab6a5325c tempest-ProjectMemberTests-406093346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:25:35 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-3da8df78-c91f-407b-9ef9-e36ab6a5325c tempest-ProjectMemberTests-406093346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:25:35 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-3da8df78-c91f-407b-9ef9-e36ab6a5325c tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:35 devstack sudo[106784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:25:35 devstack sudo[106784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:36 devstack sudo[106784]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:36 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-3da8df78-c91f-407b-9ef9-e36ab6a5325c tempest-ProjectMemberTests-406093346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.277s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:36 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-3da8df78-c91f-407b-9ef9-e36ab6a5325c tempest-ProjectMemberTests-406093346 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:25:36 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-3da8df78-c91f-407b-9ef9-e36ab6a5325c tempest-ProjectMemberTests-406093346 None] Deleted volume successfully. Nov 02 10:25:36 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-3da8df78-c91f-407b-9ef9-e36ab6a5325c tempest-ProjectMemberTests-406093346 None] Lock "cinder-f41ae5f3-62a5-4680-81bb-577c8664fe24-delete_volume" released by "delete_volume" :: held 1.202s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:25:36 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-120a25fa-96e0-4425-9912-31e8a39c1914 tempest-ProjectMemberTests-406093346 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:25:36 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-120a25fa-96e0-4425-9912-31e8a39c1914 tempest-ProjectMemberTests-406093346 None] Flow 'volume_create_manager' (32654e46-2e0e-4cbd-a98d-ffb914aa41f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:25:36 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-120a25fa-96e0-4425-9912-31e8a39c1914 tempest-ProjectMemberTests-406093346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a84db0e-8f28-436a-b3bd-f07da11b3cb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:25:36 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-120a25fa-96e0-4425-9912-31e8a39c1914 tempest-ProjectMemberTests-406093346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a84db0e-8f28-436a-b3bd-f07da11b3cb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:25:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-884669335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0204a21-0b77-4084-8ed7-83be8a0f2324,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='639ad964aa1b416eb473afb3c18dd4e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:25:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:25:37Z,use_quota=True,user_id='076db3d85c064198aa1722b31937515d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:25:36 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-120a25fa-96e0-4425-9912-31e8a39c1914 tempest-ProjectMemberTests-406093346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fef791f3-44d5-49f7-a788-b3a087224a36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:25:36 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-120a25fa-96e0-4425-9912-31e8a39c1914 tempest-ProjectMemberTests-406093346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fef791f3-44d5-49f7-a788-b3a087224a36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:25:36 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-120a25fa-96e0-4425-9912-31e8a39c1914 tempest-ProjectMemberTests-406093346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1644b676-6a23-4023-b977-1e4828bf40c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:25:36 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-120a25fa-96e0-4425-9912-31e8a39c1914 tempest-ProjectMemberTests-406093346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1644b676-6a23-4023-b977-1e4828bf40c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0204a21-0b77-4084-8ed7-83be8a0f2324', 'volume_name': 'volume-e0204a21-0b77-4084-8ed7-83be8a0f2324', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:25:36 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-120a25fa-96e0-4425-9912-31e8a39c1914 tempest-ProjectMemberTests-406093346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (273e5b4b-e071-475f-9815-a304d4a78f77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:25:36 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-120a25fa-96e0-4425-9912-31e8a39c1914 tempest-ProjectMemberTests-406093346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (273e5b4b-e071-475f-9815-a304d4a78f77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:25:36 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-120a25fa-96e0-4425-9912-31e8a39c1914 tempest-ProjectMemberTests-406093346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34d2218a-164a-482b-b501-017ca067cf9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:25:36 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-120a25fa-96e0-4425-9912-31e8a39c1914 tempest-ProjectMemberTests-406093346 None] Volume e0204a21-0b77-4084-8ed7-83be8a0f2324: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0204a21-0b77-4084-8ed7-83be8a0f2324', 'volume_size': 1} Nov 02 10:25:36 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-120a25fa-96e0-4425-9912-31e8a39c1914 tempest-ProjectMemberTests-406093346 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:25:36 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-120a25fa-96e0-4425-9912-31e8a39c1914 tempest-ProjectMemberTests-406093346 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:25:36 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-120a25fa-96e0-4425-9912-31e8a39c1914 tempest-ProjectMemberTests-406093346 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:25:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-884669335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0204a21-0b77-4084-8ed7-83be8a0f2324,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='639ad964aa1b416eb473afb3c18dd4e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:25:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:25:37Z,use_quota=True,user_id='076db3d85c064198aa1722b31937515d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:25:36 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-120a25fa-96e0-4425-9912-31e8a39c1914 tempest-ProjectMemberTests-406093346 None] Creating volume e0204a21-0b77-4084-8ed7-83be8a0f2324 {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:25:36 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-120a25fa-96e0-4425-9912-31e8a39c1914 tempest-ProjectMemberTests-406093346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:25:36 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-120a25fa-96e0-4425-9912-31e8a39c1914 tempest-ProjectMemberTests-406093346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:25:36 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-120a25fa-96e0-4425-9912-31e8a39c1914 tempest-ProjectMemberTests-406093346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:25:36 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-120a25fa-96e0-4425-9912-31e8a39c1914 tempest-ProjectMemberTests-406093346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:25:36 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-120a25fa-96e0-4425-9912-31e8a39c1914 tempest-ProjectMemberTests-406093346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:25:36 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-120a25fa-96e0-4425-9912-31e8a39c1914 tempest-ProjectMemberTests-406093346 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:25:36 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-120a25fa-96e0-4425-9912-31e8a39c1914 tempest-ProjectMemberTests-406093346 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:25:36 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-120a25fa-96e0-4425-9912-31e8a39c1914 tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e0204a21-0b77-4084-8ed7-83be8a0f2324 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:36 devstack sudo[106787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e0204a21-0b77-4084-8ed7-83be8a0f2324 1073741824 Nov 02 10:25:36 devstack sudo[106787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:37 devstack sudo[106787]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:37 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-120a25fa-96e0-4425-9912-31e8a39c1914 tempest-ProjectMemberTests-406093346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e0204a21-0b77-4084-8ed7-83be8a0f2324 1073741824" returned: 0 in 0.425s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:37 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-120a25fa-96e0-4425-9912-31e8a39c1914 tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e0204a21-0b77-4084-8ed7-83be8a0f2324 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:37 devstack sudo[106792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e0204a21-0b77-4084-8ed7-83be8a0f2324 Nov 02 10:25:37 devstack sudo[106792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:37 devstack sudo[106792]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:37 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-120a25fa-96e0-4425-9912-31e8a39c1914 tempest-ProjectMemberTests-406093346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e0204a21-0b77-4084-8ed7-83be8a0f2324" returned: 0 in 0.278s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:37 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-120a25fa-96e0-4425-9912-31e8a39c1914 tempest-ProjectMemberTests-406093346 None] <== create_volume: return (744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:25:37 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-120a25fa-96e0-4425-9912-31e8a39c1914 tempest-ProjectMemberTests-406093346 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.747s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:25:37 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-120a25fa-96e0-4425-9912-31e8a39c1914 tempest-ProjectMemberTests-406093346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34d2218a-164a-482b-b501-017ca067cf9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0204a21-0b77-4084-8ed7-83be8a0f2324', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:25:37 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-120a25fa-96e0-4425-9912-31e8a39c1914 tempest-ProjectMemberTests-406093346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d10062e5-d1e8-4f03-a917-3ec14159a980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:25:37 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-120a25fa-96e0-4425-9912-31e8a39c1914 tempest-ProjectMemberTests-406093346 None] Volume volume-e0204a21-0b77-4084-8ed7-83be8a0f2324 (e0204a21-0b77-4084-8ed7-83be8a0f2324): created successfully Nov 02 10:25:37 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-120a25fa-96e0-4425-9912-31e8a39c1914 tempest-ProjectMemberTests-406093346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d10062e5-d1e8-4f03-a917-3ec14159a980) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:25:37 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-120a25fa-96e0-4425-9912-31e8a39c1914 tempest-ProjectMemberTests-406093346 None] Flow 'volume_create_manager' (32654e46-2e0e-4cbd-a98d-ffb914aa41f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:25:37 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-120a25fa-96e0-4425-9912-31e8a39c1914 tempest-ProjectMemberTests-406093346 None] Created volume successfully. Nov 02 10:25:37 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-fa2b0f61-2a1e-4d3e-b837-3424369005a3 tempest-ProjectMemberTests-406093346 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:25:37 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-fa2b0f61-2a1e-4d3e-b837-3424369005a3 tempest-ProjectMemberTests-406093346 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:25:37 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-fa2b0f61-2a1e-4d3e-b837-3424369005a3 tempest-ProjectMemberTests-406093346 None] Creating offline snapshot 7e34ea09-2524-4a85-855c-c1e2ca07890a of volume e0204a21-0b77-4084-8ed7-83be8a0f2324 {{(pid=86890) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:25:37 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8364ac8-deaa-45a0-92e4-1127413f3077]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:25:37 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-fa2b0f61-2a1e-4d3e-b837-3424369005a3 tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e0204a21-0b77-4084-8ed7-83be8a0f2324 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:37 devstack sudo[106795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e0204a21-0b77-4084-8ed7-83be8a0f2324 Nov 02 10:25:37 devstack sudo[106795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:38 devstack sudo[106795]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:38 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-fa2b0f61-2a1e-4d3e-b837-3424369005a3 tempest-ProjectMemberTests-406093346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e0204a21-0b77-4084-8ed7-83be8a0f2324" returned: 0 in 0.399s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:38 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-fa2b0f61-2a1e-4d3e-b837-3424369005a3 tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e0204a21-0b77-4084-8ed7-83be8a0f2324,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e0204a21-0b77-4084-8ed7-83be8a0f2324.7e34ea09-2524-4a85-855c-c1e2ca07890a 1G {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:38 devstack sudo[106800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e0204a21-0b77-4084-8ed7-83be8a0f2324,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e0204a21-0b77-4084-8ed7-83be8a0f2324.7e34ea09-2524-4a85-855c-c1e2ca07890a 1G Nov 02 10:25:38 devstack sudo[106800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:38 devstack sudo[106800]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:38 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-fa2b0f61-2a1e-4d3e-b837-3424369005a3 tempest-ProjectMemberTests-406093346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e0204a21-0b77-4084-8ed7-83be8a0f2324,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e0204a21-0b77-4084-8ed7-83be8a0f2324.7e34ea09-2524-4a85-855c-c1e2ca07890a 1G" returned: 0 in 0.418s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:38 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-fa2b0f61-2a1e-4d3e-b837-3424369005a3 tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0204a21-0b77-4084-8ed7-83be8a0f2324 -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e0204a21-0b77-4084-8ed7-83be8a0f2324.7e34ea09-2524-4a85-855c-c1e2ca07890a {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:38 devstack sudo[106806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0204a21-0b77-4084-8ed7-83be8a0f2324 -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e0204a21-0b77-4084-8ed7-83be8a0f2324.7e34ea09-2524-4a85-855c-c1e2ca07890a Nov 02 10:25:38 devstack sudo[106806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:38 devstack sudo[106806]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:39 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-fa2b0f61-2a1e-4d3e-b837-3424369005a3 tempest-ProjectMemberTests-406093346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0204a21-0b77-4084-8ed7-83be8a0f2324 -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e0204a21-0b77-4084-8ed7-83be8a0f2324.7e34ea09-2524-4a85-855c-c1e2ca07890a" returned: 0 in 0.304s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:39 devstack cinder-volume[86890]: WARNING cinder.volume.drivers.remotefs [None req-fa2b0f61-2a1e-4d3e-b837-3424369005a3 tempest-ProjectMemberTests-406093346 None] /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e0204a21-0b77-4084-8ed7-83be8a0f2324.7e34ea09-2524-4a85-855c-c1e2ca07890a is being set with open permissions: ugo+rw Nov 02 10:25:39 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-fa2b0f61-2a1e-4d3e-b837-3424369005a3 tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e0204a21-0b77-4084-8ed7-83be8a0f2324.7e34ea09-2524-4a85-855c-c1e2ca07890a {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:39 devstack sudo[106811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e0204a21-0b77-4084-8ed7-83be8a0f2324.7e34ea09-2524-4a85-855c-c1e2ca07890a Nov 02 10:25:39 devstack sudo[106811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:39 devstack sudo[106811]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:39 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-fa2b0f61-2a1e-4d3e-b837-3424369005a3 tempest-ProjectMemberTests-406093346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e0204a21-0b77-4084-8ed7-83be8a0f2324.7e34ea09-2524-4a85-855c-c1e2ca07890a" returned: 0 in 0.249s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:39 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-fa2b0f61-2a1e-4d3e-b837-3424369005a3 tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e0204a21-0b77-4084-8ed7-83be8a0f2324.info {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:39 devstack sudo[106814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e0204a21-0b77-4084-8ed7-83be8a0f2324.info Nov 02 10:25:39 devstack sudo[106814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:39 devstack sudo[106814]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:39 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-fa2b0f61-2a1e-4d3e-b837-3424369005a3 tempest-ProjectMemberTests-406093346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e0204a21-0b77-4084-8ed7-83be8a0f2324.info" returned: 0 in 0.251s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:39 devstack cinder-volume[86890]: WARNING cinder.volume.drivers.remotefs [None req-fa2b0f61-2a1e-4d3e-b837-3424369005a3 tempest-ProjectMemberTests-406093346 None] /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e0204a21-0b77-4084-8ed7-83be8a0f2324.info is being set with open permissions: ugo+rw Nov 02 10:25:39 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-fa2b0f61-2a1e-4d3e-b837-3424369005a3 tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e0204a21-0b77-4084-8ed7-83be8a0f2324.info {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:39 devstack sudo[106817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e0204a21-0b77-4084-8ed7-83be8a0f2324.info Nov 02 10:25:39 devstack sudo[106817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:39 devstack sudo[106817]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:39 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-fa2b0f61-2a1e-4d3e-b837-3424369005a3 tempest-ProjectMemberTests-406093346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e0204a21-0b77-4084-8ed7-83be8a0f2324.info" returned: 0 in 0.255s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:39 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-fa2b0f61-2a1e-4d3e-b837-3424369005a3 tempest-ProjectMemberTests-406093346 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.964s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:25:39 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-fa2b0f61-2a1e-4d3e-b837-3424369005a3 tempest-ProjectMemberTests-406093346 None] Create snapshot completed successfully Nov 02 10:25:39 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-21d4740e-c8fa-46a4-8b3d-b6a59591d26b tempest-ProjectMemberTests-406093346 None] Acquiring lock "cinder-7e34ea09-2524-4a85-855c-c1e2ca07890a-delete_snapshot" by "delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:25:40 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-21d4740e-c8fa-46a4-8b3d-b6a59591d26b tempest-ProjectMemberTests-406093346 None] Lock "cinder-7e34ea09-2524-4a85-855c-c1e2ca07890a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:25:40 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-21d4740e-c8fa-46a4-8b3d-b6a59591d26b tempest-ProjectMemberTests-406093346 None] Acquiring lock "cinder-quobyte-e0204a21-0b77-4084-8ed7-83be8a0f2324" by "delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:25:40 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-21d4740e-c8fa-46a4-8b3d-b6a59591d26b tempest-ProjectMemberTests-406093346 None] Lock "cinder-quobyte-e0204a21-0b77-4084-8ed7-83be8a0f2324" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:25:40 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-21d4740e-c8fa-46a4-8b3d-b6a59591d26b tempest-ProjectMemberTests-406093346 None] Acquiring lock "cinder-quobyte-7e34ea09-2524-4a85-855c-c1e2ca07890a" by "_delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:25:40 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-21d4740e-c8fa-46a4-8b3d-b6a59591d26b tempest-ProjectMemberTests-406093346 None] Lock "cinder-quobyte-7e34ea09-2524-4a85-855c-c1e2ca07890a" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:25:40 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-21d4740e-c8fa-46a4-8b3d-b6a59591d26b tempest-ProjectMemberTests-406093346 None] Deleting offline snapshot 7e34ea09-2524-4a85-855c-c1e2ca07890a of volume e0204a21-0b77-4084-8ed7-83be8a0f2324 {{(pid=86890) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:25:40 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-21d4740e-c8fa-46a4-8b3d-b6a59591d26b tempest-ProjectMemberTests-406093346 None] snapshot_file for this snap is: volume-e0204a21-0b77-4084-8ed7-83be8a0f2324.7e34ea09-2524-4a85-855c-c1e2ca07890a {{(pid=86890) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:25:40 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[05e14e95-8516-4784-80e7-d334d445a636]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:25:40 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-21d4740e-c8fa-46a4-8b3d-b6a59591d26b tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e0204a21-0b77-4084-8ed7-83be8a0f2324.7e34ea09-2524-4a85-855c-c1e2ca07890a {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:40 devstack sudo[106820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e0204a21-0b77-4084-8ed7-83be8a0f2324.7e34ea09-2524-4a85-855c-c1e2ca07890a Nov 02 10:25:40 devstack sudo[106820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:40 devstack sudo[106820]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:40 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-21d4740e-c8fa-46a4-8b3d-b6a59591d26b tempest-ProjectMemberTests-406093346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e0204a21-0b77-4084-8ed7-83be8a0f2324.7e34ea09-2524-4a85-855c-c1e2ca07890a" returned: 0 in 0.365s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:40 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-21d4740e-c8fa-46a4-8b3d-b6a59591d26b tempest-ProjectMemberTests-406093346 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e0204a21-0b77-4084-8ed7-83be8a0f2324(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86890) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:25:40 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a82ab4e-2abd-401d-8703-b46ec134195c]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:25:40 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-21d4740e-c8fa-46a4-8b3d-b6a59591d26b tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e0204a21-0b77-4084-8ed7-83be8a0f2324 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:40 devstack sudo[106825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e0204a21-0b77-4084-8ed7-83be8a0f2324 Nov 02 10:25:40 devstack sudo[106825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:40 devstack sudo[106825]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:40 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-21d4740e-c8fa-46a4-8b3d-b6a59591d26b tempest-ProjectMemberTests-406093346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e0204a21-0b77-4084-8ed7-83be8a0f2324" returned: 0 in 0.373s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:40 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-21d4740e-c8fa-46a4-8b3d-b6a59591d26b tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e0204a21-0b77-4084-8ed7-83be8a0f2324.7e34ea09-2524-4a85-855c-c1e2ca07890a {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:40 devstack sudo[106830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e0204a21-0b77-4084-8ed7-83be8a0f2324.7e34ea09-2524-4a85-855c-c1e2ca07890a Nov 02 10:25:40 devstack sudo[106830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:41 devstack sudo[106830]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:41 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-21d4740e-c8fa-46a4-8b3d-b6a59591d26b tempest-ProjectMemberTests-406093346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e0204a21-0b77-4084-8ed7-83be8a0f2324.7e34ea09-2524-4a85-855c-c1e2ca07890a" returned: 0 in 0.349s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:41 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-21d4740e-c8fa-46a4-8b3d-b6a59591d26b tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e0204a21-0b77-4084-8ed7-83be8a0f2324.7e34ea09-2524-4a85-855c-c1e2ca07890a {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:41 devstack sudo[106835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e0204a21-0b77-4084-8ed7-83be8a0f2324.7e34ea09-2524-4a85-855c-c1e2ca07890a Nov 02 10:25:41 devstack sudo[106835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:41 devstack sudo[106835]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:41 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-21d4740e-c8fa-46a4-8b3d-b6a59591d26b tempest-ProjectMemberTests-406093346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e0204a21-0b77-4084-8ed7-83be8a0f2324.7e34ea09-2524-4a85-855c-c1e2ca07890a" returned: 0 in 0.264s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:41 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-21d4740e-c8fa-46a4-8b3d-b6a59591d26b tempest-ProjectMemberTests-406093346 None] Lock "cinder-quobyte-7e34ea09-2524-4a85-855c-c1e2ca07890a" released by "_delete_snapshot" :: held 1.456s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:25:41 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-21d4740e-c8fa-46a4-8b3d-b6a59591d26b tempest-ProjectMemberTests-406093346 None] Lock "cinder-quobyte-e0204a21-0b77-4084-8ed7-83be8a0f2324" released by "delete_snapshot" :: held 1.480s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:25:41 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-21d4740e-c8fa-46a4-8b3d-b6a59591d26b tempest-ProjectMemberTests-406093346 None] Created reservations ['7d14a812-4a23-443c-9ab4-da780afdfe23', 'ca9490d1-23d6-446c-9cc5-3a197ab8839b', 'fae74665-72c2-44a2-aaa7-6e092c1bb039', '05718362-b578-4d6c-8811-65f12da6364a'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:25:41 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-21d4740e-c8fa-46a4-8b3d-b6a59591d26b tempest-ProjectMemberTests-406093346 None] Delete snapshot completed successfully. Nov 02 10:25:41 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-21d4740e-c8fa-46a4-8b3d-b6a59591d26b tempest-ProjectMemberTests-406093346 None] Lock "cinder-7e34ea09-2524-4a85-855c-c1e2ca07890a-delete_snapshot" released by "delete_snapshot" :: held 1.632s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:25:42 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-3c3c62e8-34d4-4d1a-a20b-5694f62ede7b tempest-ProjectMemberTests-406093346 None] Acquiring lock "cinder-e0204a21-0b77-4084-8ed7-83be8a0f2324-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:25:42 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-3c3c62e8-34d4-4d1a-a20b-5694f62ede7b tempest-ProjectMemberTests-406093346 None] Lock "cinder-e0204a21-0b77-4084-8ed7-83be8a0f2324-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:25:42 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-3c3c62e8-34d4-4d1a-a20b-5694f62ede7b tempest-ProjectMemberTests-406093346 None] Acquiring lock "cinder-quobyte-e0204a21-0b77-4084-8ed7-83be8a0f2324" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:25:42 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-3c3c62e8-34d4-4d1a-a20b-5694f62ede7b tempest-ProjectMemberTests-406093346 None] Lock "cinder-quobyte-e0204a21-0b77-4084-8ed7-83be8a0f2324" acquired by "delete_volume" :: waited 0.016s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:25:42 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb55e9ed-aaac-4d60-bdf1-a6f2f24e86fb]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:25:42 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-3c3c62e8-34d4-4d1a-a20b-5694f62ede7b tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e0204a21-0b77-4084-8ed7-83be8a0f2324 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:42 devstack sudo[106838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e0204a21-0b77-4084-8ed7-83be8a0f2324 Nov 02 10:25:42 devstack sudo[106838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:42 devstack sudo[106838]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:42 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-3c3c62e8-34d4-4d1a-a20b-5694f62ede7b tempest-ProjectMemberTests-406093346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e0204a21-0b77-4084-8ed7-83be8a0f2324" returned: 0 in 0.379s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:42 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-3c3c62e8-34d4-4d1a-a20b-5694f62ede7b tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e0204a21-0b77-4084-8ed7-83be8a0f2324 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:42 devstack sudo[106843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e0204a21-0b77-4084-8ed7-83be8a0f2324 Nov 02 10:25:42 devstack sudo[106843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:42 devstack sudo[106843]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:42 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-3c3c62e8-34d4-4d1a-a20b-5694f62ede7b tempest-ProjectMemberTests-406093346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-e0204a21-0b77-4084-8ed7-83be8a0f2324" returned: 0 in 0.262s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:42 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-3c3c62e8-34d4-4d1a-a20b-5694f62ede7b tempest-ProjectMemberTests-406093346 None] Lock "cinder-quobyte-e0204a21-0b77-4084-8ed7-83be8a0f2324" released by "delete_volume" :: held 0.699s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:25:42 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-3c3c62e8-34d4-4d1a-a20b-5694f62ede7b tempest-ProjectMemberTests-406093346 None] Created reservations ['85fc60e8-d0c3-43f2-aa09-1141f54da18a', 'fd08d83a-a716-41cd-88c2-1f09e1ee6d41', 'fa3ef486-924e-467d-accc-3b19e38857dc', 'c5a5e06b-834a-44ba-afc5-37e6cceb5313'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:25:43 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-3c3c62e8-34d4-4d1a-a20b-5694f62ede7b tempest-ProjectMemberTests-406093346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:25:43 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-3c3c62e8-34d4-4d1a-a20b-5694f62ede7b tempest-ProjectMemberTests-406093346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:25:43 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-3c3c62e8-34d4-4d1a-a20b-5694f62ede7b tempest-ProjectMemberTests-406093346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:25:43 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-3c3c62e8-34d4-4d1a-a20b-5694f62ede7b tempest-ProjectMemberTests-406093346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:25:43 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-3c3c62e8-34d4-4d1a-a20b-5694f62ede7b tempest-ProjectMemberTests-406093346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:25:43 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-3c3c62e8-34d4-4d1a-a20b-5694f62ede7b tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:43 devstack sudo[106846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:25:43 devstack sudo[106846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:43 devstack sudo[106846]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:43 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-3c3c62e8-34d4-4d1a-a20b-5694f62ede7b tempest-ProjectMemberTests-406093346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.252s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:43 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-3c3c62e8-34d4-4d1a-a20b-5694f62ede7b tempest-ProjectMemberTests-406093346 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:25:43 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-3c3c62e8-34d4-4d1a-a20b-5694f62ede7b tempest-ProjectMemberTests-406093346 None] Deleted volume successfully. Nov 02 10:25:43 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-3c3c62e8-34d4-4d1a-a20b-5694f62ede7b tempest-ProjectMemberTests-406093346 None] Lock "cinder-e0204a21-0b77-4084-8ed7-83be8a0f2324-delete_volume" released by "delete_volume" :: held 1.239s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:25:43 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-49584b8f-1a47-4716-a9f8-597c023902ee tempest-ProjectMemberTests-406093346 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:25:43 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-49584b8f-1a47-4716-a9f8-597c023902ee tempest-ProjectMemberTests-406093346 None] Flow 'volume_create_manager' (1c603b09-0ffc-44d4-923c-641e1fad642b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:25:43 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-49584b8f-1a47-4716-a9f8-597c023902ee tempest-ProjectMemberTests-406093346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80205574-f891-411c-a384-1c8c1b4caed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:25:43 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-49584b8f-1a47-4716-a9f8-597c023902ee tempest-ProjectMemberTests-406093346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80205574-f891-411c-a384-1c8c1b4caed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:25:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-59358601',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96dbea0e-3151-4322-9232-99bc875ec3bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='639ad964aa1b416eb473afb3c18dd4e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:25:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:25:44Z,use_quota=True,user_id='076db3d85c064198aa1722b31937515d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:25:43 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-49584b8f-1a47-4716-a9f8-597c023902ee tempest-ProjectMemberTests-406093346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ed4b351-6a7d-4315-8f5f-9d17e4db31b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:25:43 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-49584b8f-1a47-4716-a9f8-597c023902ee tempest-ProjectMemberTests-406093346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ed4b351-6a7d-4315-8f5f-9d17e4db31b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:25:43 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-49584b8f-1a47-4716-a9f8-597c023902ee tempest-ProjectMemberTests-406093346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e67c71ed-fa50-4bf7-b767-e5a96e9411e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:25:43 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-49584b8f-1a47-4716-a9f8-597c023902ee tempest-ProjectMemberTests-406093346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e67c71ed-fa50-4bf7-b767-e5a96e9411e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96dbea0e-3151-4322-9232-99bc875ec3bd', 'volume_name': 'volume-96dbea0e-3151-4322-9232-99bc875ec3bd', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:25:43 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-49584b8f-1a47-4716-a9f8-597c023902ee tempest-ProjectMemberTests-406093346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8fd2f9d-964b-46bb-ab0e-401c0f6690bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:25:43 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-49584b8f-1a47-4716-a9f8-597c023902ee tempest-ProjectMemberTests-406093346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8fd2f9d-964b-46bb-ab0e-401c0f6690bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:25:43 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-49584b8f-1a47-4716-a9f8-597c023902ee tempest-ProjectMemberTests-406093346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dde3eb53-2fcb-4615-abd9-966d257042a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:25:43 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-49584b8f-1a47-4716-a9f8-597c023902ee tempest-ProjectMemberTests-406093346 None] Volume 96dbea0e-3151-4322-9232-99bc875ec3bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96dbea0e-3151-4322-9232-99bc875ec3bd', 'volume_size': 1} Nov 02 10:25:43 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-49584b8f-1a47-4716-a9f8-597c023902ee tempest-ProjectMemberTests-406093346 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:25:43 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-49584b8f-1a47-4716-a9f8-597c023902ee tempest-ProjectMemberTests-406093346 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:25:43 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-49584b8f-1a47-4716-a9f8-597c023902ee tempest-ProjectMemberTests-406093346 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:25:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-59358601',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96dbea0e-3151-4322-9232-99bc875ec3bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='639ad964aa1b416eb473afb3c18dd4e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:25:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:25:44Z,use_quota=True,user_id='076db3d85c064198aa1722b31937515d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:25:43 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-49584b8f-1a47-4716-a9f8-597c023902ee tempest-ProjectMemberTests-406093346 None] Creating volume 96dbea0e-3151-4322-9232-99bc875ec3bd {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:25:43 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-49584b8f-1a47-4716-a9f8-597c023902ee tempest-ProjectMemberTests-406093346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:25:43 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-49584b8f-1a47-4716-a9f8-597c023902ee tempest-ProjectMemberTests-406093346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:25:43 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-49584b8f-1a47-4716-a9f8-597c023902ee tempest-ProjectMemberTests-406093346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:25:43 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-49584b8f-1a47-4716-a9f8-597c023902ee tempest-ProjectMemberTests-406093346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:25:43 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-49584b8f-1a47-4716-a9f8-597c023902ee tempest-ProjectMemberTests-406093346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:25:43 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-49584b8f-1a47-4716-a9f8-597c023902ee tempest-ProjectMemberTests-406093346 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:25:43 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-49584b8f-1a47-4716-a9f8-597c023902ee tempest-ProjectMemberTests-406093346 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:25:43 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-49584b8f-1a47-4716-a9f8-597c023902ee tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-96dbea0e-3151-4322-9232-99bc875ec3bd 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:44 devstack sudo[106849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-96dbea0e-3151-4322-9232-99bc875ec3bd 1073741824 Nov 02 10:25:44 devstack sudo[106849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:44 devstack sudo[106849]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:44 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-49584b8f-1a47-4716-a9f8-597c023902ee tempest-ProjectMemberTests-406093346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-96dbea0e-3151-4322-9232-99bc875ec3bd 1073741824" returned: 0 in 0.442s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:44 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-49584b8f-1a47-4716-a9f8-597c023902ee tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-96dbea0e-3151-4322-9232-99bc875ec3bd {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:44 devstack sudo[106855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-96dbea0e-3151-4322-9232-99bc875ec3bd Nov 02 10:25:44 devstack sudo[106855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:44 devstack sudo[106855]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:44 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-49584b8f-1a47-4716-a9f8-597c023902ee tempest-ProjectMemberTests-406093346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-96dbea0e-3151-4322-9232-99bc875ec3bd" returned: 0 in 0.245s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:44 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-49584b8f-1a47-4716-a9f8-597c023902ee tempest-ProjectMemberTests-406093346 None] <== create_volume: return (735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:25:44 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-49584b8f-1a47-4716-a9f8-597c023902ee tempest-ProjectMemberTests-406093346 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.738s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:25:44 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-49584b8f-1a47-4716-a9f8-597c023902ee tempest-ProjectMemberTests-406093346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dde3eb53-2fcb-4615-abd9-966d257042a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96dbea0e-3151-4322-9232-99bc875ec3bd', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:25:44 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-49584b8f-1a47-4716-a9f8-597c023902ee tempest-ProjectMemberTests-406093346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74b6a4ba-b47e-4361-b5ae-3e8c1ab629bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:25:44 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-49584b8f-1a47-4716-a9f8-597c023902ee tempest-ProjectMemberTests-406093346 None] Volume volume-96dbea0e-3151-4322-9232-99bc875ec3bd (96dbea0e-3151-4322-9232-99bc875ec3bd): created successfully Nov 02 10:25:44 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-49584b8f-1a47-4716-a9f8-597c023902ee tempest-ProjectMemberTests-406093346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74b6a4ba-b47e-4361-b5ae-3e8c1ab629bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:25:44 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-49584b8f-1a47-4716-a9f8-597c023902ee tempest-ProjectMemberTests-406093346 None] Flow 'volume_create_manager' (1c603b09-0ffc-44d4-923c-641e1fad642b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:25:44 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-49584b8f-1a47-4716-a9f8-597c023902ee tempest-ProjectMemberTests-406093346 None] Created volume successfully. Nov 02 10:25:45 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-d59ea755-cf50-4533-adc5-621da56e513e tempest-ProjectMemberTests-406093346 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:25:45 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-d59ea755-cf50-4533-adc5-621da56e513e tempest-ProjectMemberTests-406093346 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:25:45 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-d59ea755-cf50-4533-adc5-621da56e513e tempest-ProjectMemberTests-406093346 None] Creating offline snapshot 8f80258a-f4da-42ed-90aa-466f4b907f34 of volume 96dbea0e-3151-4322-9232-99bc875ec3bd {{(pid=86890) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:25:45 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[91d7e385-bd4a-4d4c-8c8d-db9a294e9587]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:25:45 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-d59ea755-cf50-4533-adc5-621da56e513e tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-96dbea0e-3151-4322-9232-99bc875ec3bd {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:45 devstack sudo[106858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-96dbea0e-3151-4322-9232-99bc875ec3bd Nov 02 10:25:45 devstack sudo[106858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:45 devstack sudo[106858]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:45 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-d59ea755-cf50-4533-adc5-621da56e513e tempest-ProjectMemberTests-406093346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-96dbea0e-3151-4322-9232-99bc875ec3bd" returned: 0 in 0.368s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:45 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-d59ea755-cf50-4533-adc5-621da56e513e tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-96dbea0e-3151-4322-9232-99bc875ec3bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-96dbea0e-3151-4322-9232-99bc875ec3bd.8f80258a-f4da-42ed-90aa-466f4b907f34 1G {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:45 devstack sudo[106863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-96dbea0e-3151-4322-9232-99bc875ec3bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-96dbea0e-3151-4322-9232-99bc875ec3bd.8f80258a-f4da-42ed-90aa-466f4b907f34 1G Nov 02 10:25:45 devstack sudo[106863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:45 devstack sudo[106863]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:45 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-d59ea755-cf50-4533-adc5-621da56e513e tempest-ProjectMemberTests-406093346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-96dbea0e-3151-4322-9232-99bc875ec3bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-96dbea0e-3151-4322-9232-99bc875ec3bd.8f80258a-f4da-42ed-90aa-466f4b907f34 1G" returned: 0 in 0.371s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:45 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-d59ea755-cf50-4533-adc5-621da56e513e tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96dbea0e-3151-4322-9232-99bc875ec3bd -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-96dbea0e-3151-4322-9232-99bc875ec3bd.8f80258a-f4da-42ed-90aa-466f4b907f34 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:45 devstack sudo[106868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96dbea0e-3151-4322-9232-99bc875ec3bd -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-96dbea0e-3151-4322-9232-99bc875ec3bd.8f80258a-f4da-42ed-90aa-466f4b907f34 Nov 02 10:25:45 devstack sudo[106868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:46 devstack sudo[106868]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:46 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-d59ea755-cf50-4533-adc5-621da56e513e tempest-ProjectMemberTests-406093346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96dbea0e-3151-4322-9232-99bc875ec3bd -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-96dbea0e-3151-4322-9232-99bc875ec3bd.8f80258a-f4da-42ed-90aa-466f4b907f34" returned: 0 in 0.284s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:46 devstack cinder-volume[86890]: WARNING cinder.volume.drivers.remotefs [None req-d59ea755-cf50-4533-adc5-621da56e513e tempest-ProjectMemberTests-406093346 None] /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-96dbea0e-3151-4322-9232-99bc875ec3bd.8f80258a-f4da-42ed-90aa-466f4b907f34 is being set with open permissions: ugo+rw Nov 02 10:25:46 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-d59ea755-cf50-4533-adc5-621da56e513e tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-96dbea0e-3151-4322-9232-99bc875ec3bd.8f80258a-f4da-42ed-90aa-466f4b907f34 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:46 devstack sudo[106873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-96dbea0e-3151-4322-9232-99bc875ec3bd.8f80258a-f4da-42ed-90aa-466f4b907f34 Nov 02 10:25:46 devstack sudo[106873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:46 devstack sudo[106873]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:46 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-d59ea755-cf50-4533-adc5-621da56e513e tempest-ProjectMemberTests-406093346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-96dbea0e-3151-4322-9232-99bc875ec3bd.8f80258a-f4da-42ed-90aa-466f4b907f34" returned: 0 in 0.235s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:46 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-d59ea755-cf50-4533-adc5-621da56e513e tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-96dbea0e-3151-4322-9232-99bc875ec3bd.info {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:46 devstack sudo[106876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-96dbea0e-3151-4322-9232-99bc875ec3bd.info Nov 02 10:25:46 devstack sudo[106876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:46 devstack sudo[106876]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:46 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-d59ea755-cf50-4533-adc5-621da56e513e tempest-ProjectMemberTests-406093346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-96dbea0e-3151-4322-9232-99bc875ec3bd.info" returned: 0 in 0.243s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:46 devstack cinder-volume[86890]: WARNING cinder.volume.drivers.remotefs [None req-d59ea755-cf50-4533-adc5-621da56e513e tempest-ProjectMemberTests-406093346 None] /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-96dbea0e-3151-4322-9232-99bc875ec3bd.info is being set with open permissions: ugo+rw Nov 02 10:25:46 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-d59ea755-cf50-4533-adc5-621da56e513e tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-96dbea0e-3151-4322-9232-99bc875ec3bd.info {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:46 devstack sudo[106879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-96dbea0e-3151-4322-9232-99bc875ec3bd.info Nov 02 10:25:46 devstack sudo[106879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:46 devstack sudo[106879]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:46 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-d59ea755-cf50-4533-adc5-621da56e513e tempest-ProjectMemberTests-406093346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-96dbea0e-3151-4322-9232-99bc875ec3bd.info" returned: 0 in 0.234s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:46 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-d59ea755-cf50-4533-adc5-621da56e513e tempest-ProjectMemberTests-406093346 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.810s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:25:46 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-d59ea755-cf50-4533-adc5-621da56e513e tempest-ProjectMemberTests-406093346 None] Create snapshot completed successfully Nov 02 10:25:47 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-0ad85510-e8f5-42d0-9769-ed11df4f7745 tempest-ProjectMemberTests-406093346 None] Acquiring lock "cinder-8f80258a-f4da-42ed-90aa-466f4b907f34-delete_snapshot" by "delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:25:47 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-0ad85510-e8f5-42d0-9769-ed11df4f7745 tempest-ProjectMemberTests-406093346 None] Lock "cinder-8f80258a-f4da-42ed-90aa-466f4b907f34-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:25:47 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-0ad85510-e8f5-42d0-9769-ed11df4f7745 tempest-ProjectMemberTests-406093346 None] Acquiring lock "cinder-quobyte-96dbea0e-3151-4322-9232-99bc875ec3bd" by "delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:25:47 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-0ad85510-e8f5-42d0-9769-ed11df4f7745 tempest-ProjectMemberTests-406093346 None] Lock "cinder-quobyte-96dbea0e-3151-4322-9232-99bc875ec3bd" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:25:47 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-0ad85510-e8f5-42d0-9769-ed11df4f7745 tempest-ProjectMemberTests-406093346 None] Acquiring lock "cinder-quobyte-8f80258a-f4da-42ed-90aa-466f4b907f34" by "_delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:25:47 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-0ad85510-e8f5-42d0-9769-ed11df4f7745 tempest-ProjectMemberTests-406093346 None] Lock "cinder-quobyte-8f80258a-f4da-42ed-90aa-466f4b907f34" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:25:47 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-0ad85510-e8f5-42d0-9769-ed11df4f7745 tempest-ProjectMemberTests-406093346 None] Deleting offline snapshot 8f80258a-f4da-42ed-90aa-466f4b907f34 of volume 96dbea0e-3151-4322-9232-99bc875ec3bd {{(pid=86890) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:25:47 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-0ad85510-e8f5-42d0-9769-ed11df4f7745 tempest-ProjectMemberTests-406093346 None] snapshot_file for this snap is: volume-96dbea0e-3151-4322-9232-99bc875ec3bd.8f80258a-f4da-42ed-90aa-466f4b907f34 {{(pid=86890) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:25:47 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[baf097ab-3e02-4dec-bb5c-b62748d4545e]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:25:47 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-0ad85510-e8f5-42d0-9769-ed11df4f7745 tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-96dbea0e-3151-4322-9232-99bc875ec3bd.8f80258a-f4da-42ed-90aa-466f4b907f34 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:47 devstack sudo[106882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-96dbea0e-3151-4322-9232-99bc875ec3bd.8f80258a-f4da-42ed-90aa-466f4b907f34 Nov 02 10:25:47 devstack sudo[106882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:47 devstack sudo[106882]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:47 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-0ad85510-e8f5-42d0-9769-ed11df4f7745 tempest-ProjectMemberTests-406093346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-96dbea0e-3151-4322-9232-99bc875ec3bd.8f80258a-f4da-42ed-90aa-466f4b907f34" returned: 0 in 0.347s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:47 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-0ad85510-e8f5-42d0-9769-ed11df4f7745 tempest-ProjectMemberTests-406093346 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-96dbea0e-3151-4322-9232-99bc875ec3bd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86890) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:25:47 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[146a47cd-f26a-4f4c-b4a5-221bb8657be6]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:25:47 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-0ad85510-e8f5-42d0-9769-ed11df4f7745 tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-96dbea0e-3151-4322-9232-99bc875ec3bd {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:47 devstack sudo[106887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-96dbea0e-3151-4322-9232-99bc875ec3bd Nov 02 10:25:47 devstack sudo[106887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:48 devstack sudo[106887]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:48 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-0ad85510-e8f5-42d0-9769-ed11df4f7745 tempest-ProjectMemberTests-406093346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-96dbea0e-3151-4322-9232-99bc875ec3bd" returned: 0 in 0.347s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:48 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-0ad85510-e8f5-42d0-9769-ed11df4f7745 tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-96dbea0e-3151-4322-9232-99bc875ec3bd.8f80258a-f4da-42ed-90aa-466f4b907f34 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:48 devstack sudo[106892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-96dbea0e-3151-4322-9232-99bc875ec3bd.8f80258a-f4da-42ed-90aa-466f4b907f34 Nov 02 10:25:48 devstack sudo[106892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:48 devstack sudo[106892]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:48 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-0ad85510-e8f5-42d0-9769-ed11df4f7745 tempest-ProjectMemberTests-406093346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-96dbea0e-3151-4322-9232-99bc875ec3bd.8f80258a-f4da-42ed-90aa-466f4b907f34" returned: 0 in 0.319s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:48 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-0ad85510-e8f5-42d0-9769-ed11df4f7745 tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-96dbea0e-3151-4322-9232-99bc875ec3bd.8f80258a-f4da-42ed-90aa-466f4b907f34 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:48 devstack sudo[106897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-96dbea0e-3151-4322-9232-99bc875ec3bd.8f80258a-f4da-42ed-90aa-466f4b907f34 Nov 02 10:25:48 devstack sudo[106897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:48 devstack sudo[106897]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:48 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-0ad85510-e8f5-42d0-9769-ed11df4f7745 tempest-ProjectMemberTests-406093346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-96dbea0e-3151-4322-9232-99bc875ec3bd.8f80258a-f4da-42ed-90aa-466f4b907f34" returned: 0 in 0.239s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:48 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-0ad85510-e8f5-42d0-9769-ed11df4f7745 tempest-ProjectMemberTests-406093346 None] Lock "cinder-quobyte-8f80258a-f4da-42ed-90aa-466f4b907f34" released by "_delete_snapshot" :: held 1.349s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:25:48 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-0ad85510-e8f5-42d0-9769-ed11df4f7745 tempest-ProjectMemberTests-406093346 None] Lock "cinder-quobyte-96dbea0e-3151-4322-9232-99bc875ec3bd" released by "delete_snapshot" :: held 1.372s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:25:48 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-0ad85510-e8f5-42d0-9769-ed11df4f7745 tempest-ProjectMemberTests-406093346 None] Created reservations ['e45dbc27-972c-4ae5-8855-95b147b2e66d', '5c7569dd-5538-4aaa-b770-2da3d6bc76aa', 'cfb4b751-cd85-495d-9c44-66489528838c', '54a9b087-f017-4c8d-9d29-a2ffe8449b7c'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:25:48 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-0ad85510-e8f5-42d0-9769-ed11df4f7745 tempest-ProjectMemberTests-406093346 None] Delete snapshot completed successfully. Nov 02 10:25:48 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-0ad85510-e8f5-42d0-9769-ed11df4f7745 tempest-ProjectMemberTests-406093346 None] Lock "cinder-8f80258a-f4da-42ed-90aa-466f4b907f34-delete_snapshot" released by "delete_snapshot" :: held 1.496s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:25:49 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-816355b3-d24f-4b59-aaf0-d4d32bca0caf tempest-ProjectMemberTests-406093346 None] Acquiring lock "cinder-96dbea0e-3151-4322-9232-99bc875ec3bd-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:25:49 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-816355b3-d24f-4b59-aaf0-d4d32bca0caf tempest-ProjectMemberTests-406093346 None] Lock "cinder-96dbea0e-3151-4322-9232-99bc875ec3bd-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:25:49 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-816355b3-d24f-4b59-aaf0-d4d32bca0caf tempest-ProjectMemberTests-406093346 None] Acquiring lock "cinder-quobyte-96dbea0e-3151-4322-9232-99bc875ec3bd" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:25:49 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-816355b3-d24f-4b59-aaf0-d4d32bca0caf tempest-ProjectMemberTests-406093346 None] Lock "cinder-quobyte-96dbea0e-3151-4322-9232-99bc875ec3bd" acquired by "delete_volume" :: waited 0.015s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:25:49 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2294883-e226-463d-9836-4bca6c72dfc6]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:25:49 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-816355b3-d24f-4b59-aaf0-d4d32bca0caf tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-96dbea0e-3151-4322-9232-99bc875ec3bd {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:49 devstack sudo[106900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-96dbea0e-3151-4322-9232-99bc875ec3bd Nov 02 10:25:49 devstack sudo[106900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:49 devstack sudo[106900]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:49 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-816355b3-d24f-4b59-aaf0-d4d32bca0caf tempest-ProjectMemberTests-406093346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-96dbea0e-3151-4322-9232-99bc875ec3bd" returned: 0 in 0.350s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:49 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-816355b3-d24f-4b59-aaf0-d4d32bca0caf tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-96dbea0e-3151-4322-9232-99bc875ec3bd {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:49 devstack sudo[106905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-96dbea0e-3151-4322-9232-99bc875ec3bd Nov 02 10:25:49 devstack sudo[106905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:50 devstack sudo[106905]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:50 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-816355b3-d24f-4b59-aaf0-d4d32bca0caf tempest-ProjectMemberTests-406093346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-96dbea0e-3151-4322-9232-99bc875ec3bd" returned: 0 in 0.239s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:50 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-816355b3-d24f-4b59-aaf0-d4d32bca0caf tempest-ProjectMemberTests-406093346 None] Lock "cinder-quobyte-96dbea0e-3151-4322-9232-99bc875ec3bd" released by "delete_volume" :: held 0.652s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:25:50 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-816355b3-d24f-4b59-aaf0-d4d32bca0caf tempest-ProjectMemberTests-406093346 None] Created reservations ['53677c09-579f-49d9-bacc-8512b14e3d3a', '623b4d15-3d1b-4425-8162-342b96487bb9', 'c8a1b44c-4742-4aae-901d-f1ad2c250877', '07c5575f-a384-4a31-89e8-5624671febf9'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:25:50 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-816355b3-d24f-4b59-aaf0-d4d32bca0caf tempest-ProjectMemberTests-406093346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:25:50 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-816355b3-d24f-4b59-aaf0-d4d32bca0caf tempest-ProjectMemberTests-406093346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:25:50 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-816355b3-d24f-4b59-aaf0-d4d32bca0caf tempest-ProjectMemberTests-406093346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:25:50 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-816355b3-d24f-4b59-aaf0-d4d32bca0caf tempest-ProjectMemberTests-406093346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:25:50 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-816355b3-d24f-4b59-aaf0-d4d32bca0caf tempest-ProjectMemberTests-406093346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:25:50 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-816355b3-d24f-4b59-aaf0-d4d32bca0caf tempest-ProjectMemberTests-406093346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:25:50 devstack sudo[106908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:25:50 devstack sudo[106908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:25:50 devstack sudo[106908]: pam_unix(sudo:session): session closed for user root Nov 02 10:25:50 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-816355b3-d24f-4b59-aaf0-d4d32bca0caf tempest-ProjectMemberTests-406093346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.294s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:25:50 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-816355b3-d24f-4b59-aaf0-d4d32bca0caf tempest-ProjectMemberTests-406093346 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:25:50 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-816355b3-d24f-4b59-aaf0-d4d32bca0caf tempest-ProjectMemberTests-406093346 None] Deleted volume successfully. Nov 02 10:25:50 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-816355b3-d24f-4b59-aaf0-d4d32bca0caf tempest-ProjectMemberTests-406093346 None] Lock "cinder-96dbea0e-3151-4322-9232-99bc875ec3bd-delete_volume" released by "delete_volume" :: held 1.162s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:26:00 devstack cinder-volume[86890]: DEBUG dbcounter [-] [86890] Writing DB stats cinder:SELECT=37,cinder:INSERT=16,cinder:DELETE=3,cinder:UPDATE=50 {{(pid=86890) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:26:00 devstack cinder-volume[86890]: DEBUG dbcounter [-] [86890] Writing DB stats cinder:UPDATE=50,cinder:SELECT=40,cinder:INSERT=13,cinder:DELETE=5 {{(pid=86890) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:26:25 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-159e1623-6a27-4be6-a9bb-089921db06f8 tempest-SnapshotDependencyTests-661331874 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:26:25 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-159e1623-6a27-4be6-a9bb-089921db06f8 tempest-SnapshotDependencyTests-661331874 None] Flow 'volume_create_manager' (fd9ce6c3-ff89-4cf3-b358-b0715c315217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:26:25 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-159e1623-6a27-4be6-a9bb-089921db06f8 tempest-SnapshotDependencyTests-661331874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc9d5700-06a3-4bc6-b894-72ab49d261a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:26:25 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-159e1623-6a27-4be6-a9bb-089921db06f8 tempest-SnapshotDependencyTests-661331874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc9d5700-06a3-4bc6-b894-72ab49d261a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:26:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1270249138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50679769-6e83-4218-bf1f-38ec76d3430e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7913a2cf05024a51b8488dc5ace056ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:26:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:26:26Z,use_quota=True,user_id='1eb28fcc01624fb58f4359ebb1ace3cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:26:25 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-159e1623-6a27-4be6-a9bb-089921db06f8 tempest-SnapshotDependencyTests-661331874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34de8351-c9b3-4d31-a4b0-c05b9ed3304b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:26:25 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-159e1623-6a27-4be6-a9bb-089921db06f8 tempest-SnapshotDependencyTests-661331874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34de8351-c9b3-4d31-a4b0-c05b9ed3304b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:26:25 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-159e1623-6a27-4be6-a9bb-089921db06f8 tempest-SnapshotDependencyTests-661331874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d82c9722-3649-4d6a-9ead-e230db462474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:26:25 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-159e1623-6a27-4be6-a9bb-089921db06f8 tempest-SnapshotDependencyTests-661331874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d82c9722-3649-4d6a-9ead-e230db462474) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50679769-6e83-4218-bf1f-38ec76d3430e', 'volume_name': 'volume-50679769-6e83-4218-bf1f-38ec76d3430e', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:26:26 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-159e1623-6a27-4be6-a9bb-089921db06f8 tempest-SnapshotDependencyTests-661331874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (276470c8-93db-47b4-a2c9-65eaf039db30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:26:26 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-159e1623-6a27-4be6-a9bb-089921db06f8 tempest-SnapshotDependencyTests-661331874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (276470c8-93db-47b4-a2c9-65eaf039db30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:26:26 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-159e1623-6a27-4be6-a9bb-089921db06f8 tempest-SnapshotDependencyTests-661331874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef9f79c2-abbf-4437-b910-c8544ee71525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:26:26 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-159e1623-6a27-4be6-a9bb-089921db06f8 tempest-SnapshotDependencyTests-661331874 None] Volume 50679769-6e83-4218-bf1f-38ec76d3430e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50679769-6e83-4218-bf1f-38ec76d3430e', 'volume_size': 1} Nov 02 10:26:26 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-159e1623-6a27-4be6-a9bb-089921db06f8 tempest-SnapshotDependencyTests-661331874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:26:26 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-159e1623-6a27-4be6-a9bb-089921db06f8 tempest-SnapshotDependencyTests-661331874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:26:26 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-159e1623-6a27-4be6-a9bb-089921db06f8 tempest-SnapshotDependencyTests-661331874 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:26:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1270249138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50679769-6e83-4218-bf1f-38ec76d3430e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7913a2cf05024a51b8488dc5ace056ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:26:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:26:26Z,use_quota=True,user_id='1eb28fcc01624fb58f4359ebb1ace3cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)}" {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:26:26 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-159e1623-6a27-4be6-a9bb-089921db06f8 tempest-SnapshotDependencyTests-661331874 None] Creating volume 50679769-6e83-4218-bf1f-38ec76d3430e {{(pid=86890) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:26:26 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-159e1623-6a27-4be6-a9bb-089921db06f8 tempest-SnapshotDependencyTests-661331874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:26:26 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-159e1623-6a27-4be6-a9bb-089921db06f8 tempest-SnapshotDependencyTests-661331874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:26:26 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-159e1623-6a27-4be6-a9bb-089921db06f8 tempest-SnapshotDependencyTests-661331874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:26:26 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-159e1623-6a27-4be6-a9bb-089921db06f8 tempest-SnapshotDependencyTests-661331874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:26:26 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-159e1623-6a27-4be6-a9bb-089921db06f8 tempest-SnapshotDependencyTests-661331874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:26:26 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-159e1623-6a27-4be6-a9bb-089921db06f8 tempest-SnapshotDependencyTests-661331874 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:26:26 devstack cinder-volume[86890]: INFO cinder.volume.drivers.remotefs [None req-159e1623-6a27-4be6-a9bb-089921db06f8 tempest-SnapshotDependencyTests-661331874 None] casted to osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 Nov 02 10:26:26 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-159e1623-6a27-4be6-a9bb-089921db06f8 tempest-SnapshotDependencyTests-661331874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-50679769-6e83-4218-bf1f-38ec76d3430e 1073741824 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:26:26 devstack sudo[106962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-50679769-6e83-4218-bf1f-38ec76d3430e 1073741824 Nov 02 10:26:26 devstack sudo[106962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:26:26 devstack sudo[106962]: pam_unix(sudo:session): session closed for user root Nov 02 10:26:26 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-159e1623-6a27-4be6-a9bb-089921db06f8 tempest-SnapshotDependencyTests-661331874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-50679769-6e83-4218-bf1f-38ec76d3430e 1073741824" returned: 0 in 0.431s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:26:26 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-159e1623-6a27-4be6-a9bb-089921db06f8 tempest-SnapshotDependencyTests-661331874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-50679769-6e83-4218-bf1f-38ec76d3430e {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:26:26 devstack sudo[106968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-50679769-6e83-4218-bf1f-38ec76d3430e Nov 02 10:26:26 devstack sudo[106968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:26:26 devstack sudo[106968]: pam_unix(sudo:session): session closed for user root Nov 02 10:26:26 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-159e1623-6a27-4be6-a9bb-089921db06f8 tempest-SnapshotDependencyTests-661331874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-50679769-6e83-4218-bf1f-38ec76d3430e" returned: 0 in 0.236s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:26:26 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-159e1623-6a27-4be6-a9bb-089921db06f8 tempest-SnapshotDependencyTests-661331874 None] <== create_volume: return (712ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'} {{(pid=86890) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:26:26 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-159e1623-6a27-4be6-a9bb-089921db06f8 tempest-SnapshotDependencyTests-661331874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.714s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:26:26 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-159e1623-6a27-4be6-a9bb-089921db06f8 tempest-SnapshotDependencyTests-661331874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef9f79c2-abbf-4437-b910-c8544ee71525) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50679769-6e83-4218-bf1f-38ec76d3430e', 'volume_size': 1}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:26:26 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-159e1623-6a27-4be6-a9bb-089921db06f8 tempest-SnapshotDependencyTests-661331874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac3d52d6-aaae-44e7-9ef1-ca70e46922be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:26:26 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-159e1623-6a27-4be6-a9bb-089921db06f8 tempest-SnapshotDependencyTests-661331874 None] Volume volume-50679769-6e83-4218-bf1f-38ec76d3430e (50679769-6e83-4218-bf1f-38ec76d3430e): created successfully Nov 02 10:26:26 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-159e1623-6a27-4be6-a9bb-089921db06f8 tempest-SnapshotDependencyTests-661331874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac3d52d6-aaae-44e7-9ef1-ca70e46922be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:26:26 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-159e1623-6a27-4be6-a9bb-089921db06f8 tempest-SnapshotDependencyTests-661331874 None] Flow 'volume_create_manager' (fd9ce6c3-ff89-4cf3-b358-b0715c315217) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:26:26 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-159e1623-6a27-4be6-a9bb-089921db06f8 tempest-SnapshotDependencyTests-661331874 None] Created volume successfully. Nov 02 10:26:27 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-3d59fa50-3046-45d4-92f4-9c9402740bce tempest-SnapshotDependencyTests-661331874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:26:27 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-3d59fa50-3046-45d4-92f4-9c9402740bce tempest-SnapshotDependencyTests-661331874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:26:27 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-3d59fa50-3046-45d4-92f4-9c9402740bce tempest-SnapshotDependencyTests-661331874 None] Creating offline snapshot 723331c9-3ca3-4fd5-a419-1218f3dc9887 of volume 50679769-6e83-4218-bf1f-38ec76d3430e {{(pid=86890) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:26:27 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[369012f2-43b5-47e8-8d70-4e403cc01167]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:26:27 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-3d59fa50-3046-45d4-92f4-9c9402740bce tempest-SnapshotDependencyTests-661331874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-50679769-6e83-4218-bf1f-38ec76d3430e {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:26:27 devstack sudo[106971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-50679769-6e83-4218-bf1f-38ec76d3430e Nov 02 10:26:27 devstack sudo[106971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:26:27 devstack sudo[106971]: pam_unix(sudo:session): session closed for user root Nov 02 10:26:27 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-3d59fa50-3046-45d4-92f4-9c9402740bce tempest-SnapshotDependencyTests-661331874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-50679769-6e83-4218-bf1f-38ec76d3430e" returned: 0 in 0.351s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:26:27 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-3d59fa50-3046-45d4-92f4-9c9402740bce tempest-SnapshotDependencyTests-661331874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-50679769-6e83-4218-bf1f-38ec76d3430e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-50679769-6e83-4218-bf1f-38ec76d3430e.723331c9-3ca3-4fd5-a419-1218f3dc9887 1G {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:26:27 devstack sudo[106976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-50679769-6e83-4218-bf1f-38ec76d3430e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-50679769-6e83-4218-bf1f-38ec76d3430e.723331c9-3ca3-4fd5-a419-1218f3dc9887 1G Nov 02 10:26:27 devstack sudo[106976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:26:27 devstack sudo[106976]: pam_unix(sudo:session): session closed for user root Nov 02 10:26:27 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-3d59fa50-3046-45d4-92f4-9c9402740bce tempest-SnapshotDependencyTests-661331874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-50679769-6e83-4218-bf1f-38ec76d3430e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-50679769-6e83-4218-bf1f-38ec76d3430e.723331c9-3ca3-4fd5-a419-1218f3dc9887 1G" returned: 0 in 0.373s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:26:27 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-3d59fa50-3046-45d4-92f4-9c9402740bce tempest-SnapshotDependencyTests-661331874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50679769-6e83-4218-bf1f-38ec76d3430e -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-50679769-6e83-4218-bf1f-38ec76d3430e.723331c9-3ca3-4fd5-a419-1218f3dc9887 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:26:27 devstack sudo[106981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50679769-6e83-4218-bf1f-38ec76d3430e -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-50679769-6e83-4218-bf1f-38ec76d3430e.723331c9-3ca3-4fd5-a419-1218f3dc9887 Nov 02 10:26:27 devstack sudo[106981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:26:28 devstack sudo[106981]: pam_unix(sudo:session): session closed for user root Nov 02 10:26:28 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-3d59fa50-3046-45d4-92f4-9c9402740bce tempest-SnapshotDependencyTests-661331874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50679769-6e83-4218-bf1f-38ec76d3430e -F qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-50679769-6e83-4218-bf1f-38ec76d3430e.723331c9-3ca3-4fd5-a419-1218f3dc9887" returned: 0 in 0.292s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:26:28 devstack cinder-volume[86890]: WARNING cinder.volume.drivers.remotefs [None req-3d59fa50-3046-45d4-92f4-9c9402740bce tempest-SnapshotDependencyTests-661331874 None] /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-50679769-6e83-4218-bf1f-38ec76d3430e.723331c9-3ca3-4fd5-a419-1218f3dc9887 is being set with open permissions: ugo+rw Nov 02 10:26:28 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-3d59fa50-3046-45d4-92f4-9c9402740bce tempest-SnapshotDependencyTests-661331874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-50679769-6e83-4218-bf1f-38ec76d3430e.723331c9-3ca3-4fd5-a419-1218f3dc9887 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:26:28 devstack sudo[106987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-50679769-6e83-4218-bf1f-38ec76d3430e.723331c9-3ca3-4fd5-a419-1218f3dc9887 Nov 02 10:26:28 devstack sudo[106987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:26:28 devstack sudo[106987]: pam_unix(sudo:session): session closed for user root Nov 02 10:26:28 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-3d59fa50-3046-45d4-92f4-9c9402740bce tempest-SnapshotDependencyTests-661331874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-50679769-6e83-4218-bf1f-38ec76d3430e.723331c9-3ca3-4fd5-a419-1218f3dc9887" returned: 0 in 0.230s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:26:28 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-3d59fa50-3046-45d4-92f4-9c9402740bce tempest-SnapshotDependencyTests-661331874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-50679769-6e83-4218-bf1f-38ec76d3430e.info {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:26:28 devstack sudo[106990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-50679769-6e83-4218-bf1f-38ec76d3430e.info Nov 02 10:26:28 devstack sudo[106990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:26:28 devstack sudo[106990]: pam_unix(sudo:session): session closed for user root Nov 02 10:26:28 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-3d59fa50-3046-45d4-92f4-9c9402740bce tempest-SnapshotDependencyTests-661331874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-50679769-6e83-4218-bf1f-38ec76d3430e.info" returned: 0 in 0.262s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:26:28 devstack cinder-volume[86890]: WARNING cinder.volume.drivers.remotefs [None req-3d59fa50-3046-45d4-92f4-9c9402740bce tempest-SnapshotDependencyTests-661331874 None] /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-50679769-6e83-4218-bf1f-38ec76d3430e.info is being set with open permissions: ugo+rw Nov 02 10:26:28 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-3d59fa50-3046-45d4-92f4-9c9402740bce tempest-SnapshotDependencyTests-661331874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-50679769-6e83-4218-bf1f-38ec76d3430e.info {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:26:28 devstack sudo[106993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-50679769-6e83-4218-bf1f-38ec76d3430e.info Nov 02 10:26:28 devstack sudo[106993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:26:28 devstack sudo[106993]: pam_unix(sudo:session): session closed for user root Nov 02 10:26:28 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-3d59fa50-3046-45d4-92f4-9c9402740bce tempest-SnapshotDependencyTests-661331874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-50679769-6e83-4218-bf1f-38ec76d3430e.info" returned: 0 in 0.233s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:26:28 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-3d59fa50-3046-45d4-92f4-9c9402740bce tempest-SnapshotDependencyTests-661331874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.827s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:26:29 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-3d59fa50-3046-45d4-92f4-9c9402740bce tempest-SnapshotDependencyTests-661331874 None] Create snapshot completed successfully Nov 02 10:26:29 devstack cinder-volume[86890]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6a99e7e-2525-476d-b91f-26b725b2b846 tempest-SnapshotDependencyTests-661331874 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86890) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:26:29 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-b6a99e7e-2525-476d-b91f-26b725b2b846 tempest-SnapshotDependencyTests-661331874 None] Flow 'volume_create_manager' (1ca1859e-795a-4b02-ab41-3d809a7ac4d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:26:29 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-b6a99e7e-2525-476d-b91f-26b725b2b846 tempest-SnapshotDependencyTests-661331874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ce2600e-78eb-4bf3-9c12-a3a2d3bf9301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:26:29 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-b6a99e7e-2525-476d-b91f-26b725b2b846 tempest-SnapshotDependencyTests-661331874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ce2600e-78eb-4bf3-9c12-a3a2d3bf9301) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:26:30Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b951cfe8-e8b8-46f9-a5bd-0ff7eb4464ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7913a2cf05024a51b8488dc5ace056ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:26:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=723331c9-3ca3-4fd5-a419-1218f3dc9887,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:26:30Z,use_quota=True,user_id='1eb28fcc01624fb58f4359ebb1ace3cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ffe817-dc8b-4661-9511-e5656c91a7fe),volume_type_id=a8ffe817-dc8b-4661-9511-e5656c91a7fe)' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:26:29 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-b6a99e7e-2525-476d-b91f-26b725b2b846 tempest-SnapshotDependencyTests-661331874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a75c55ab-2197-4cb1-b27f-a61b975d3e28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:26:29 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-b6a99e7e-2525-476d-b91f-26b725b2b846 tempest-SnapshotDependencyTests-661331874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a75c55ab-2197-4cb1-b27f-a61b975d3e28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:26:29 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-b6a99e7e-2525-476d-b91f-26b725b2b846 tempest-SnapshotDependencyTests-661331874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40979af2-8fc7-4bbe-938a-921d2512726b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:26:29 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-b6a99e7e-2525-476d-b91f-26b725b2b846 tempest-SnapshotDependencyTests-661331874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40979af2-8fc7-4bbe-938a-921d2512726b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b951cfe8-e8b8-46f9-a5bd-0ff7eb4464ac', 'volume_name': 'volume-b951cfe8-e8b8-46f9-a5bd-0ff7eb4464ac', 'volume_size': 1, 'snapshot_id': '723331c9-3ca3-4fd5-a419-1218f3dc9887'}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:26:29 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-b6a99e7e-2525-476d-b91f-26b725b2b846 tempest-SnapshotDependencyTests-661331874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (333d43a8-c1a4-4d0f-82c4-fc0d14691c2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:26:29 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-b6a99e7e-2525-476d-b91f-26b725b2b846 tempest-SnapshotDependencyTests-661331874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (333d43a8-c1a4-4d0f-82c4-fc0d14691c2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:26:29 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-b6a99e7e-2525-476d-b91f-26b725b2b846 tempest-SnapshotDependencyTests-661331874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdd3cb56-eff2-46ec-86d6-76a9389e70dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:26:29 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-b6a99e7e-2525-476d-b91f-26b725b2b846 tempest-SnapshotDependencyTests-661331874 None] Volume b951cfe8-e8b8-46f9-a5bd-0ff7eb4464ac: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b951cfe8-e8b8-46f9-a5bd-0ff7eb4464ac', 'volume_size': 1, 'snapshot_id': '723331c9-3ca3-4fd5-a419-1218f3dc9887'} Nov 02 10:26:29 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-b6a99e7e-2525-476d-b91f-26b725b2b846 tempest-SnapshotDependencyTests-661331874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:26:29 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-b6a99e7e-2525-476d-b91f-26b725b2b846 tempest-SnapshotDependencyTests-661331874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:26:29 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-b6a99e7e-2525-476d-b91f-26b725b2b846 tempest-SnapshotDependencyTests-661331874 None] Acquiring lock "cinder-quobyte-723331c9-3ca3-4fd5-a419-1218f3dc9887-b951cfe8-e8b8-46f9-a5bd-0ff7eb4464ac" by "_create_volume_from_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:26:29 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-b6a99e7e-2525-476d-b91f-26b725b2b846 tempest-SnapshotDependencyTests-661331874 None] Lock "cinder-quobyte-723331c9-3ca3-4fd5-a419-1218f3dc9887-b951cfe8-e8b8-46f9-a5bd-0ff7eb4464ac" acquired by "_create_volume_from_snapshot" :: waited 0.012s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:26:29 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-b6a99e7e-2525-476d-b91f-26b725b2b846 tempest-SnapshotDependencyTests-661331874 None] Creating volume b951cfe8-e8b8-46f9-a5bd-0ff7eb4464ac from snapshot 723331c9-3ca3-4fd5-a419-1218f3dc9887 {{(pid=86890) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 02 10:26:29 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-b6a99e7e-2525-476d-b91f-26b725b2b846 tempest-SnapshotDependencyTests-661331874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:26:29 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-b6a99e7e-2525-476d-b91f-26b725b2b846 tempest-SnapshotDependencyTests-661331874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:26:29 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-b6a99e7e-2525-476d-b91f-26b725b2b846 tempest-SnapshotDependencyTests-661331874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:26:29 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-b6a99e7e-2525-476d-b91f-26b725b2b846 tempest-SnapshotDependencyTests-661331874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:26:29 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-b6a99e7e-2525-476d-b91f-26b725b2b846 tempest-SnapshotDependencyTests-661331874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:26:29 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-b6a99e7e-2525-476d-b91f-26b725b2b846 tempest-SnapshotDependencyTests-661331874 None] Selected osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67 as target Quobyte volume. {{(pid=86890) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:26:29 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-b6a99e7e-2525-476d-b91f-26b725b2b846 tempest-SnapshotDependencyTests-661331874 None] Acquiring lock "cinder-quobyte-b951cfe8-e8b8-46f9-a5bd-0ff7eb4464ac" by "_copy_volume_from_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:26:30 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-b6a99e7e-2525-476d-b91f-26b725b2b846 tempest-SnapshotDependencyTests-661331874 None] Lock "cinder-quobyte-b951cfe8-e8b8-46f9-a5bd-0ff7eb4464ac" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:26:30 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-b6a99e7e-2525-476d-b91f-26b725b2b846 tempest-SnapshotDependencyTests-661331874 None] snapshot: 723331c9-3ca3-4fd5-a419-1218f3dc9887, volume: b951cfe8-e8b8-46f9-a5bd-0ff7eb4464ac, {{(pid=86890) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 10:26:30 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-b6a99e7e-2525-476d-b91f-26b725b2b846 tempest-SnapshotDependencyTests-661331874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:26:30 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-b6a99e7e-2525-476d-b91f-26b725b2b846 tempest-SnapshotDependencyTests-661331874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:26:30 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-b6a99e7e-2525-476d-b91f-26b725b2b846 tempest-SnapshotDependencyTests-661331874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:26:30 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-b6a99e7e-2525-476d-b91f-26b725b2b846 tempest-SnapshotDependencyTests-661331874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:26:30 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-b6a99e7e-2525-476d-b91f-26b725b2b846 tempest-SnapshotDependencyTests-661331874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:26:30 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[959f90dc-ef8c-4489-b5bc-cb29c6facd42]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:26:30 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-b6a99e7e-2525-476d-b91f-26b725b2b846 tempest-SnapshotDependencyTests-661331874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-50679769-6e83-4218-bf1f-38ec76d3430e.723331c9-3ca3-4fd5-a419-1218f3dc9887 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:26:30 devstack sudo[106996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-50679769-6e83-4218-bf1f-38ec76d3430e.723331c9-3ca3-4fd5-a419-1218f3dc9887 Nov 02 10:26:30 devstack sudo[106996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:26:30 devstack sudo[106996]: pam_unix(sudo:session): session closed for user root Nov 02 10:26:30 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-b6a99e7e-2525-476d-b91f-26b725b2b846 tempest-SnapshotDependencyTests-661331874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-50679769-6e83-4218-bf1f-38ec76d3430e.723331c9-3ca3-4fd5-a419-1218f3dc9887" returned: 0 in 0.355s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:26:30 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-b6a99e7e-2525-476d-b91f-26b725b2b846 tempest-SnapshotDependencyTests-661331874 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-50679769-6e83-4218-bf1f-38ec76d3430e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86890) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:26:30 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a13dc6d-4bf9-4644-b1b0-a4b5d66caf97]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:26:30 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-b6a99e7e-2525-476d-b91f-26b725b2b846 tempest-SnapshotDependencyTests-661331874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-50679769-6e83-4218-bf1f-38ec76d3430e {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:26:30 devstack sudo[107001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-50679769-6e83-4218-bf1f-38ec76d3430e Nov 02 10:26:30 devstack sudo[107001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:26:30 devstack sudo[107001]: pam_unix(sudo:session): session closed for user root Nov 02 10:26:30 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-b6a99e7e-2525-476d-b91f-26b725b2b846 tempest-SnapshotDependencyTests-661331874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-50679769-6e83-4218-bf1f-38ec76d3430e" returned: 0 in 0.390s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:26:30 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-b6a99e7e-2525-476d-b91f-26b725b2b846 tempest-SnapshotDependencyTests-661331874 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-50679769-6e83-4218-bf1f-38ec76d3430e {{(pid=86890) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 10:26:30 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-b6a99e7e-2525-476d-b91f-26b725b2b846 tempest-SnapshotDependencyTests-661331874 None] Creating direct copy from snapshot {{(pid=86890) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 10:26:30 devstack cinder-volume[86890]: DEBUG cinder.utils [None req-b6a99e7e-2525-476d-b91f-26b725b2b846 tempest-SnapshotDependencyTests-661331874 None] Path /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b951cfe8-e8b8-46f9-a5bd-0ff7eb4464ac not found in is_blk_device check {{(pid=86890) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 10:26:30 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-b6a99e7e-2525-476d-b91f-26b725b2b846 tempest-SnapshotDependencyTests-661331874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-50679769-6e83-4218-bf1f-38ec76d3430e /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b951cfe8-e8b8-46f9-a5bd-0ff7eb4464ac {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:26:30 devstack sudo[107006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-50679769-6e83-4218-bf1f-38ec76d3430e /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b951cfe8-e8b8-46f9-a5bd-0ff7eb4464ac Nov 02 10:26:30 devstack sudo[107006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:26:34 devstack cinder-volume[86890]: DEBUG oslo_service.periodic_task [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86890) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:26:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:26:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:26:34 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:26:34 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:26:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:26:34 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:26:34 devstack sudo[107020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:26:34 devstack sudo[107020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:26:35 devstack sudo[107020]: pam_unix(sudo:session): session closed for user root Nov 02 10:26:35 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.311s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:26:35 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:26:35 devstack cinder-volume[86890]: DEBUG oslo_service.periodic_task [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] Running periodic task VolumeManager._thread_info {{(pid=86890) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:26:35 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] thread count: 29 {{(pid=86890) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:26:35 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-c3fe0701-b9e8-4da9-83cc-ff9b66000c6b None None] thread info: [<_MainThread(MainThread, started 133913319395456)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86890) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:26:36 devstack sudo[107006]: pam_unix(sudo:session): session closed for user root Nov 02 10:26:36 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-b6a99e7e-2525-476d-b91f-26b725b2b846 tempest-SnapshotDependencyTests-661331874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-50679769-6e83-4218-bf1f-38ec76d3430e /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b951cfe8-e8b8-46f9-a5bd-0ff7eb4464ac" returned: 0 in 5.513s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:26:36 devstack cinder-volume[86890]: DEBUG cinder.image.image_utils [None req-b6a99e7e-2525-476d-b91f-26b725b2b846 tempest-SnapshotDependencyTests-661331874 None] Image conversion details: src /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-50679769-6e83-4218-bf1f-38ec76d3430e, size 1024.00 MB, duration 5.51 sec, destination /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b951cfe8-e8b8-46f9-a5bd-0ff7eb4464ac {{(pid=86890) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 10:26:36 devstack cinder-volume[86890]: INFO cinder.image.image_utils [None req-b6a99e7e-2525-476d-b91f-26b725b2b846 tempest-SnapshotDependencyTests-661331874 None] Converted 1024.00 MB image at 185.71 MB/s Nov 02 10:26:36 devstack cinder-volume[86890]: WARNING cinder.volume.drivers.remotefs [None req-b6a99e7e-2525-476d-b91f-26b725b2b846 tempest-SnapshotDependencyTests-661331874 None] /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b951cfe8-e8b8-46f9-a5bd-0ff7eb4464ac is being set with open permissions: ugo+rw Nov 02 10:26:36 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-b6a99e7e-2525-476d-b91f-26b725b2b846 tempest-SnapshotDependencyTests-661331874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b951cfe8-e8b8-46f9-a5bd-0ff7eb4464ac {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:26:36 devstack sudo[107023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b951cfe8-e8b8-46f9-a5bd-0ff7eb4464ac Nov 02 10:26:36 devstack sudo[107023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:26:36 devstack sudo[107023]: pam_unix(sudo:session): session closed for user root Nov 02 10:26:36 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-b6a99e7e-2525-476d-b91f-26b725b2b846 tempest-SnapshotDependencyTests-661331874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b951cfe8-e8b8-46f9-a5bd-0ff7eb4464ac" returned: 0 in 0.224s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:26:36 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-b6a99e7e-2525-476d-b91f-26b725b2b846 tempest-SnapshotDependencyTests-661331874 None] Lock "cinder-quobyte-b951cfe8-e8b8-46f9-a5bd-0ff7eb4464ac" released by "_copy_volume_from_snapshot" :: held 6.559s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:26:36 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-b6a99e7e-2525-476d-b91f-26b725b2b846 tempest-SnapshotDependencyTests-661331874 None] Lock "cinder-quobyte-723331c9-3ca3-4fd5-a419-1218f3dc9887-b951cfe8-e8b8-46f9-a5bd-0ff7eb4464ac" released by "_create_volume_from_snapshot" :: held 6.614s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:26:36 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-b6a99e7e-2525-476d-b91f-26b725b2b846 tempest-SnapshotDependencyTests-661331874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.628s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:26:36 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-b6a99e7e-2525-476d-b91f-26b725b2b846 tempest-SnapshotDependencyTests-661331874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdd3cb56-eff2-46ec-86d6-76a9389e70dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b951cfe8-e8b8-46f9-a5bd-0ff7eb4464ac', 'volume_size': 1, 'snapshot_id': '723331c9-3ca3-4fd5-a419-1218f3dc9887'}' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:26:36 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-b6a99e7e-2525-476d-b91f-26b725b2b846 tempest-SnapshotDependencyTests-661331874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a6806c2-d8f6-440b-9457-3bc35de24f5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:26:36 devstack cinder-volume[86890]: INFO cinder.volume.flows.manager.create_volume [None req-b6a99e7e-2525-476d-b91f-26b725b2b846 tempest-SnapshotDependencyTests-661331874 None] Volume volume-b951cfe8-e8b8-46f9-a5bd-0ff7eb4464ac (b951cfe8-e8b8-46f9-a5bd-0ff7eb4464ac): created successfully Nov 02 10:26:36 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-b6a99e7e-2525-476d-b91f-26b725b2b846 tempest-SnapshotDependencyTests-661331874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a6806c2-d8f6-440b-9457-3bc35de24f5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86890) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:26:36 devstack cinder-volume[86890]: DEBUG cinder.volume.manager [None req-b6a99e7e-2525-476d-b91f-26b725b2b846 tempest-SnapshotDependencyTests-661331874 None] Flow 'volume_create_manager' (1ca1859e-795a-4b02-ab41-3d809a7ac4d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86890) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:26:36 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-b6a99e7e-2525-476d-b91f-26b725b2b846 tempest-SnapshotDependencyTests-661331874 None] Created volume successfully. Nov 02 10:26:37 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-f9d1e148-cc24-4cbd-9010-cb76ca7af99e tempest-SnapshotDependencyTests-661331874 None] Acquiring lock "cinder-723331c9-3ca3-4fd5-a419-1218f3dc9887-delete_snapshot" by "delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:26:37 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-f9d1e148-cc24-4cbd-9010-cb76ca7af99e tempest-SnapshotDependencyTests-661331874 None] Lock "cinder-723331c9-3ca3-4fd5-a419-1218f3dc9887-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:26:37 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-f9d1e148-cc24-4cbd-9010-cb76ca7af99e tempest-SnapshotDependencyTests-661331874 None] Acquiring lock "cinder-quobyte-50679769-6e83-4218-bf1f-38ec76d3430e" by "delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:26:37 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-f9d1e148-cc24-4cbd-9010-cb76ca7af99e tempest-SnapshotDependencyTests-661331874 None] Lock "cinder-quobyte-50679769-6e83-4218-bf1f-38ec76d3430e" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:26:37 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-f9d1e148-cc24-4cbd-9010-cb76ca7af99e tempest-SnapshotDependencyTests-661331874 None] Acquiring lock "cinder-quobyte-723331c9-3ca3-4fd5-a419-1218f3dc9887" by "_delete_snapshot" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:26:37 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-f9d1e148-cc24-4cbd-9010-cb76ca7af99e tempest-SnapshotDependencyTests-661331874 None] Lock "cinder-quobyte-723331c9-3ca3-4fd5-a419-1218f3dc9887" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:26:37 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-f9d1e148-cc24-4cbd-9010-cb76ca7af99e tempest-SnapshotDependencyTests-661331874 None] Deleting offline snapshot 723331c9-3ca3-4fd5-a419-1218f3dc9887 of volume 50679769-6e83-4218-bf1f-38ec76d3430e {{(pid=86890) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:26:37 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-f9d1e148-cc24-4cbd-9010-cb76ca7af99e tempest-SnapshotDependencyTests-661331874 None] snapshot_file for this snap is: volume-50679769-6e83-4218-bf1f-38ec76d3430e.723331c9-3ca3-4fd5-a419-1218f3dc9887 {{(pid=86890) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:26:37 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[c895c12a-165b-4057-83d9-985d995eee6d]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:26:37 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-f9d1e148-cc24-4cbd-9010-cb76ca7af99e tempest-SnapshotDependencyTests-661331874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-50679769-6e83-4218-bf1f-38ec76d3430e.723331c9-3ca3-4fd5-a419-1218f3dc9887 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:26:37 devstack sudo[107026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-50679769-6e83-4218-bf1f-38ec76d3430e.723331c9-3ca3-4fd5-a419-1218f3dc9887 Nov 02 10:26:37 devstack sudo[107026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:26:37 devstack sudo[107026]: pam_unix(sudo:session): session closed for user root Nov 02 10:26:37 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-f9d1e148-cc24-4cbd-9010-cb76ca7af99e tempest-SnapshotDependencyTests-661331874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-50679769-6e83-4218-bf1f-38ec76d3430e.723331c9-3ca3-4fd5-a419-1218f3dc9887" returned: 0 in 0.335s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:26:37 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.remotefs [None req-f9d1e148-cc24-4cbd-9010-cb76ca7af99e tempest-SnapshotDependencyTests-661331874 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-50679769-6e83-4218-bf1f-38ec76d3430e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86890) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:26:37 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fc0e5cc-fe98-40d2-ade4-f9e191237d20]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:26:37 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-f9d1e148-cc24-4cbd-9010-cb76ca7af99e tempest-SnapshotDependencyTests-661331874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-50679769-6e83-4218-bf1f-38ec76d3430e {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:26:38 devstack sudo[107031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-50679769-6e83-4218-bf1f-38ec76d3430e Nov 02 10:26:38 devstack sudo[107031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:26:38 devstack sudo[107031]: pam_unix(sudo:session): session closed for user root Nov 02 10:26:38 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-f9d1e148-cc24-4cbd-9010-cb76ca7af99e tempest-SnapshotDependencyTests-661331874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-50679769-6e83-4218-bf1f-38ec76d3430e" returned: 0 in 0.497s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:26:38 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-f9d1e148-cc24-4cbd-9010-cb76ca7af99e tempest-SnapshotDependencyTests-661331874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-50679769-6e83-4218-bf1f-38ec76d3430e.723331c9-3ca3-4fd5-a419-1218f3dc9887 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:26:38 devstack sudo[107036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-50679769-6e83-4218-bf1f-38ec76d3430e.723331c9-3ca3-4fd5-a419-1218f3dc9887 Nov 02 10:26:38 devstack sudo[107036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:26:38 devstack sudo[107036]: pam_unix(sudo:session): session closed for user root Nov 02 10:26:38 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-f9d1e148-cc24-4cbd-9010-cb76ca7af99e tempest-SnapshotDependencyTests-661331874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-50679769-6e83-4218-bf1f-38ec76d3430e.723331c9-3ca3-4fd5-a419-1218f3dc9887" returned: 0 in 0.330s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:26:38 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-f9d1e148-cc24-4cbd-9010-cb76ca7af99e tempest-SnapshotDependencyTests-661331874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-50679769-6e83-4218-bf1f-38ec76d3430e.723331c9-3ca3-4fd5-a419-1218f3dc9887 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:26:38 devstack sudo[107041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-50679769-6e83-4218-bf1f-38ec76d3430e.723331c9-3ca3-4fd5-a419-1218f3dc9887 Nov 02 10:26:38 devstack sudo[107041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:26:39 devstack sudo[107041]: pam_unix(sudo:session): session closed for user root Nov 02 10:26:39 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-f9d1e148-cc24-4cbd-9010-cb76ca7af99e tempest-SnapshotDependencyTests-661331874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-50679769-6e83-4218-bf1f-38ec76d3430e.723331c9-3ca3-4fd5-a419-1218f3dc9887" returned: 0 in 0.229s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:26:39 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-f9d1e148-cc24-4cbd-9010-cb76ca7af99e tempest-SnapshotDependencyTests-661331874 None] Lock "cinder-quobyte-723331c9-3ca3-4fd5-a419-1218f3dc9887" released by "_delete_snapshot" :: held 1.488s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:26:39 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-f9d1e148-cc24-4cbd-9010-cb76ca7af99e tempest-SnapshotDependencyTests-661331874 None] Lock "cinder-quobyte-50679769-6e83-4218-bf1f-38ec76d3430e" released by "delete_snapshot" :: held 1.511s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:26:39 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-f9d1e148-cc24-4cbd-9010-cb76ca7af99e tempest-SnapshotDependencyTests-661331874 None] Created reservations ['c41e1f4c-e33d-40dc-8521-d5eea93baaea', 'eb1e99a8-bc76-4052-9e09-ef8048cb0914', '87c680ba-cef6-4925-98c7-c80e0f19c58d', '4204bad3-887f-496d-849e-fa9c5329cb1e'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:26:39 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-f9d1e148-cc24-4cbd-9010-cb76ca7af99e tempest-SnapshotDependencyTests-661331874 None] Delete snapshot completed successfully. Nov 02 10:26:39 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-f9d1e148-cc24-4cbd-9010-cb76ca7af99e tempest-SnapshotDependencyTests-661331874 None] Lock "cinder-723331c9-3ca3-4fd5-a419-1218f3dc9887-delete_snapshot" released by "delete_snapshot" :: held 1.644s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:26:39 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-bf91410b-85f1-451b-9576-fc5e0236007d tempest-SnapshotDependencyTests-661331874 None] Acquiring lock "cinder-50679769-6e83-4218-bf1f-38ec76d3430e-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:26:39 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-bf91410b-85f1-451b-9576-fc5e0236007d tempest-SnapshotDependencyTests-661331874 None] Lock "cinder-50679769-6e83-4218-bf1f-38ec76d3430e-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:26:39 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-bf91410b-85f1-451b-9576-fc5e0236007d tempest-SnapshotDependencyTests-661331874 None] Acquiring lock "cinder-quobyte-50679769-6e83-4218-bf1f-38ec76d3430e" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:26:39 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-bf91410b-85f1-451b-9576-fc5e0236007d tempest-SnapshotDependencyTests-661331874 None] Lock "cinder-quobyte-50679769-6e83-4218-bf1f-38ec76d3430e" acquired by "delete_volume" :: waited 0.014s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:26:39 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f9d91b0-48ea-4640-b090-db72b6a7d817]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:26:39 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-bf91410b-85f1-451b-9576-fc5e0236007d tempest-SnapshotDependencyTests-661331874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-50679769-6e83-4218-bf1f-38ec76d3430e {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:26:39 devstack sudo[107044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-50679769-6e83-4218-bf1f-38ec76d3430e Nov 02 10:26:39 devstack sudo[107044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:26:40 devstack sudo[107044]: pam_unix(sudo:session): session closed for user root Nov 02 10:26:40 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-bf91410b-85f1-451b-9576-fc5e0236007d tempest-SnapshotDependencyTests-661331874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-50679769-6e83-4218-bf1f-38ec76d3430e" returned: 0 in 0.341s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:26:40 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-bf91410b-85f1-451b-9576-fc5e0236007d tempest-SnapshotDependencyTests-661331874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-50679769-6e83-4218-bf1f-38ec76d3430e {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:26:40 devstack sudo[107049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-50679769-6e83-4218-bf1f-38ec76d3430e Nov 02 10:26:40 devstack sudo[107049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:26:40 devstack sudo[107049]: pam_unix(sudo:session): session closed for user root Nov 02 10:26:40 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-bf91410b-85f1-451b-9576-fc5e0236007d tempest-SnapshotDependencyTests-661331874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-50679769-6e83-4218-bf1f-38ec76d3430e" returned: 0 in 0.230s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:26:40 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-bf91410b-85f1-451b-9576-fc5e0236007d tempest-SnapshotDependencyTests-661331874 None] Lock "cinder-quobyte-50679769-6e83-4218-bf1f-38ec76d3430e" released by "delete_volume" :: held 0.633s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:26:40 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-bf91410b-85f1-451b-9576-fc5e0236007d tempest-SnapshotDependencyTests-661331874 None] Created reservations ['7df93129-7bd1-4c46-af6e-17e2f4e80242', '66ee4ac0-8cb7-411a-aa52-494b8c5c5c99', '5d9d2e40-b931-4bc0-a8a0-49bb9d9b0dec', '0ba20d33-8852-4462-ba12-1531c394e4cc'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:26:40 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-bf91410b-85f1-451b-9576-fc5e0236007d tempest-SnapshotDependencyTests-661331874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:26:40 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-bf91410b-85f1-451b-9576-fc5e0236007d tempest-SnapshotDependencyTests-661331874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:26:40 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-bf91410b-85f1-451b-9576-fc5e0236007d tempest-SnapshotDependencyTests-661331874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:26:40 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-bf91410b-85f1-451b-9576-fc5e0236007d tempest-SnapshotDependencyTests-661331874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:26:40 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-bf91410b-85f1-451b-9576-fc5e0236007d tempest-SnapshotDependencyTests-661331874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:26:40 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-bf91410b-85f1-451b-9576-fc5e0236007d tempest-SnapshotDependencyTests-661331874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:26:40 devstack sudo[107052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:26:40 devstack sudo[107052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:26:40 devstack sudo[107052]: pam_unix(sudo:session): session closed for user root Nov 02 10:26:40 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-bf91410b-85f1-451b-9576-fc5e0236007d tempest-SnapshotDependencyTests-661331874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.243s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:26:40 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-bf91410b-85f1-451b-9576-fc5e0236007d tempest-SnapshotDependencyTests-661331874 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:26:40 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-bf91410b-85f1-451b-9576-fc5e0236007d tempest-SnapshotDependencyTests-661331874 None] Deleted volume successfully. Nov 02 10:26:40 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-bf91410b-85f1-451b-9576-fc5e0236007d tempest-SnapshotDependencyTests-661331874 None] Lock "cinder-50679769-6e83-4218-bf1f-38ec76d3430e-delete_volume" released by "delete_volume" :: held 1.051s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:26:40 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-bae5e746-e76c-40e2-b570-d7e265bddb7f tempest-SnapshotDependencyTests-661331874 None] Acquiring lock "cinder-b951cfe8-e8b8-46f9-a5bd-0ff7eb4464ac-delete_volume" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:26:40 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-bae5e746-e76c-40e2-b570-d7e265bddb7f tempest-SnapshotDependencyTests-661331874 None] Lock "cinder-b951cfe8-e8b8-46f9-a5bd-0ff7eb4464ac-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:26:40 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-bae5e746-e76c-40e2-b570-d7e265bddb7f tempest-SnapshotDependencyTests-661331874 None] Acquiring lock "cinder-quobyte-b951cfe8-e8b8-46f9-a5bd-0ff7eb4464ac" by "delete_volume" {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:26:40 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-bae5e746-e76c-40e2-b570-d7e265bddb7f tempest-SnapshotDependencyTests-661331874 None] Lock "cinder-quobyte-b951cfe8-e8b8-46f9-a5bd-0ff7eb4464ac" acquired by "delete_volume" :: waited 0.014s {{(pid=86890) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:26:40 devstack cinder-volume[86890]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb6a1417-e8e7-472e-8687-f59749421256]: (4, 'qcow2') {{(pid=87612) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:26:40 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-bae5e746-e76c-40e2-b570-d7e265bddb7f tempest-SnapshotDependencyTests-661331874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b951cfe8-e8b8-46f9-a5bd-0ff7eb4464ac {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:26:41 devstack sudo[107055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b951cfe8-e8b8-46f9-a5bd-0ff7eb4464ac Nov 02 10:26:41 devstack sudo[107055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:26:41 devstack sudo[107055]: pam_unix(sudo:session): session closed for user root Nov 02 10:26:41 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-bae5e746-e76c-40e2-b570-d7e265bddb7f tempest-SnapshotDependencyTests-661331874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b951cfe8-e8b8-46f9-a5bd-0ff7eb4464ac" returned: 0 in 0.347s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:26:41 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-bae5e746-e76c-40e2-b570-d7e265bddb7f tempest-SnapshotDependencyTests-661331874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b951cfe8-e8b8-46f9-a5bd-0ff7eb4464ac {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:26:41 devstack sudo[107060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b951cfe8-e8b8-46f9-a5bd-0ff7eb4464ac Nov 02 10:26:41 devstack sudo[107060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:26:41 devstack sudo[107060]: pam_unix(sudo:session): session closed for user root Nov 02 10:26:41 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-bae5e746-e76c-40e2-b570-d7e265bddb7f tempest-SnapshotDependencyTests-661331874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785/volume-b951cfe8-e8b8-46f9-a5bd-0ff7eb4464ac" returned: 0 in 0.248s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:26:41 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-bae5e746-e76c-40e2-b570-d7e265bddb7f tempest-SnapshotDependencyTests-661331874 None] Lock "cinder-quobyte-b951cfe8-e8b8-46f9-a5bd-0ff7eb4464ac" released by "delete_volume" :: held 0.635s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:26:41 devstack cinder-volume[86890]: DEBUG cinder.quota [None req-bae5e746-e76c-40e2-b570-d7e265bddb7f tempest-SnapshotDependencyTests-661331874 None] Created reservations ['1e6249e4-3681-4b73-bd86-633512a4e52e', 'f3d150de-c5c2-4026-bdc4-8ac7bf4ec701', '83ca9029-669b-42e8-8a75-e06666a210bb', 'b0cc6731-dd1f-41ff-83c5-d1750f5139e0'] {{(pid=86890) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:26:41 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-bae5e746-e76c-40e2-b570-d7e265bddb7f tempest-SnapshotDependencyTests-661331874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:26:41 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-bae5e746-e76c-40e2-b570-d7e265bddb7f tempest-SnapshotDependencyTests-661331874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:26:41 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-bae5e746-e76c-40e2-b570-d7e265bddb7f tempest-SnapshotDependencyTests-661331874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67': None} {{(pid=86890) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:26:41 devstack cinder-volume[86890]: DEBUG cinder.volume.drivers.quobyte [None req-bae5e746-e76c-40e2-b570-d7e265bddb7f tempest-SnapshotDependencyTests-661331874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659174b7-8bfa-40e1-9d18-26b3999d9f67'] {{(pid=86890) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:26:41 devstack cinder-volume[86890]: DEBUG oslo_concurrency.lockutils [None req-bae5e746-e76c-40e2-b570-d7e265bddb7f tempest-SnapshotDependencyTests-661331874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86890) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:26:41 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-bae5e746-e76c-40e2-b570-d7e265bddb7f tempest-SnapshotDependencyTests-661331874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:26:41 devstack sudo[107063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785 Nov 02 10:26:41 devstack sudo[107063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:26:41 devstack sudo[107063]: pam_unix(sudo:session): session closed for user root Nov 02 10:26:41 devstack cinder-volume[86890]: DEBUG oslo_concurrency.processutils [None req-bae5e746-e76c-40e2-b570-d7e265bddb7f tempest-SnapshotDependencyTests-661331874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bb68e25301bc6c5945e3dcb98fb71785" returned: 0 in 0.251s {{(pid=86890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:26:41 devstack cinder-volume[86890]: DEBUG cinder.manager [None req-bae5e746-e76c-40e2-b570-d7e265bddb7f tempest-SnapshotDependencyTests-661331874 None] Notifying Schedulers of capabilities ... {{(pid=86890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:26:41 devstack cinder-volume[86890]: INFO cinder.volume.manager [None req-bae5e746-e76c-40e2-b570-d7e265bddb7f tempest-SnapshotDependencyTests-661331874 None] Deleted volume successfully. Nov 02 10:26:41 devstack cinder-volume[86890]: DEBUG cinder.coordination [None req-bae5e746-e76c-40e2-b570-d7e265bddb7f tempest-SnapshotDependencyTests-661331874 None] Lock "cinder-b951cfe8-e8b8-46f9-a5bd-0ff7eb4464ac-delete_volume" released by "delete_volume" :: held 1.078s {{(pid=86890) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:26:51 devstack cinder-volume[86890]: DEBUG dbcounter [-] [86890] Writing DB stats cinder:UPDATE=30,cinder:SELECT=25,cinder:INSERT=9,cinder:DELETE=2 {{(pid=86890) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:26:51 devstack cinder-volume[86890]: DEBUG dbcounter [-] [86890] Writing DB stats cinder:SELECT=24,cinder:UPDATE=28,cinder:DELETE=3,cinder:INSERT=6 {{(pid=86890) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:27:06 devstack cinder-volume[86890]: DEBUG dbcounter [-] [86890] Writing DB stats cinder:SELECT=1 {{(pid=86890) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:27:06 devstack cinder-volume[86890]: DEBUG dbcounter [-] [86890] Writing DB stats cinder:UPDATE=1 {{(pid=86890) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}